migrating from 0.6 to 0.8, "java.io.IOError: ... cannot extend file to required size"

ian douglas Tue, 09 Aug 2011 11:17:11 -0700

Hey all,

Thanks to thobbs_ patience in IRC this morning, I got the last of myquestions answered about migrating from v0.6 to v0.8. My cassandra.yamlis mostly stock out of the box other than IP's, ports (I'm running v0.6on my workstation at the same time as v0.8), and our cluster name.

I used the v0.8 conf/schema-sample.txt to create a basic keyspace andour column families, all pretty basic, looking like this:


create keyspace armorgames
    with strategy_options=[{replication_factor:2}]
    and placement_strategy = 'org.apache.cassandra.locator.SimpleStrategy';

use armorgames;

create column family GameSave2
     with comparator = BytesType
     and keys_cached = 20000
     and rows_cached = 0
     and row_cache_save_period = 0
     and key_cache_save_period = 14400
     and memtable_flush_after = 60
     and memtable_throughput = 255
     and memtable_operations = 0.29;

create column family UserData
    with column_type = Super
    and comparator = BytesType
    and subcomparator = BytesType
    and rows_cached = 0
    and row_cache_save_period = 0
    and key_cache_save_period = 14400
    and memtable_flush_after = 60
    and memtable_throughput = 255
    and memtable_operations = 0.29;

I started up v0.8, used the CLI tool to get the schema importedsuccessfully, shut down v0.8, copied the binary data from my v0.6/data/armorgames/ path to my v0.8 data path, and restarted v0.8, and nowget IO errors. Thanks for any assitance!


Ian


INFO 11:12:44,500 Logging initialized
 INFO 11:12:44,514 Heap size: 6290407424/6291456000
 INFO 11:12:44,515 JNA not found. Native methods will be disabled.

INFO 11:12:44,528 Loading settings fromfile:/data/apache-cassandra-0.8.1/conf/cassandra.yamlINFO 11:12:44,643 DiskAccessMode 'auto' determined to be mmap,indexAccessMode is mmap

 INFO 11:12:44,752 Global memtable threshold is enabled at 2000MB

INFO 11:12:44,753 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:44,758 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:44,758 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:44,759 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:44,760 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:44,761 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)

 INFO 11:12:44,840 Opening /data/cassandra8/data/system/Schema-g-13
 INFO 11:12:44,869 Opening /data/cassandra8/data/system/Migrations-g-13
 INFO 11:12:44,873 Opening /data/cassandra8/data/system/LocationInfo-g-2
 INFO 11:12:44,875 Opening /data/cassandra8/data/system/LocationInfo-g-1

INFO 11:12:44,924 Loading schema version8fbed060-c2ae-11e0-0000-242d50cf1fffINFO 11:12:45,105 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,111 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,117 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,122 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,128 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,134 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,153 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,155 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,156 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,158 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,159 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,159 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,160 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,161 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)INFO 11:12:45,162 Removing compacted SSTable files (seehttp://wiki.apache.org/cassandra/MemtableSSTable)

 INFO 11:12:45,173 Opening /data/cassandra8/data/armorgames/Feeds2-1777
 INFO 11:12:45,989 Opening /data/cassandra8/data/armorgames/Status-764
 INFO 11:12:46,008 Opening /data/cassandra8/data/armorgames/Comments-763

INFO 11:12:46,030 Opening/data/cassandra8/data/armorgames/UserGameshareData-8483

 INFO 11:12:54,068 Opening /data/cassandra8/data/armorgames/GameSave2-4849

ERROR 11:12:54,253 Corrupt sstable/data/cassandra8/data/armorgames/GameSave2-4849=[Filter.db, Data.db,Index.db]; skipped

java.io.EOFException
    at java.io.RandomAccessFile.readByte(RandomAccessFile.java:642)

atorg.apache.cassandra.utils.ByteBufferUtil.readShortLength(ByteBufferUtil.java:358)atorg.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:368)atorg.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:312)atorg.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:194)atorg.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:280)atorg.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:455)atorg.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:436)

    at org.apache.cassandra.db.Table.initCf(Table.java:369)
    at org.apache.cassandra.db.Table.<init>(Table.java:306)
    at org.apache.cassandra.db.Table.open(Table.java:111)

atorg.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:161)atorg.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:315)atorg.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:80)

 INFO 11:12:54,257 Opening /data/cassandra8/data/armorgames/UserData-9055
 INFO 11:12:58,779 Opening /data/cassandra8/data/armorgames/Feeds2-1777
ERROR 11:12:58,791 Exception encountered during startup.

java.io.IOError: java.io.IOException: Channel not open for writing -cannot extend file to required sizeatorg.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:170)atorg.apache.cassandra.io.util.MmappedSegmentedFile$Builder.complete(MmappedSegmentedFile.java:147)atorg.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:340)atorg.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:194)atorg.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:280)atorg.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:455)atorg.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:436)

    at org.apache.cassandra.db.Table.initCf(Table.java:369)
    at org.apache.cassandra.db.Table.<init>(Table.java:306)
    at org.apache.cassandra.db.Table.open(Table.java:111)

    at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:768)

atorg.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:162)

    ... 12 more
Exception encountered during startup.

    at org.apache.cassandra.db.Table.initCf(Table.java:369)
    at org.apache.cassandra.db.Table.<init>(Table.java:306)
    at org.apache.cassandra.db.Table.open(Table.java:111)

    at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:768)

atorg.apache.cassandra.io.util.MmappedSegmentedFile$Builder.createSegments(MmappedSegmentedFile.java:162)

    ... 12 more

migrating from 0.6 to 0.8, "java.io.IOError: ... cannot extend file to required size"

Reply via email to