As stated in topic, I'm unable to drop secondary index either by using
cli or cqlsh. In both cases it looks like to command is processed
properly (some uuid shows up in cli, no output in cqlsh), I can see in
logs that schema is going to be updated (index name and type are set to
null) and then... nothing. No exception, no information. Just a few
lines of output telling me that some system-related Memtables/CFs got
flushed/compacted. Attaching logs at the end of this email (I was
dropping Users_username_idx_1).
I'm using C* 1.2.1, upgraded some time ago from 1.1.0. The same works
perfectly on a test cluster which uses the same C* configuration and a
sample of production data (and was upgraded at the same time as production).
However, when I setup out environment on a brand new C* 1.2.1 cluster
(not upgraded), I can see some differences in schemas comparing to the
1.1.0 -> 1.2.1 one; for example missing 'type' column for
system.schema_columns for example. I wonder if it's not a problem, but
as far as I can see in source code it seems to be handled.
Rebuilding indexes fails (no new files were created) with no errors too.
Any ideas?
INFO [Thrift:24864] 2013-04-18 10:23:17,536 MigrationManager.java (line
246) Update ColumnFamily 'production/Users' From
org.apache.cassandra.config.CFMetaData@4febff32[cfId=5230d831-0ac9-3c5f-835f-481296696252,ksName=production,cfName=Users,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,readRepairChance=1.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.UTF8Type,keyValidator=org.apache.cassandra.db.marshal.LexicalUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,keyAliases=[],columnAliases=[],valueAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=12 cap=12]=ColumnDefinition{name=646174655f63726561746564,
validator=org.apache.cassandra.db.marshal.LongType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
cap=6]=ColumnDefinition{name=616374697665,
validator=org.apache.cassandra.db.marshal.IntegerType, index_type=KEYS,
index_name='Users_active_idx'}, java.nio.HeapByteBuffer[pos=0 lim=5
cap=5]=ColumnDefinition{name=656d61696c,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=KEYS,
index_name='Users_email_idx'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=757365726e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=KEYS,
index_name='Users_username_idx'}, java.nio.HeapByteBuffer[pos=0 lim=18
cap=18]=ColumnDefinition{name=64656661756c745f6163636f756e745f6964,
validator=org.apache.cassandra.db.marshal.LexicalUUIDType,
index_type=null, index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.SnappyCompressor},bloomFilterFpChance=<null>,caching=KEYS_ONLY]
To
org.apache.cassandra.config.CFMetaData@2eb25d0[cfId=5230d831-0ac9-3c5f-835f-481296696252,ksName=production,cfName=Users,cfType=Standard,comparator=org.apache.cassandra.db.marshal.AsciiType,subcolumncomparator=<null>,comment=,readRepairChance=1.0,dclocalReadRepairChance=0.0,replicateOnWrite=true,gcGraceSeconds=864000,defaultValidator=org.apache.cassandra.db.marshal.UTF8Type,keyValidator=org.apache.cassandra.db.marshal.LexicalUUIDType,minCompactionThreshold=4,maxCompactionThreshold=32,keyAliases=[],columnAliases=[],valueAlias=<null>,column_metadata={java.nio.HeapByteBuffer[pos=0
lim=12 cap=12]=ColumnDefinition{name=646174655f63726561746564,
validator=org.apache.cassandra.db.marshal.LongType, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=6
cap=6]=ColumnDefinition{name=616374697665,
validator=org.apache.cassandra.db.marshal.IntegerType, index_type=KEYS,
index_name='Users_active_idx'}, java.nio.HeapByteBuffer[pos=0 lim=5
cap=5]=ColumnDefinition{name=656d61696c,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=null,
index_name='null'}, java.nio.HeapByteBuffer[pos=0 lim=8
cap=8]=ColumnDefinition{name=757365726e616d65,
validator=org.apache.cassandra.db.marshal.UTF8Type, index_type=KEYS,
index_name='Users_username_idx'}, java.nio.HeapByteBuffer[pos=0 lim=18
cap=18]=ColumnDefinition{name=64656661756c745f6163636f756e745f6964,
validator=org.apache.cassandra.db.marshal.LexicalUUIDType,
index_type=null, index_name='null'}},compactionStrategyClass=class
org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy,compactionStrategyOptions={},compressionOptions={sstable_compression=org.apache.cassandra.io.compress.SnappyCompressor},bloomFilterFpChance=<null>,caching=KEYS_ONLY]
INFO [MigrationStage:1] 2013-04-18 10:23:17,567 ColumnFamilyStore.java
(line 640) Enqueuing flush of
Memtable-schema_columnfamilies@469728303(1023/2281 serialized/live
bytes, 20 ops)
INFO [FlushWriter:22] 2013-04-18 10:23:17,568 Memtable.java (line 447)
Writing Memtable-schema_columnfamilies@469728303(1023/2281
serialized/live bytes, 20 ops)
INFO [FlushWriter:22] 2013-04-18 10:23:17,573 Memtable.java (line 481)
Completed flushing
/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-631-Data.db
(648 bytes) for commitlog position
ReplayPosition(segmentId=1365620853206, position=2889368)
INFO [CompactionExecutor:7616] 2013-04-18 10:23:17,574
CompactionTask.java (line 118) Compacting
[SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-631-Data.db'),
SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-629-Data.db'),
SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-630-Data.db'),
SSTableReader(path='/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-628-Data.db')]
INFO [MigrationStage:1] 2013-04-18 10:23:17,576 ColumnFamilyStore.java
(line 640) Enqueuing flush of Memtable-schema_columns@1106646812(248/700
serialized/live bytes, 5 ops)
INFO [FlushWriter:22] 2013-04-18 10:23:17,577 Memtable.java (line 447)
Writing Memtable-schema_columns@1106646812(248/700 serialized/live
bytes, 5 ops)
INFO [FlushWriter:22] 2013-04-18 10:23:17,595 Memtable.java (line 481)
Completed flushing
/cassandra/system/schema_columns/system-schema_columns-ib-483-Data.db
(199 bytes) for commitlog position
ReplayPosition(segmentId=1365620853206, position=2889368)
INFO [CompactionExecutor:7617] 2013-04-18 10:23:17,595
CompactionTask.java (line 118) Compacting
[SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-480-Data.db'),
SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-482-Data.db'),
SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-481-Data.db'),
SSTableReader(path='/cassandra/system/schema_columns/system-schema_columns-ib-483-Data.db')]
INFO [CompactionExecutor:7616] 2013-04-18 10:23:17,611
CompactionTask.java (line 273) Compacted 4 sstables to
[/cassandra/system/schema_columnfamilies/system-schema_columnfamilies-ib-632,].
17,018 bytes to 15,070 (~88% of original) in 36ms = 0.399219MB/s. 8
total rows, 5 unique. Row merge counts were {1:4, 2:0, 3:0, 4:1, }
INFO [CompactionExecutor:7617] 2013-04-18 10:23:17,616
CompactionTask.java (line 273) Compacted 4 sstables to
[/cassandra/system/schema_columns/system-schema_columns-ib-484,]. 3,804
bytes to 3,148 (~82% of original) in 20ms = 0.150108MB/s. 7 total rows,
4 unique. Row merge counts were {1:3, 2:0, 3:0, 4:1, }
M.
