Hi Jonathan,
Never mind it was an issue with the rmi hostname. Now it works and the issue
comes from the following lines (KeysSearcher.java in package
org.apache.cassandra.db.index.keys) :
if (logger.isDebugEnabled())
logger.debug(String.format("Scanning index %s
starting with %s",
expressionString(primary),
index.getBaseCfs().metadata.getKeyValidator().getString(startKey)));
QueryFilter indexFilter =
QueryFilter.getSliceFilter(indexKey,
new QueryPath(index.getIndexCfs().getColumnFamilyName()),
lastSeenKey,
endKey,
false,
rowsPerQuery);
ColumnFamily indexRow =
index.getIndexCfs().getColumnFamily(indexFilter); <---- it returns null
logger.debug("fetched {}", indexRow);
if (indexRow == null)
{
logger.debug("no data, all done");
return endOfData();
}
The matter is that indexFilter returns a new instance of QueryFilter with value
QueryFilter(key=DecoratedKey(2012-11-29 02:35:00+0000, 0000013b4a046420),
path=QueryPath(columnFamilyName='syndic.mailIndex', superColumnName='null',
columnName='null'), filter=SliceQueryFilter(start=java.nio.HeapByteBuffer[pos=0
lim=0 cap=0], finish=java.nio.HeapByteBuffer[pos=0 lim=0 cap=0],
reversed=false, count=10000])
but then index.getIndexCfs().getColumnFamily(indexFilter) returns null !
As said before, if we rebuild the index it works and returns values
Tell me if you need more information
Cyril SCETBON
On Nov 30, 2012, at 10:32 PM, Jonathan Ellis <jbel...@gmail.com> wrote:
> Re remote debugging, see cassandra-env.sh:
>
> # uncomment to have Cassandra JVM listen for remote
> debuggers/profilers on port 1414
> # JVM_OPTS="$JVM_OPTS -Xdebug -Xnoagent
> -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=1414"
>
> On Sat, Dec 1, 2012 at 1:22 AM, Cyril Scetbon <cyril.scet...@free.fr> wrote:
>> Hi,
>>
>> We got an issue here with cassandra 1.1.6 where a secondary index seems to
>> be seen as empty. For example, If I try to see what are the first 10 values
>> I have :
>>
>> cqlsh:pns_fr> select mailendwnd from syndic limit 10;
>> mailendwnd
>> --------------------------
>> 2012-11-29 23:30:00+0000
>> 2012-11-29 02:35:00+0000
>> 2012-11-29 06:35:00+0000
>> 2012-11-29 00:30:00+0000
>> 2012-11-29 07:10:00+0000
>> 2012-11-29 02:10:00+0000
>> 2012-11-29 01:55:00+0000
>> 2012-11-29 23:45:00+0000
>> 2012-11-29 07:25:00+0000
>> 2012-11-29 06:55:00+0000
>>
>> However, even if there is a secondary index on mailendwnd, we can't get any
>> record :
>>
>> cqlsh:pns_fr> select mailendwnd from syndic where mailendwnd = '2012-11-29
>> 02:35:00+0000' limit 1000;
>>
>> fyi, It's resolved by repairing the index and it happened a few times. I
>> launched cassandra in debug mode and noticed that it thinks there is no data
>> in the index :
>>
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,756 CassandraServer.java (line 1232)
>> execute_cql_query
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,758 QueryProcessor.java (line 445) CQL
>> statement type: SELECT
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,777 StorageProxy.java (line 842)
>> Command/ConsistencyLevel is RangeSliceCommand{keyspace='pns_fr',
>> column_family='syndic', super_column=null,
>> predicate=SlicePredicate(column_names:[java.nio.HeapByteBuffer[pos=0 lim=10
>> cap=10]]), range=[min(-1),m
>> in(-1)], row_filter =[IndexExpression(column_name:6D 61 69 6C 65 6E 64 77 6E
>> 64, op:EQ, value:00 00 01 3B 4A 04 64 20)], maxResults=10000,
>> maxIsColumns=false}/ONE
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,778 StorageProxy.java (line 1073)
>> restricted ranges for query [min(-1),min(-1)] are [[min(-1),max(0)],
>> (max(0),max(21267647932558653966460912964485513216)],
>> (max(21267647932558653966460912964485513216),max(42535295865117307932921825928971026432
>> )],
>> (max(42535295865117307932921825928971026432),max(63802943797675961899382738893456539648)],
>>
>> (max(63802943797675961899382738893456539648),max(85070591730234615865843651857942052864)],
>>
>> (max(85070591730234615865843651857942052864),max(106338239662793269832304564822427566080)],
>> (max
>> (106338239662793269832304564822427566080),max(127605887595351923798765477786913079296)],
>>
>> (max(127605887595351923798765477786913079296),max(148873535527910577765226390751398592512)],
>> (max(148873535527910577765226390751398592512),min(-1)]]
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,779 NetworkTopologyStrategy.java (line
>> 125) /10.244.136.105,/10.244.137.238,/10.244.130.226 endpoints in datacenter
>> us-west-2 for token 0
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,780 StorageProxy.java (line 869) local
>> range slice
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,782 ExtendedFilter.java (line 181)
>> adding columns to original Filter to cover additional expressions
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,782 KeysSearcher.java (line 99)
>> Primary scan clause is mailendwnd
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,783 ColumnFamilyStore.java (line 1449)
>> Filtering org.apache.cassandra.db.index.keys.KeysSearcher$1@60ce274e for
>> rows matching
>> org.apache.cassandra.db.filter.ExtendedFilter$FilterWithClauses@7e76a388
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,784 KeysSearcher.java (line 135)
>> Scanning index 'syndic.mailendwnd EQ 2012-11-29 02:35:00+0000' starting with
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,784 CollationController.java (line
>> 227) collectAllData
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,784 KeysSearcher.java(line 145)
>> fetched null
>> DEBUG [Thrift:14] 2012-11-30 08:35:20,784 KeysSearcher.java (line 148) no
>> data, all done <----- THIS IS WHAT IT SAYS HERE
>>
>> I tried to remotely debug cassandra from eclipse but I wasn't able to do it.
>> Whenever it tries to connect to the dt_socket it fails and the port is
>> closed on the server :( I tried locally without any issue but I havent the
>> data (can I copy data from one node to mine and debug it locally, is it
>> possible ?). I'm investigating network issues concerning that to help you.
>> If you have input concerning the issue before I can debug it, welcome !
>>
>> Regards
>>
>> Cyril SCETBON
>>
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder, http://www.datastax.com
> @spyced
