Re: Internal pagination in secondary index queries

2014-12-31 Thread Sam Klock
Thanks. I've opened the following issue to track this: https://issues.apache.org/jira/browse/CASSANDRA-8550 SK On 2014-12-30 11:26, Tyler Hobbs wrote: > > On Mon, Dec 29, 2014 at 5:20 PM, Sam Klock > wrote: > > > Our investigation led us to logic in Cassandra u

Re: Internal pagination in secondary index queries

2014-12-30 Thread Tyler Hobbs
On Mon, Dec 29, 2014 at 5:20 PM, Sam Klock wrote: > > > Our investigation led us to logic in Cassandra used to paginate scans > of rows in indexes on composites. The issue seems to be the short > algorithm Cassandra uses to select the size of the pages for the scan, > partially given on the follo

Re: Internal pagination in secondary index queries

2014-12-29 Thread Jonathan Haddad
Secondary indexes are there for convenience, not performance. If you're looking for something performant, you'll need to maintain your own indexes. On Mon Dec 29 2014 at 3:22:58 PM Sam Klock wrote: > Hi folks, > > Perhaps this is a question better addressed to the Cassandra developers > direct

Internal pagination in secondary index queries

2014-12-29 Thread Sam Klock
Hi folks, Perhaps this is a question better addressed to the Cassandra developers directly, but I thought I'd ask it here first. We've recently been benchmarking certain uses of secondary indexes in Cassandra 2.1.x, and we've noticed that when the number of items in an index reaches beyond so