Re: out of memory when trying to sort by id in a 1.5 billion index

2014-11-07 Thread Chris Hostetter
: For sorting DocValues are the best option I think. yep, definitely a good idea. : > I have a usecase for using cursorpage and when tried to check this, I got : > outOfMemory just for sorting by id. what does the field/fieldType for your uniqueKey field look like? If you aren't using DocValue

Re: out of memory when trying to sort by id in a 1.5 billion index

2014-11-07 Thread Yago Riveiro
For sorting DocValues are the best option I think. — /Yago Riveiro On Fri, Nov 7, 2014 at 12:45 PM, adfel70 wrote: > hi > I have 11 machines in my cluster. > each machine 128GB memory, 2 solr jvm's with 12gb heap each. > cluster has 7 shard, 3 replicas. > 1.5 billion docs total. > most user que

out of memory when trying to sort by id in a 1.5 billion index

2014-11-07 Thread adfel70
hi I have 11 machines in my cluster. each machine 128GB memory, 2 solr jvm's with 12gb heap each. cluster has 7 shard, 3 replicas. 1.5 billion docs total. most user queries are pretty simple for now, sorting by date fields and another field the has around 1000 unique values. I have a usecase for u