Re: Scale up design

2010-12-13 Thread William Newport
I've used 30-35gb heaps and it is painful. Sent from my iPhone On Dec 13, 2010, at 2:16 AM, "Danil ŢORIN" wrote: > GC times on large heaps are pretty painfull right now (haven't tried > G1 collector, knowledgeable people : please advise) > > Also it's very dependent on your index and query patt

Re: LUCENE-2456 (A Column-Oriented Cassandra-Based Lucene Directory)

2010-08-17 Thread William Newport
I think it's similar to datagrid directory plugins which are likely higher performance than Cassandra but still have performance issues with large indexes. Sent from my iPhone On Aug 17, 2010, at 12:20 PM, Utku Can Topçu wrote: > Hi Otis, > > Thank you for the notice. I'll do so. > > "What happ

Re: Using lucene for substring matching

2010-07-27 Thread William Newport
Ramdirectorys seem useful but as the index gets larger, java heap sizes can become a problem in terms of garbage collection pauses. Some customers are looking to use data grid products such as IBM websphere extreme scale or oracle coherence to act as the directory for the index. This stores the ind