10 million entities and 100 million related information

2012-01-12 Thread Cheng
I have 10MM entities, for each of which I will index 10-20 fields. Also, I will have to index 100MM related information of the entities, and each piece of the information will have to go through some Analyzer. I have a few questions: 1) Can I use just one index folder for all the data? 2) If I h

Re: Build RAMDirectory on FSDirectory, and then synchronzing the two

2012-01-12 Thread Cheng
The reason is I have indexes on hard drive but want to load them into ram for faster searching, adding, deleting, etc. Using RAMDirectory can help achieve this goal. On Thu, Jan 12, 2012 at 6:36 PM, Sanne Grinovero wrote: > Maybe you could explain why you are doing this? Someone could suggest >

Re: Build RAMDirectory on FSDirectory, and then synchronzing the two

2012-01-12 Thread Sanne Grinovero
Maybe you could explain why you are doing this? Someone could suggest alternative approaches. Regards, Sanne On Jan 12, 2012 4:02 AM, "dyzc" <1393975...@qq.com> wrote: > That lies in that my apps add indexes to those in RAM rather than update > them. So the size doubled. Seem not related to the O

extractterms Output

2012-01-12 Thread David Olson
Hi all - thanks in advance for any help... I have an app that aggregates keyword performance through incoming messages. A message comes in, I index it, search the index, and the output the performance. The two things I'm playing with are either parse the output from searcher.explain() or iterating