Re: ElasticSearch

2011-11-16 Thread Federico Fissore
Peyman Faratin, il 16/11/2011 15:12, ha scritto: Hi A client is considering moving from Lucene to ElasticSearch. What is the community's opinion on ES? thank you we have recently compared ES to Solr to estimate the effort of evolving our search infrastructure (it was game like: two teams t

Re: Lucene killing JVM

2011-09-01 Thread Federico Fissore
Dragan Jotanovic, il 01/09/2011 11:12, ha scritto: Hi, I recently upgraded to lucene 3.3 (from 3.0.3) and now my JVM keeps crashing. I noticed that it happens when I'm closing and reopening my index. It doesn't happen every time. Sometimes it works for days and sometimes it crashes several times

Re: SSD Experience (on developer machine)

2011-08-24 Thread Federico Fissore
David Nemeskey, il 24/08/2011 11:46, ha scritto: [...] Theoretically, in the case described above, it would be possible to move 'static' data (data of cells that have not been written to for a long time) to the 5GB in question and use the 'fresher' cells as free space; this could be done in a rou

Re: SSD Experience (on developer machine)

2011-08-23 Thread Federico Fissore
Great reply, thank you. Will re-read it and re-evaluate my position Just one comment Toke Eskildsen, il 23/08/2011 17:11, ha scritto: [...] Let's say you have a drive with just 5GB left. Let's say that the cells can handle 10,000 writes. Doing constant rewrites of the 5GB gives you 10,000 * 5G

Re: SSD Experience (on developer machine)

2011-08-23 Thread Federico Fissore
Toke Eskildsen, il 23/08/2011 13:37, ha scritto: [...] Yes, the first generation of SSDs had bad wear-leveling and there has been some exceptionally bad eggs along the way, but we're long past that point now. All brand name SSDs use wear leveling and unless you set up pathological destruction cas

Re: SSD Experience (on developer machine)

2011-08-23 Thread Federico Fissore
we are probably running out of topic here, but for the record, there is also someone lamenting about ssd http://www.codinghorror.com/blog/2011/05/the-hot-crazy-solid-state-drive-scale.html the underlying point is correct: SSD offer much less re-writes of the same "sector" than disk based so,

Re: Can I use Lucene to solve this problem?

2011-08-17 Thread Federico Fissore
Josh Rehman, il 17/08/2011 05:03, ha scritto: My organization is looking to solve a difficult problem, and I believe that Lucene is a close fit (although perhaps it is not). However I'm not sure exactly how to approach this problem. [...] maybe using semantic vectors? [0] we've played around

Re: Is there kind of a "NullAnalyzer" ?

2011-05-09 Thread Federico Fissore
Clemens Wyss, il 09/05/2011 09:42, ha scritto: i.e. an analyzer which takes the field to be analyzed as is into the index...? The fields I am trying to index have a max length of 3 words and I don't want to match sub terms of these fields. keyword analyzer? https://lucene.apache.org/java/3_0

Re: Immutable OpenBitSet?

2011-04-28 Thread Federico Fissore
Nader, John P, il 28/04/2011 00:24, ha scritto: Thanks. Your project looks interesting. We've got some duplicate home-grown stuff here that is similar. As far as thread-safety, if one thread initializes an OpenBitSet's by setting one or bits and then hands that off to another thread, the oth

Re: Immutable OpenBitSet?

2011-04-27 Thread Federico Fissore
Nader, John P, il 27/04/2011 20:28, ha scritto: Hello, We have an application that relies heavily on caching OpenBitSets for reuse across multiple threads, and therefore multiple threads. [...] You don't need synchronization if you just read from an openbitset. And if you need to modify it,

Re: Parallel access to TermPositions API

2011-04-15 Thread Federico Fissore
Chris Bamford, il 14/04/2011 20:11, ha scritto: Hi, I need to load a huge amount of TermPositions in a short space of time (millions of Documents, sub-second). Does the IndexReader's API support multiple accesses to allow several parallel threads to consume a chunk each? AFAIK, you cannot sha

Re: is OpenBitSet / SortedVIntList compressed bit map index?

2011-02-11 Thread Federico Fissore
Raavan, il 08/01/2011 19:17, ha scritto: Thanks Ryan. I will test this to see if it uses much less memory than SortedVIntList. -Raavan Hello Raavan, have you tested those implementations? How do they look? federico - To un

Re: is OpenBitSet / SortedVIntList compressed bit map index?

2011-01-07 Thread Federico Fissore
First Last, il 07/01/2011 20:55, ha scritto: Hi, is OpenBitSet / SortedVIntList a compressed bit map index? Which one is better if memory usage is the primary concern ? SortedVIntList is compressed, OpenBitSet is not Our filters are sparse. So is SortedVIntList better in that case? Yes

Re: Comment in query-parser?

2010-12-30 Thread Federico Fissore
Paul Libbrecht, il 30/12/2010 20:15, ha scritto: [...] Is there anything in the query parser that would be considered ignored till the end of the line? Currently I'm using a fancy field but it introduces a useless query. I would make a CommentFilter and put it in an Analyzer I would give to

StringIndexCache throws ArrayIndexOutOfBound

2010-10-04 Thread Federico Fissore
hich case please give some advice) or it is a bug Looking forward for your feedback before opening a ticket on jira Best regards Federico Fissore package org.apache.lucene.search; import static org.junit.Assert.*; import org.apache.lucene.analysis.standard.StandardAnalyz