Re: [sword-devel] size of xapian indices

2014-11-27 Thread Greg Hellings
Another possibility to add to our comparison might be http://lucy.apache.org It appears active (latest release within the past two months). They freely state they aren't as fast yet as Lucene is, but it might be faster than Xapian's three and a half hours for Karl.. Might be worth consideration.

Re: [sword-devel] size of xapian indices

2014-11-27 Thread Karl Kleinpaste
On 11/27/2014 12:25 PM, Troy A. Griffitts wrote: > I don't think we're at a place where we want to promote Xapian as the > default ... support is very preliminary and we haven't done any speed > or size testing OK, well, I just bumped into it sideways because of "svn up" the other evening. If you

Re: [sword-devel] size of xapian indices

2014-11-27 Thread Troy A. Griffitts
Hey Karl, I don't think we're at a place where we want to promote Xapian as the default and recommended indexed search framework. We added support for it due to CLucene's lack of updates, but support is very preliminary and we haven't done any speed or size testing with it until your report! :)

[sword-devel] size of xapian indices

2014-11-27 Thread Karl Kleinpaste
I hadn't thought too much about the new Xapian search usage until I had reason this morning to look at disc usage under ~/.sword. Xapian indices are monstrous in size. A touchstone for this is that my personal NETnote module has rawcom ot+nt files whose size total about 23M. But the Xapian indic