Re: Code for Precision in Lucene

2011-08-26 Thread Yakob
I did, go here http://jacobian.web.id/2010/12/01/calculating-precision-and-recall-in-lucene/ On 8/26/11, Sara naznazi wrote: > hi > I have some text files and want to calculate Precision and Recall. dont > refer me to Lucen in action book, I already studied it and just want to know > is there an

Re: please help me

2011-08-12 Thread Yakob
the problem you're having is that you haven't learn about java yet. you need to know about imports statement, about jars file that contain java classes. you need to learn about this first then you can run java. the LIA (lucene in action) package that you're downloaded can all be run if you put them

Re: precision and recall in lucene

2010-12-01 Thread Yakob
On 12/1/10, Robert Muir wrote: > > you fill the topics files with list of queries, like the lia2 example > that has a single query for "apache source": > > > Number: 0 > apache source > Description: > Narrative: > > > then you populate the qrels file with the "answers" for your document > c

Re: precision and recall in lucene

2010-12-01 Thread Yakob
On 12/1/10, Robert Muir wrote: > > well you can't use those files with your own document collection. > you need to populate the topics file with queries that you care about > measuring. > then you need to populate the qrels file with judgements for each > query, *for your collection*. you are sa

Re: precision and recall in lucene

2010-12-01 Thread Yakob
On 11/30/10, Robert Muir wrote: > On Tue, Nov 30, 2010 at 10:46 AM, Yakob wrote: > >> can you tell me what went wrong? what is the difference between >> topicsFile and qrelsFile anyway? >> > > well its hard to tell what you are supplying as topics and qrels. >

Re: problem with incremental update in lucene

2010-12-01 Thread Yakob
On 12/1/10, Ian Lea wrote: > It's probably this line: > > Directory.copy(ramDir, FSDirectory.open(indexDir), false); // 3 > > the javadocs say > > Copy contents of a directory src to a directory dest. If a file in src > already exists in dest then the one in dest will be blindly > overwritten. > >

problem with incremental update in lucene

2010-11-30 Thread Yakob
I am creating a program that can index many text files in different folder. so that's mean every folder that has text files get indexed and its index are stored in another folder. so this another folder acts like a universal index of all files in my computer. and I am using lucene to achieve this b

Re: precision and recall in lucene

2010-11-30 Thread Yakob
On 11/30/10, Robert Muir wrote: > > Have a look at contrib/benchmark under the > org.apache.lucene.benchmark.quality package. > There is code (for example > org.apache.lucene.benchmark.quality.trec.QueryDriver) that can run an > experiment and output what you need for trec_eval.exe > I think ther

Re: precision and recall in lucene

2010-11-29 Thread Yakob
On 11/29/10, Erick Erickson wrote: > Define precision. Define recall. Define measure > > Sorry to give in to my impulses, but this question is so broad it's > unanswerable. Try looking at the Text REtrieval Conference for instance. > Lots of very bright people spend significant amounts of the

precision and recall in lucene

2010-11-29 Thread Yakob
hello all I was wondering, if I want to measure precision and recall in lucene then what's the best way for me to do it? is there any sample cource code that I can use? thanks though -- http://jacobian.web.id - To unsubscribe, e

Re: asking about index verification tools

2010-11-17 Thread Yakob
situation? :-) On 11/17/10, Anshum wrote: > Lance, CheckIndex would only check for the sanity of the index and not > really if all words from the source got added into the index or not. > CheckIndex would only check for corrupt indexes and in the process also take > a lot of time. >

asking about index verification tools

2010-11-15 Thread Yakob
hello all, I would like to ask about lucene index. I mean I created a simple program that created lucene indexes and stored it in a folder. also I had use a diagnostic tools name Luke to be able to lurk inside lucene index and find out its content. and I know that lucene is a standard framework whe

Re: adding documents to an existing index

2010-10-29 Thread Yakob
but anyway,I've done it.thanks for your help. I did look up your source code and find it easier to understand. this is the kind of help that I want. thank you very much then. :-) On 10/27/10, Seth Rosen wrote: > Yakob the boolean in the constructor should be true if you want to create

Re: adding documents to an existing index

2010-10-27 Thread Yakob
On 10/27/10, Seth Rosen wrote: > Yakob, > Here is a snippet of an example of IndexWriter from the lucene source that > you might find helpful. > > >> IndexWriter writer = new IndexWriter(FSDirectory.open(INDEX_DIR), new >> StandardAnalyzer(Ve

Re: adding documents to an existing index

2010-10-27 Thread Yakob
well thanks anyway though. On 10/27/10, 蒋明原 wrote: > you are too lazy.download the lucene source code,take a glance and you will > find demos; > > On Wed, Oct 27, 2010 at 8:43 PM, Yakob wrote: > >> I did searched about this constructor and find that it's already been

Re: adding documents to an existing index

2010-10-27 Thread Yakob
I did searched about this constructor and find that it's already been deprecated. http://lucene.apache.org/java/2_4_0/api/org/apache/lucene/index/IndexWriter.html#IndexWriter(org.apache.lucene.store.Directory, org.apache.lucene.analysis.Analyzer, boolean) I am using lucene 3.0 now.can I really use

adding documents to an existing index

2010-10-27 Thread Yakob
hello all, I would like to ask of how to add new documents to an existing lucene index. I mean what's class should I use to achieve this goal. thanks -- http://jacobian.web.id - To unsubscribe, e-mail: java-user-unsubscr...@luc

Re: integrating RAMDirectory in FSDirectory

2010-10-16 Thread Yakob
On 10/13/10, Erick Erickson wrote: > Try IndexWrite.addIndexes. I confess that I haven't used that since > 2.4, but I suspect it's what you want. > ok after I started asking around in stackoverflow regarding this problem. someone was kind enough to give an answer. well sort of. private int index

integrating RAMDirectory in FSDirectory

2010-10-11 Thread Yakob
be visible > until you reopen the FSDir reader, so your flush could then be just > reopen everything... > > Best > Erick > > On Mon, Oct 11, 2010 at 1:34 PM, Yakob wrote: > >> On 9/29/10, Erick Erickson wrote: >> > Nope, never used jNotify, so I don't have a

Re: flushing index

2010-10-11 Thread Yakob
On 9/29/10, Erick Erickson wrote: > Nope, never used jNotify, so I don't have any code handy... > > Good luck! > Erick > so I did try JNotify but there is seems to be some bug in it that I find it hards to integrate in my lucene source code.so I had to try a looping option instead. http://stacko

Re: flushing index

2010-09-28 Thread Yakob
On 9/28/10, Erick Erickson wrote: > Flushing an index to disk is just an IndexWriter.commit(), there's nothing > really special about that... > > About running your code continuously, you have several options: > 1> schedule a recurring job to do this. On *nix systems, this is a cron job, > on Wind

Re: flushing index

2010-09-27 Thread Yakob
On 9/27/10, Uwe Schindler wrote: > > > Yes. You must close before, else the addIndexes call will do nothing, as the > index looks empty for the addIndexes() call (because no committed segments > are available in the ramDir). > > I don't understand what you mean with flushing? If you are working on

Re: flushing index

2010-09-26 Thread Yakob
On 9/26/10, Uwe Schindler wrote: > You should close the ramwriter before doing the addindexes call. Else you > simply copy only *committed* changes, but there are none, as the index is > initially empty and stays empty for an outside reader (your addindexes call > is the outside reader) until the

flushing index

2010-09-25 Thread Yakob
hello all, I am here to ask about lucene in flushing indexes. below is a pseudocode I get from the book lucene in action. FSDirectory fsDir = FSDirectory.getDirectory("/tmp/index", true); RAMDirectory ramDir = new RAMDirectory(); IndexWriter fsWriter = IndexWriter(fsDir, new SimpleAnalyzer(), true

Re: asking about incremental update

2010-08-19 Thread Yakob
do you reckon I should use a timer or a thread instead to periodically update the index? On 8/19/10, findbestopensource wrote: > Hi jacobian, > > Lucene will not do incremental update by iteself. Lucene is just a > library. Your app should periodically add the content to the index and > once done

asking about incremental update

2010-08-18 Thread Yakob
hello all, you may remember me as the one who ask about how to understand lucene in the previous email,but I have now been able to create a sample application of lucene. I read the book and able to test it. which to me is very great, as I am a new learner. here is my proof. http://jacobian.web.id

Re: understanding lucene

2010-08-09 Thread Yakob
On 8/9/10, Erik Hatcher wrote: > An even better URL: http://www.manning.com/lucene :) > > Erik so I guess you are the one who wrote this book? :-) -- http://jacobian.web.id - To unsubscribe, e-mail: java-user-unsubscr..

Re: understanding lucene

2010-08-08 Thread Yakob
ok I am sorry,I should not have said that.I didn't know that it was you guys who made the book.so I will now try to activate my paypal account to buy that book. thanks for the suggestion. :-) On 8/8/10, Uwe Schindler wrote: > Hi Yakob, > > In this mailing list are all the people

Re: understanding lucene

2010-08-08 Thread Yakob
On 8/8/10, Uwe Schindler wrote: > The example code you found is very old (seems to be from the Version 1.x of > Lucene), and is not working with Version 2.x or 3.x of Lucene (previously > deprecated "Hits" class is gone in 3.0, "static" Field constructors were > gone long time ago in 2.0, so you g

Re: understanding lucene

2010-08-08 Thread Yakob
ok I had tried to run some sample lucene application I found on the internet such this one from http://javatechniques.com/blog/lucene-in-memory-text-search-example/ and this is the source code, I put it in pastebin so it will be easier to edit. http://pastebin.ca/1913109 but still when I tried

Re: understanding lucene

2010-08-07 Thread Yakob
On 7/29/10, Erick Erickson wrote: > that code has way too much stuff in it for your first application. > Hibernate > is in there and it looks, from the description, like it tries to search your > database. > I'd *strongly* recommend that you don't go there. > > Try looking at > http://wiki.apa

understanding lucene

2010-07-27 Thread Yakob
hello everyone, I am starting to understand lucene in java and I am having a hard time in implementing it. I am trying to develop a java application that can do indexing, searching and whatnot. and using lucene framework is one of the best solution for me. only the problem was I am a bit new in thi