Re: Benchmarking my indexer

2008-11-05 Thread Rafael Cunha de Almeida
On Sun, 2 Nov 2008 21:06:56 -0200 Rafael Cunha de Almeida <[EMAIL PROTECTED]> wrote: > On Sun, 2 Nov 2008 07:11:20 -0500 > Grant Ingersoll <[EMAIL PROTECTED]> wrote: > > > > > On Nov 1, 2008, at 1:39 AM, Rafael Cunha de Almeida wrote: > > > > > Hello, > > > > > > I did an indexer that parses so

Re: Benchmarking my indexer

2008-11-02 Thread Rafael Cunha de Almeida
On Sun, 2 Nov 2008 07:11:20 -0500 Grant Ingersoll <[EMAIL PROTECTED]> wrote: > > On Nov 1, 2008, at 1:39 AM, Rafael Cunha de Almeida wrote: > > > Hello, > > > > I did an indexer that parses some files and indexes them using > > lucene. I > > want to benchmark the whole thing, so I'd like to co

Re: Benchmarking my indexer

2008-11-02 Thread Grant Ingersoll
On Nov 1, 2008, at 1:39 AM, Rafael Cunha de Almeida wrote: Hello, I did an indexer that parses some files and indexes them using lucene. I want to benchmark the whole thing, so I'd like to count the tokens being indexed so I can calculate the average number of indexed tokens per second. Is

Benchmarking my indexer

2008-10-31 Thread Rafael Cunha de Almeida
Hello, I did an indexer that parses some files and indexes them using lucene. I want to benchmark the whole thing, so I'd like to count the tokens being indexed so I can calculate the average number of indexed tokens per second. Is there a way to count the number of tokens on a document? While I'm