Re: Indexing with foreign key

2010-11-01 Thread Paulo Levi
Just self imposed.

Re: Indexing with foreign key

2010-10-31 Thread Paulo Levi
I meant -Xmx32m On Sun, Oct 31, 2010 at 9:17 PM, Paulo Levi wrote: > Yes that's what i ended up doing. I will probably "fork" a new java vm > instead of doing it in the same. That way i can control the memory > requirements, though it hasn't given me any problems (a

Re: Indexing with foreign key

2010-10-31 Thread Paulo Levi
t...) still do a 2 > pass > process, but instead of making a map, put the data in a Lucene index on > disk. > Then the second pass searches that index for the data to add to the docs > in your "real" index. > > HTH > Erick > > On Sun, Oct 31, 2010 at 12:17 PM, P

Indexing with foreign key

2010-10-31 Thread Paulo Levi
I'm stepping tru a rdf file (the project gutenberg catalog) and sending data to a lucene index to allow searches of titles authors and such. However the gutenberg rdf is a little bit "special". It has two sections, one for title, authors, collaborators and such, and (after all the books) starts the