Re: indexing 100GB of data

2009-07-23 Thread Shai Erera
gt; Very thankful to all , am tired of hadoop settings , is it > good to use read such type large index with lucene alone? will it go for > OOM > ? anyone pl suggest me. > -- > View this message in context: > http://www.nabble.com/indexing-100GB-of-data-tp24600563p246

RE: indexing 100GB of data

2009-07-23 Thread m.harig
Thanks all , Very thankful to all , am tired of hadoop settings , is it good to use read such type large index with lucene alone? will it go for OOM ? anyone pl suggest me. -- View this message in context: http://www.nabble.com/indexing-100GB-of-data-tp24600563p24620846.html

RE: indexing 100GB of data

2009-07-22 Thread Steven A Rowe
12:46 PM > To: java-user@lucene.apache.org > Subject: Re: indexing 100GB of data > > On Wed, Jul 22, 2009 at 5:46 AM, m.harig wrote: > > > Is there any article or forum for using Hadoop with lucene? Please > any1 help > > me > > Hi M, > > Katta is a p

Re: indexing 100GB of data

2009-07-22 Thread Phil Whelan
On Wed, Jul 22, 2009 at 5:46 AM, m.harig wrote: > Is there any article or forum for using Hadoop with lucene? Please any1 help > me Hi M, Katta is a project that is combining Lucene and Hadoop. Check it out here... http://katta.sourceforge.net/ Thanks, Phil

RE: indexing 100GB of data

2009-07-22 Thread Dan OConnor
...@stimulussoft.com] Sent: Wednesday, July 22, 2009 8:51 AM To: java-user@lucene.apache.org Subject: Re: indexing 100GB of data HI There We have lucene searching across several terabytes of email data and there is no problem at all. Regards, Jamie Shai Erera wrote: > There shouldn't be a problem t

Re: indexing 100GB of data

2009-07-22 Thread Jamie
m.harig wrote: Thanks Shai So there won't be problem when searching that kind of large index . am i right? Can anyone tell me is it possible to use hadoop with lucene?? -- View this message in context: http://www.nabble.com/indexing-100GB-of-data-tp24600563p2460206

Re: indexing 100GB of data

2009-07-22 Thread m.harig
Is there any article or forum for using Hadoop with lucene? Please any1 help me -- View this message in context: http://www.nabble.com/indexing-100GB-of-data-tp24600563p24605164.html Sent from the Lucene - Java Users mailing list archive at Nabble.com

Re: indexing 100GB of data

2009-07-22 Thread Shai Erera
t? > > Can anyone tell me is it possible to use hadoop with lucene?? > -- > View this message in context: > http://www.nabble.com/indexing-100GB-of-data-tp24600563p24602064.html > Sent from the L

Re: indexing 100GB of data

2009-07-22 Thread prashant ullegaddi
arching that kind of large index > . am i right? > > Can anyone tell me is it possible to use hadoop with lucene?? > -- > View this message in context: > http://www.nabble.com/indexing-100GB-of-data-tp24600563p24602064.html > Sent from the Lucene - Java Us

Re: indexing 100GB of data

2009-07-22 Thread m.harig
Thanks Shai So there won't be problem when searching that kind of large index . am i right? Can anyone tell me is it possible to use hadoop with lucene?? -- View this message in context: http://www.nabble.com/indexing-100GB-of-data-tp24600563p24602064.html Sent fro

Re: indexing 100GB of data

2009-07-22 Thread Shai Erera
segments >3. How much index size can lucene handle? >4. Will it cause for java OOM. > -- > View this message in context: > http://www.nabble.com/indexing-100GB-of-data-tp24600563p24600563.html > Sent from the Lucene - Java Users mailing list archive at Nabble.c

indexing 100GB of data

2009-07-21 Thread m.harig
x size can lucene handle? 4. Will it cause for java OOM. -- View this message in context: http://www.nabble.com/indexing-100GB-of-data-tp24600563p24600563.html Sent from the Lucene - Java Users mailing list archive at Nabble.com.