RE: Read large size index

2009-06-30 Thread Uwe Schindler
To: java-user@lucene.apache.org > Subject: RE: Read large size index > > > Thanks Uwe, > > can you please give me a code snippet , so that i can resolve > my > issue , please > > > > The correct way to iterate over all results is to use a custom >

RE: Read large size index

2009-06-30 Thread m.harig
ating over the whole results (in full text search, nobody would normally do this. E.g. Google does not allow you to go beyond page 100). If you want to display the top 10 results you can use TopDocCollector(10). Uwe -- View this message in context: http://www.nabble.com/Read-large-size-

RE: Read large size index

2009-06-30 Thread Uwe Schindler
Sent: Tuesday, June 30, 2009 2:31 PM > To: java-user@lucene.apache.org > Subject: Re: Read large size index > > > > > Hi there, > > On Tue, Jun 30, 2009 at 12:41 PM, m.harig wrote: > > > > Thanks Simon , > > > >          Its working now , th

Re: Read large size index

2009-06-30 Thread Simon Willnauer
will not exceed more than 10k , > what am asking is i need to display the total hits from the index , it might > be more than 10k , like google did ,  Results 1 - 10 of about 51,200 , can > you please tell me.. TopDoc returned by several Searcher#search methods has a field TopDocs#

Re: Read large size index

2009-06-30 Thread m.harig
me.. simon -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24271025.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user-unsubscr...

Re: Read large size index

2009-06-30 Thread Simon Willnauer
{ >                        Document doc = searcher.doc(scoreDocs[i].doc, > selector); > >                        System.out.println(doc.get("title")); >                        System.out.println(doc.get("path")); > >                } > > > >          

Re: Read large size index

2009-06-30 Thread m.harig
m.out.println(doc.get("title")); System.out.println(doc.get("path")); } searcher.close(); can you please clear my doubt -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24269693.htm

Re: Read large size index

2009-06-30 Thread Simon Willnauer
Hey there, On Tue, Jun 30, 2009 at 10:41 AM, wrote: > Thanks Simon > >  this is my code , but am getting null , > > IndexReader open = IndexReader.open(indexDir); > >                IndexSearcher searcher = new IndexSearcher(open); > >                final String fName = "contents"; > >          

Re: Read large size index

2009-06-29 Thread m.harig
please explain the code , please -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24266289.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubs

Re: Read large size index

2009-06-29 Thread Simon Willnauer
t; FieldSelector. > You can have a closer look at FieldSelector and the new search methods > which accept them. This is a way to make you retrieval faster and load > only the fields you really need. > > > > -- > V

Re: Read large size index

2009-06-29 Thread m.harig
retrieval faster and load only the fields you really need. -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24257547.html Sent from the Lucene - Java Users mailing list archive at Nabble.com.

Re: Read large size index

2009-06-29 Thread Simon Willnauer
.servlet.SearchServlet.doProcess(SearchServlet.java:164) > >         > com.npedia.liteSearch.servlet.SearchServlet.doGet(SearchServlet.java:39) > >        javax.servlet.http.HttpServlet.service(HttpServlet.java:690) > >        javax.servlet.http.HttpServlet.service(HttpServlet.java:803) > > > > note The full s

Re: Read large size index

2009-06-29 Thread m.harig
rvice(HttpServlet.java:803) note The full stack trace of the root cause is available in the Apache Tomcat/6.0.10 logs. Apache Tomcat/6.0.10 -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24254191.html Sent from the Lucene - Java Users mailing list archi

Re: Read large size index

2009-06-29 Thread Simon Willnauer
you sort on any field - which query do you use (e.g. wilidcard searches) And again, the source of the error is very important :) simon > -- > View this message in context: > http://www.nabble.com/Read-large-size-index-tp242519

Re: Read large size index

2009-06-29 Thread m.harig
ontext: http://www.nabble.com/Read-large-size-index-tp24251993p24253760.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org For additional co

Re: Read large size index

2009-06-29 Thread Simon Willnauer
fused... Sorry man if you can not provide any details about how you search and what you do or stack traces it's very tough to give you any help or advice. > -- > View this message in context: > http://www.nabble.com/Read-large-size-index-tp24251993p24253583.html > Sent

Re: Read large size index

2009-06-29 Thread m.harig
or , -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24251993p24253583.html Sent from the Lucene - Java Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: java-user-unsubscr...@lu

Re: Read large size index

2009-06-29 Thread Simon Willnauer
;>>> index size is small, am getting java heap space error when am using >>>>> large >>>>> size index, i came to know about hadoop with lucene to solve this >>>>> problem >>>>> , >>>>> but i don't have any

Re: Read large size index

2009-06-29 Thread m.harig
gt;>> problem >>>> , >>>> but i don't have any idea about hadoop , i've searched thru the net , >>>> but >>>> i >>>> can't find better solutions , am tired of searching , am very curios if >>>> some1

Re: Read large size index

2009-06-29 Thread Simon Willnauer
r-h...@lucene.apache.org >> >> >> > Hey there, 1GB is not a big index though. What happens when you search? Can you post the stacktrace where the OOM occurs? Do you do any kind of sorting in your application? simon > i've posted a mail at hadoop lucene f

Re: Read large size index

2009-06-29 Thread m.harig
ave any idea about hadoop , i've searched thru the net , but >> i >> can't find better solutions , am tired of searching , am very curios if >> some1 tell me how to integrate lucene with hadoop , and i'll be very >> thankful to you , please any1 help me >&g

Re: Read large size index

2009-06-29 Thread Simon Willnauer
t; some1 tell me how to integrate lucene with hadoop , and i'll be very > thankful to you , please any1 help me > -- > View this message in context: > http://www.nabble.com/Read-large-size-index-tp24251993p24251993.html > Sen

Read large size index

2009-06-29 Thread m.harig
rched thru the net , but i can't find better solutions , am tired of searching , am very curios if some1 tell me how to integrate lucene with hadoop , and i'll be very thankful to you , please any1 help me -- View this message in context: http://www.nabble.com/Read-large-size-index-tp24