after search,how can i kown whether each of the filed of the hit docs is hited?

2006-05-24 Thread youbo youbo
I want to highlight the hited field, so I must kown which field is hited,and load text of this field from database,and highlight it.To make index file smaller,the text of the field not store in index. _ 与联机的朋友进行交流,请使用 MSN Messenger

Re: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Zhenjian YU
yes, PrefixQuery will help. On 5/24/06, mark harwood <[EMAIL PROTECTED]> wrote: >>What will happen if I send PrefixQuery A search returns a list of docs - you want a list of words which is why I suggested using the IndexReader "terms" APIs which PrefixQuery uses internally. If you are not in

Re: IOException Access Denied errors [ modified]

2006-05-24 Thread Erick Erickson
I wonder if it would shed any light on the issue if you separated the two? In other words, what would happen if you mocked up your MySQL connection and just generated "responses" for Lucene to index without having the database drivers even loaded? Also, you could write the data from MySQL out to

Re: Handling hyphens and other puncuation in proper nouns

2006-05-24 Thread Erick Erickson
There are several analyzers provided with Lucene that you could check out. SimpleAnalyzer, WhitespaceAnalyzer and KeywordAnalyzer all come to mind. Certainly WhitespaceAnalyzer won't break at the hyphen etc. NOTE: be sure you pay attention to what analyzer is used if you are using QueryParser, si

Re: Web services for querying and return of results

2006-05-24 Thread Chris Hostetter
: Solr sounds very interesting though - how do you maintain the cache? : Are you storing filters? And how do you persist these, via the session : or using some kind of register? I was considering designing something : like this but felt that state management was something I wanted to avoid : doi

Re: IOException Access Denied errors [ modified]

2006-05-24 Thread Dan Armbrust
Rahil wrote: No I have around 50GB free on my extrenal disk in which Im creating the indexes. So hopefully that shouldnt be the problem. How is the external disk mounted? Samba from unix? NTFS? I wonder if there isn't something strange going on here. Have you tried building the index on a

Question about special characters

2006-05-24 Thread Dan Wiggin
I need some functionality and I don't know how to do. The problem is special characters like à, ä , ç or ñ latin characters in the text. Now I use iso latin filter, but the problem is when I want to obtain most term used. These term are stored without ` ´ ^ or another "character attribute". For ex

Handling hyphens and other puncuation in proper nouns

2006-05-24 Thread Tim.Wright
Hi all, We're having issues searching for proper nouns (names) which have punctuation in; things like "a-blah" or "blah'x". I suspect the StandardAnalyzer is replacing the punctuation with spaces, and we get back results that just contain "blah". Any suggestions? I'm guessing we could write our

Re: IOException Access Denied errors [ modified]

2006-05-24 Thread Rahil
Hi Paul [EMAIL PROTECTED] wrote: I can only think that the problem you're having is peculiar to your setup or the way in which you are using Lucene. A wild guess - are you reaching quota limits on your filesystem or something like this? No I have around 50GB free on my extrenal disk in which

Re: Making SpanQuery more effiicent

2006-05-24 Thread Michael Chan
I see. Also, as I'm only interested in the number of results returned and not in the ranking of documents returned, is there any component I can simplify in order to improve search performance? Perhaps, Scorer or Similarity? Thanks. Michael On 5/24/06, Chris Hostetter <[EMAIL PROTECTED]> wrote

Re: IOException Access Denied errors [ modified]

2006-05-24 Thread Paul . Illingworth
Another wild guess - it seems to be throwing the exception when merging segments. Are you sure you've got write access to the directory that the lock file is being created in. Lucene In Action has some details about index locking and how you can change the location of the lock file - I'm not s

Re: IOException Access Denied errors [ modified]

2006-05-24 Thread Paul . Illingworth
I can only think that the problem you're having is peculiar to your setup or the way in which you are using Lucene. A wild guess - are you reaching quota limits on your filesystem or something like this? Regards Paul I..

Re: IOException Access Denied errors [ modified]

2006-05-24 Thread Rahil
Hi Dan Dan Armbrust wrote: The MySQL drivers are horrible at dealing with large result sets - that article gives you the workaround to tell it to bring the results back as they are needed (like it should in the first place) but I have found that it isn't reliable - it tends to drop out at

RE: ORing complementary queries gives no results

2006-05-24 Thread Satuluri, Venu_Madhav
Hi Chris, Yes, if I want to get "name:xyz or -name:xys" to work as I expect it to, then I must replace "-name:xyz" with "(alwaysTrueField:true -name:xyz)". Thanks a lot. Venu -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Tuesday, May 23, 2006 11:48 PM To: jav

RE: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread mark harwood
>>What will happen if I send PrefixQuery A search returns a list of docs - you want a list of words which is why I suggested using the IndexReader "terms" APIs which PrefixQuery uses internally. If you are not in a position to try the more complex solution I outlined earlier (this bases suggestio

RE: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Vikas Khengare
  Hi Mark     You are right; I want suggestions from doc content only not general words. What will happen if I send PrefixQuery in each char input from user then I will get results [No problem about number of hits to show user] using AJAX. So when user type "a" Onkeyup I will send qu

Re: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread mark harwood
Tips: 1) Don't send to 3 mail lists when 1 will do please continue this conversation on java-user only. 2) Most "suggest" tools work off an index of previous searches (not documents). Do you have a large set of searches? If not, making sensible suggestions based on document content can be much mo

Re: Web services for querying and return of results

2006-05-24 Thread mark harwood
Marc, If you're looking to expose the full lucene search functionality to clients other than Java you will need a query syntax which goes beyond the built in QueryParser syntax e.g. adds support for defining filters, span queries etc in a Java-independent way. If so, the XMLQueryParser in the cont

Re: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Vikas Khengare
Hi Zhenjian YU     Means Now I have 2 options 1.    WildCardQuery 2.   PrefixQuery A] If I use WildCardQuery it will search “a” in whole word and then return result   e.g If I type “a” then it will return all results which contain “a” in their spelling. But I want when us

Re: Web services for querying and return of results

2006-05-24 Thread Marc Dauncey
Thanks for the reply everyone - useful advice. We are already engaged in designing a solution around Lucene, the web services in that context was the thing I specifically needed advice on. Solr sounds very interesting though - how do you maintain the cache? Are you storing filters? And how d

Re: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Zhenjian YU
Hi Vikas, Seems that you can use the WildCardQuery to do this, just put "a*" as the query term. But take caution to use WildCardQuery, because it can bring the performance of your system down. Yes, you can also implement your own filter to filter out the results which don't starting with "a". E

RE: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Vikas Khengare
  Hi Zhenjian YU     I have implemented that with AJAX Search But when I type "a" in textbox. It gives me all results which contains letter "a". So I am getting "America", "Asia", "Flag" & "Zhenjian" also. But in actual I want only "America" & "Asia".   Thanks   -Original M

Re: Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Zhenjian YU
hi, *vikas, *the ajax way should work for you. while in the lucene part, you should do something to handle the prefix query. Best Regards, Zhenjian On 5/24/06, Vikas Khengare <[EMAIL PROTECTED]> wrote: Hi Friend I want to perform search like "Google search" which will give

Re: Checking for duplicates inside index

2006-05-24 Thread Andrzej Bialecki
Hannes Carl Meyer wrote: Ken Krugler schrieb: On Mon, 2006-05-22 at 23:42 +0200, Hannes Carl Meyer wrote: > I'm indexing ~1 documents per day but since I'm getting a lot of real duplicates (100% the same document content) I want to check the content before indexing... > My idea is t

Re: Checking for duplicates inside index

2006-05-24 Thread Hannes Carl Meyer
Ken Krugler schrieb: On Mon, 2006-05-22 at 23:42 +0200, Hannes Carl Meyer wrote: > I'm indexing ~1 documents per day but since I'm getting a lot of real duplicates (100% the same document content) I want to check the content before indexing... > My idea is to create a checksum of th

Can I do "Google Suggest" Like Search? - - - from - - -vikas

2006-05-24 Thread Vikas Khengare
Hi Friend         I want to perform search like “Google search” which will give suggestions to user. So when I type “L” it will give me search options names which will start from “L”. Then when I will type “Lu” then it should give me options for names which are starting from “Lu