Difference between PhraseQuery and Span(Near)Query

2010-06-18 Thread syedfa
Dear fellow Java developers: I am reading up on PhraseQuery to search for an exact match for terms that appear exactly in a particular order for a field (i.e. slop value of 0). However, I came across SpanNearQuery which appears to work in a similar fashion, but am confused, due to it's variation

Is it possible to do a PhraseQuery using XML Query Parser?

2010-01-12 Thread syedfa
Dear fellow Java developers: Is it possible to do a PhraseQuery when using the XML Query Parser? I checked the documentation for the XML Query Parser, and it has tags for a multitude of queries, with PhraseQuery absent from the list. Is it possible to do a PhraseQuery using the XMLQueryParser,

Need help with XML Query Parser for search form

2009-12-30 Thread syedfa
Dear fellow Java developers: I am setting up an advanced search page that is very similar to google's and yahoo's. I have four text fields with the following labels: With all of the words: With the exact phrase: With at least on one of the words:

Re: Basic question about indexing certain words

2009-12-27 Thread syedfa
makes > it > easy to see the effects of various Analyzers. Google Lucene Luke > > Finally, you can easily use *different* analyzers for different fields > within a > document, see PerFieldAnalyzerWrapper. > > HTH > Erick > > On Sun, Dec 27, 2009 at 5:48 PM,

Basic question about indexing certain words

2009-12-27 Thread syedfa
Dear fellow Java developers: I have a very basic question about indexing text using Lucene. I am indexing a large amount of text, that includes names that contain certain punctuation (eg. "Jane Doe-Smith", "Sa'eed", etc.) Will the punctuation throw off the indexer in any way, such that it break

Re: Need help with XML Query Parser example in Lucene 3.0

2009-12-23 Thread syedfa
Ignore the previous message, I realized that I just needed to choose the right combination to get a result! Thanks again for your time and patience. Take care. Sincerely; Fayyaz syedfa wrote: > > Thanks very much for your kind reply, and for pointing out my mistake. I > made the c

Re: Need help with XML Query Parser example in Lucene 3.0

2009-12-23 Thread syedfa
The "jobDescription" > default fieldname passed to the XML parser would only be in effect for any > tags that didn't specify a fieldName.. > > BTW, in the source distribution there are full "DTDdocs" for the XML > syntax in contrib\xml-query-parser\docs >

Re: Need help with XML Query Parser example in Lucene 3.0

2009-12-22 Thread syedfa
t take note of this, or please show me the error of my ways. Having said that, as I mentioned earlier, despite making this correction, I am still getting the above "NullPointerException". Can anyone see where I am going wrong? Thanks again to all who reply. Sincerely; Fayyaz syedfa

Need help with XML Query Parser example in Lucene 3.0

2009-12-22 Thread syedfa
Dear fellow Java developers: I am trying to run the XML Query Parser example that comes with Lucene 3.0 source distribution. I have the application structured identical to the one you download, and I am trying to run it in eclipse. When I launch the application, fill out the form that appears o

Re: Finding duplicate records from a result set

2009-09-16 Thread syedfa
r > duplicating search results to users.other wise the user can waste > considerable time inspecting which is duplicate and which is not . > i can give u the the abstract and come codes (in java) id u want > i think this might help > henok > > --- On Wed, 9/16/09, syedfa wrote:

Finding duplicate records from a result set

2009-09-16 Thread syedfa
Dear Fellow Java/Lucene developers: One annoyance that people have when searching for information online is the occurance of duplicate records (i.e. multiple sites that carry news feeds from the SAME news source like reuters or the associated press, and do not provide any additional pieces of inf

RE: Lucene vs. LingPipe vs. GATE

2009-03-14 Thread syedfa
bout that, it combines the > three tools to create a web search engine. > > Uwe > > - > Uwe Schindler > H.-H.-Meier-Allee 63, D-28213 Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > >> -Original Message- >> From: syedfa [mailto:f

Lucene vs. LingPipe vs. GATE

2009-03-14 Thread syedfa
Dear fellow Java/Lucene developers: I have been working with lucene for the past year or so in developing search applications, and just recently discovered another API for Java called LingPipe. I have never used LingPipe, and would like to know what is the difference between the two, and if not,

Searching over multiple fields using XML document

2008-11-02 Thread syedfa
Dear fellow Java/Lucene developers: I am trying to search an xml document over multiple fields. The index I created using the SAX method. I am trying to search shakespeare's "Hamlet" over the and tags for words that the user is looking for. I am thinking of using the MultiFieldQueryParser ho

Highlighting results returned from MultiFieldQueryParser

2008-07-30 Thread syedfa
Dear fellow Lucene/Java developers: I have an index created from an XML file which I am trying to search using the MultiFieldQueryParser. At present, I am using the QueryParser to successfully return results that are highlighted. The code is listed here: public List search(File indexDir, Strin

Re: Creating an index from an XML file using Lucene in Java

2008-07-28 Thread syedfa
ld.TermVector.YES); > doc.add(lines); > } > ... > if(qName.equals("SPEECH") || qName.equals("SCENE-COMMENTARY")){ > indexWriter.addDocument(doc); > } > > (instead of "indexWriter.addDocument(doc);" in block of > if(qName.equals("LIN

Re: Creating an index from an XML file using Lucene in Java

2008-07-28 Thread syedfa
ument(doc); > } > > (instead of "indexWriter.addDocument(doc);" in block of > if(qName.equals("LINES")){ ) > > > > Best regards > Karsten > > P.S.: > If you want to learn java: > I really like > http://www.java-hamster-modell.de/

Re: Creating an index from an XML file using Lucene in Java

2008-07-28 Thread syedfa
") || qName.equals("SCENE-COMMENTARY")){ > indexWriter.addDocument(doc); > } > > (instead of "indexWriter.addDocument(doc);" in block of > if(qName.equals("LINES")){ ) > > > > Best regards > Karsten > > P.S.: >

Re: Creating an index from an XML file using Lucene in Java

2008-07-27 Thread syedfa
I think I understand what you are saying, but I was hoping you could clarify a little further. in the start-element method, I have the following: if(qName.equals("SPEECH")){ doc=new Document(); } are you saying that I should add an ident

Creating an index from an XML file using Lucene in Java

2008-07-27 Thread syedfa
Dear fellow Java/Lucene developers: I have a question on creating an index from an XML document for the purpose of searching using the Lucene API in Java. I am searching shakespeare's "Hamlet" which I have as an xml document. I want to include comentary on each scene and would like to make th

Improving search performance with the results returned

2008-06-18 Thread syedfa
Dear Fellow Java/Lucene developers: I want to know if there is a way to improve the efficiency of doing a search using lucene such that when a user does a search, and should there be hundreds of hits, by paging the results for the user, provide only the best 20 hits first (like google). If the u

Re: Displaying and highlighting results from a Wild Card and Fuzzy search using Lucene in Java

2008-06-18 Thread syedfa
Thanks so much for your responses, I have it figured out: Query parser=new WildcardQuery(new Term("LINES", "the*")); parser=parser.rewrite(IndexReader.open(fsDir)); and I was able to get my results highlighted for both WildCard and Fuzzy searches. Thanks for the responses. Sincerely; F

Re: Displaying and highlighting results from a Wild Card and Fuzzy search using Lucene in Java

2008-06-16 Thread syedfa
Thanks very much for your reply. I am having problems creating an IndexReader object for this purpose. This is the relevant code for my method: public List wildSearch(File indexDir) throws Exception { List searchResult = new ArrayList(); Directory fsDir=FSDirectory.get

Re: Displaying and highlighting results from a Wild Card and Fuzzy search using Lucene in Java

2008-06-15 Thread syedfa
help in accomplishing this would be greatly appreciated. Sincerely; Fayyaz Daniel Naber-10 wrote: > > On Sonntag, 1. Juni 2008, syedfa wrote: > >> I am trying to display my results from doing a search of an xml document >> (some quotes from shakespeare's "Hamlet&qu

Displaying and highlighting results from a Wild Card and Fuzzy search using Lucene in Java

2008-05-31 Thread syedfa
Dear Fellow Java and Lucene developers: I am trying to display my results from doing a search of an xml document (some quotes from shakespeare's "Hamlet") using a WildCard and Fuzzy search, and then I'm trying to highlight the keyword(s) in the results, but unfortunately I am having problems. In

Re: How to return entire resultset which includes the highlighted keywords

2008-05-23 Thread syedfa
Dear Mr.Miller: I figured out how to use the CachingTokenFilter and it worked exactly as you described. Thanks so much once again for sharing your time and expertise! :-) All the best. Sincerely; Fayyaz markrmiller wrote: > > A TokenStream can only be read once unless you wrap it with a >

Re: How to return entire resultset which includes the highlighted keywords

2008-05-23 Thread syedfa
Thanks for your reply, can you give an example of how this is done? Sincerely; Fayyaz markrmiller wrote: > > A TokenStream can only be read once unless you wrap it with a > CachingTokenFilter and call reset between uses. So thats what you should > do. > > - Mark > >

Re: How to return entire resultset which includes the highlighted keywords

2008-05-23 Thread syedfa
Thanks so much for your reply Mr.Miller, that's exactly what I was trying to accomplish! :-) I have however, run into another problem now, and thus I have a follow up question: My goal is to provide a set of results like google to the user that presents a set of results with the keyword highlig

How to return entire resultset which includes the highlighted keywords

2008-05-20 Thread syedfa
Dear Fellow Java/Lucene developers: I am trying to use the Highlighter class to return the keywords that the user is searching for in bold. However, instead of returning a fragment of the block of text where the keyword is found, I would like to return the ENTIRE block of text. Here is the bloc

Using Highlighter to return search results

2008-05-03 Thread syedfa
Dear Fellow Java/Lucene developers: I have created an index from an xml document which I would like to search using lucene. Unfortunately, I am only able to return the number of times a particular key word is found in the document, instead of returning the keyword as well as the text that comes

Searching through a single XML document

2008-04-20 Thread syedfa
Dear Fellow Java/Lucene developers: I am trying to write a search engine application for shakespeare's "Hamlet" which I have in xml format. For demonstration purposes, I am using an xml file of some quotes from the play only, which is listed below: The Tragedy of Hamlet, Prince of Denmark LOR

Indexing and Searching from within a single Document

2008-04-07 Thread syedfa
Dear Fellow Java/Lucene developers: I am writing an application where a user is able to search for keywords from within a single book. When the user conducts a search, he/she should receive a set of results that show the sentence/phrase within the book where the keyword is found. Unfortunately,

Re: Error running Lucene in Action code

2007-12-07 Thread syedfa
Erik > > > On Dec 6, 2007, at 9:53 PM, syedfa wrote: > >> >> Thanks very much for your reply. I commented out the line: >> >> attributeMap.clear(); >> >> in the startElement() method, and the code ran! >> >> Thanks for your pr

Re: Error running Lucene in Action code

2007-12-06 Thread syedfa
u need to initialize attributeMap, eg add " = new HashMap()" in > the declaration? > > Mike > > "syedfa" <[EMAIL PROTECTED]> wrote: >> >> Dear Fellow Java & Lucene developers: >> >> I am a Java developer learning lucene and I am cur

Re: Error running Lucene in Action code

2007-12-05 Thread syedfa
I'll give it a try. I would be surprised if that is the problem, since the code is straight from the book. Let's see what happens. Fayyaz Michael McCandless-2 wrote: > > > I think you need to initialize attributeMap, eg add " = new HashMap()" in > the dec

Error running Lucene in Action code

2007-12-04 Thread syedfa
Dear Fellow Java & Lucene developers: I am a Java developer learning lucene and I am currently going through the book Lucene in Action. At present, I am trying to run the sample code for indexing an xml document using sax. My code has been slightly updated for Lucene version 2.2: /* * To chan

XML parsing using Lucene in Java

2007-11-18 Thread syedfa
Dear Fellow Lucene Developers: I am a java/jsp developer and have started learning lucene for the purpose of creating a search engine for some books that I have in xml format. The XML document is actually quite large, and would like to provide as accurate results as possible to the user searchin