Re: Negation search help

2021-04-29 Thread amitesh116
During this change I had to change the way I store indexes. This change results in too many .cfs and .fdt files generated against earlier. Previously there were 5-7 files in index folder, now it has grown to 40+. Does it affect having change in the way how indexes are stored internally with this ch

Re: Negation search help

2021-04-29 Thread amitesh116
//Method to create document private static Document createDocumentTextField(HashMap fields) { Document document = new Document(); for (String key : fields.keySet()) { String val = fields.get(key); Field f = new TextField(key, val, Field.Store.YES);

Re: Negation search help

2021-04-29 Thread Michael Wechner
Yes, it would be great if you could share code snippets. Maybe it will help others or maybe someone will have a suggestion to improve or an alternative. All the best Michael Am 29.04.21 um 14:35 schrieb amitesh116: Thank you Michael! I solved this requirement by setting the tokenStream at t

Re: Negation search help

2021-04-29 Thread amitesh116
Thank you Michael! I solved this requirement by setting the tokenStream at the field level and not leaving it to the analyzer. This gives control over altering the full text before tokenization using custom methods. This has memory overhead which is handled by writing the documents one at a time

Re: Negation search help

2021-04-28 Thread Michael Wechner
Hi Amitesh Thanks for the more concrete examples. Unfortunately I do not know how to solve this better with Lucene itself in a more general context, but did you ever consider using BERT in combination with Lucene/Solr https://blog.google/products/search/search-language-understanding-bert/ ht

Re: Negation search help

2021-04-28 Thread amitesh116
Hi Gus, Thank you your reply! In my search system; users are complaining that they get results with negation terms when don't expect. As explained in my original post. User don't want to get documents having a term like "Non Vitamin K" when they search for "Vitamin K". But because each terms ar

Re: Negation search help

2021-04-28 Thread Gus Heck
behaviour, which is > interesting from a pyschological point of view and it would be > interesting to study it in more detail. > > Coming to your actual question: > > https://lucene.472066.n3.nabble.com/Negation-search-help-td4471842.html > > It seems to me that your use case makes

Re: Negation search help

2021-04-28 Thread Michael Wechner
behaviour, which is interesting from a pyschological point of view and it would be interesting to study it in more detail. Coming to your actual question: https://lucene.472066.n3.nabble.com/Negation-search-help-td4471842.html It seems to me that your use case makes an assumption that the sear

Re: Negation search help

2021-04-28 Thread amitesh116
I badly need some help on this one. Someone please give some direction. Regards Amitesh -- Sent from: https://lucene.472066.n3.nabble.com/Lucene-Java-Users-f532864.html - To unsubscribe, e-mail: java-user-unsubscr...@lucene.a