Thank you, Maksin and Alexei! To dive a bit deeper, what are our biggest issues with text queries today? One is persistence, the other (IIUC) is the fact that we cannot order results from different nodes (which PR 9081 seems to have resolved?)
What else would be pending for text queries to become usable? Atri On Mon, Jun 21, 2021 at 2:49 PM Alexei Scherbakov <alexey.scherbak...@gmail.com> wrote: > > Hi. > > One of the biggest issues with text queries is a lack of support for lucene > indices persistence, which makes this functionality useless if a > persistence is enabled. > > I would first take care of it. > > пн, 21 июн. 2021 г. в 12:16, Maksim Timonin <timonin.ma...@gmail.com>: > > > Hi, Atri! > > > > You're right, Actually there is a lack of support for TextQueries. For the > > last ticket I'm doing I see some obvious issues with them (no page size > > support, for example). I'm glad that somebody wants to maintain this > > functionality. Thanks a lot! > > > > For the MergeSort algorithm there is already a patch for that [1]. It's > > currently on review. This patch introduces an abstract reducer for > > CacheQueries with 2 implementations (unordered, merge-sort). Then TextQuery > > leverages on MergeSort to order results from multiple nodes by score. This > > patch also fixes the pageSize issue, I've mentioned before. Could you > > please check if it fully matches your idea? Any issues or comments are > > welcome. > > > > I've prepared this ticket, because I need the MergeSort algorithm for the > > new type of queries I'm implementing (IndexQuery, it should also provide > > ordered results over multiple nodes). Currently I'm not planning to go > > further with TextQuery, so if you're going to support this it'll be a great > > contribution, I think. > > > > [1] https://issues.apache.org/jira/browse/IGNITE-14703 > > [2] https://github.com/apache/ignite/pull/9081 > > > > > > On Mon, Jun 21, 2021 at 11:11 AM Atri Sharma <a...@apache.org> wrote: > > > > > Hi All, > > > > > > I have been looking into our text queries support and see that it has > > > limited community support. > > > > > > Therefore, I volunteer to be the maintainer of the module and work on > > > enhancing it further. > > > > > > First goal would be to move to Lucene 8.x, then work on sorted reduce > > > - merge across nodes. Fundamentally, this is doable since Lucene ranks > > > documents according to their score, and documents are returned in the > > > order of their score. Since the scoring function is homogeneous, this > > > means that across nodes, we can compare scores and merge sort. > > > > > > Please let me know if I can take this up. > > > > > > Atri > > > > > > -- > > > Regards, > > > > > > Atri > > > Apache Concerted > > > > > > > > -- > > Best regards, > Alexei Scherbakov -- Regards, Atri Apache Concerted
