Hi, Atri! You're right, Actually there is a lack of support for TextQueries. For the last ticket I'm doing I see some obvious issues with them (no page size support, for example). I'm glad that somebody wants to maintain this functionality. Thanks a lot!
For the MergeSort algorithm there is already a patch for that [1]. It's currently on review. This patch introduces an abstract reducer for CacheQueries with 2 implementations (unordered, merge-sort). Then TextQuery leverages on MergeSort to order results from multiple nodes by score. This patch also fixes the pageSize issue, I've mentioned before. Could you please check if it fully matches your idea? Any issues or comments are welcome. I've prepared this ticket, because I need the MergeSort algorithm for the new type of queries I'm implementing (IndexQuery, it should also provide ordered results over multiple nodes). Currently I'm not planning to go further with TextQuery, so if you're going to support this it'll be a great contribution, I think. [1] https://issues.apache.org/jira/browse/IGNITE-14703 [2] https://github.com/apache/ignite/pull/9081 On Mon, Jun 21, 2021 at 11:11 AM Atri Sharma <a...@apache.org> wrote: > Hi All, > > I have been looking into our text queries support and see that it has > limited community support. > > Therefore, I volunteer to be the maintainer of the module and work on > enhancing it further. > > First goal would be to move to Lucene 8.x, then work on sorted reduce > - merge across nodes. Fundamentally, this is doable since Lucene ranks > documents according to their score, and documents are returned in the > order of their score. Since the scoring function is homogeneous, this > means that across nodes, we can compare scores and merge sort. > > Please let me know if I can take this up. > > Atri > > -- > Regards, > > Atri > Apache Concerted >
