Re: Non equi-joins with streaming expressions

2022-01-07 Thread Damiano Albani
OK, if I can find some time, I'll have a try. In the long run, it would be better (for me) to have the functionality by default in Solr than to maintain my own piece of code 😀 On Fri, Jan 7, 2022 at 1:42 AM Dennis Gove wrote: > Hi Damiano, > > Yup, that's what I meant. I'd be happy to collaborat

Re: Non equi-joins with streaming expressions

2022-01-06 Thread Dennis Gove
Hi Damiano, Yup, that's what I meant. I'd be happy to collaborate with you on this. Cheers! On Thu, Jan 6, 2022 at 5:09 PM Damiano Albani wrote: > Hi Dennis, > > Do you (implicitly) mean by your message that it would be a good idea to > get the changes you mentioned into the official Solr code

Re: Non equi-joins with streaming expressions

2022-01-06 Thread Damiano Albani
Hi Dennis, Do you (implicitly) mean by your message that it would be a good idea to get the changes you mentioned into the official Solr code base? In other words, that a PR implementing this enhancement would be considered by the Solr team? Regards, On Wed, Jan 5, 2022 at 1:58 AM Dennis Gove w

Re: Non equi-joins with streaming expressions

2022-01-04 Thread Dennis Gove
My recollection from working on this code years ago is that other definitions of "equal" can be supported by creating new implementations of the Equalitor class ( https://github.com/apache/solr/blob/main/solr/solrj/src/java/org/apache/solr/client/solrj/io/eq/Equalitor.java#L27-L30). The purpose of

Re: Non equi-joins with streaming expressions

2022-01-04 Thread Damiano Albani
Hello, It's the first time that I hear about those Lucene expressions written in JavaScript. Good to learn about it! I suppose you're referring to https://lucene.apache.org/core/9_0_0/expressions/org/apache/lucene/expressions/js/package-summary.html ? I couldn't find much information about how to

Re: Non equi-joins with streaming expressions

2022-01-04 Thread David Smiley
I'd prefer to use Lucene's "expressions" module and thus do JavaScript. This is more accessible to a wider audience, and I believe makes safety/security easier (though I have not checked). ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in/davidwsmiley On Tue, Jan 4, 2

Re: Non equi-joins with streaming expressions

2022-01-04 Thread Eric Pugh
That looks great! I love how (relatively) simple it all is to write your own logic. One of the reasons that we added packages (bin/solr package) to Solr is so that if someone wants to add something like a java() evaluator, they can! > On Jan 4, 2022, at 11:40 AM, Damiano Albani wrote: > > Hi

Re: Non equi-joins with streaming expressions

2022-01-04 Thread Damiano Albani
Hi, Just a quick note to mention that I've managed to implement what I wanted in terms of non equi-joins. Should someone be interested, I've put my code on https://github.com/dalbani/solr-streaming-expressions. By the way, I happened to need a startsWith function and I implemented it quite easily

Re: Non equi-joins with streaming expressions

2021-12-29 Thread Joel Bernstein
As you mentioned currently only the equi-join is supported. But you could pretty quickly adapt an existing join to do what you want. https://github.com/apache/solr/blob/main/solr/solrj/src/java/org/apache/solr/client/solrj/io/stream/LeftOuterJoinStream.java Joel Bernstein http://joelsolr.blogspot

Re: Non equi-joins with streaming expressions

2021-12-29 Thread Eric Pugh
https://github.com/epugh/playing-with-solr-streaming-expressions/tree/master/streaming_expressions/src/main/java/com/o19s/solr/streaming has an example of parsing JSONL formatted docs and an example of using atomic updates ;-) https://github.com/epugh/playing-with-solr-streaming-expressions/blob

Re: Non equi-joins with streaming expressions

2021-12-29 Thread Damiano Albani
Hi Eric, Thanks for your feedback, I highly appreciate it. I don't mind going the route of implementing something myself. I will have a try. By any chance, apart from looking at the official codebase, do you know of any examples out there I could draw my inspiration from? Regards, On Wed, Dec 29

Re: Non equi-joins with streaming expressions

2021-12-29 Thread Eric Pugh
Damiano, I don’t really have a direct answer for you. However, one of the aspects of Streaming that I really like is that it’s relatively easy to create your own operators and add them to Solr. I find that I often just create my own operator to fill in the gap of what is available. I do th