Re: [EXTERNAL] Re: Re: ElasticsearchIO write to trigger a percolator

2023-02-03 Thread Kaggal, Vinod C. (Vinod C.), M.S. via user
: ElasticsearchIO write to trigger a percolator I believe that 2.41.0 is the "oldest" safe version[1] to use as there were initially some bugs introduced when migrating from PDone to outputting the write results. [1] https://github.com/apache/beam/commit/2cb2ee2ba3b5efb0f08880a9325f092485b3ccf2<

Re: [EXTERNAL] Re: ElasticsearchIO write to trigger a percolator

2023-02-02 Thread Evan Galpin
; > > Thank you! > > Vinod > > > > *From: *Chamikara Jayalath > *Date: *Thursday, February 2, 2023 at 6:01 PM > *To: *user@beam.apache.org , Kaggal, Vinod C. > (Vinod C), M.S. > *Subject: *[EXTERNAL] Re: ElasticsearchIO write to trigger a percolator > > >

Re: [EXTERNAL] Re: ElasticsearchIO write to trigger a percolator

2023-02-02 Thread Kaggal, Vinod C. (Vinod C.), M.S. via user
), M.S. Subject: [EXTERNAL] Re: ElasticsearchIO write to trigger a percolator On Thu, Feb 2, 2023 at 1:56 PM Kaggal, Vinod C. (Vinod C.), M.S. via user mailto:user@beam.apache.org>> wrote: Hello! Thank you for all the hard work on implementing these useful libraries. Background: We have been

Re: ElasticsearchIO write to trigger a percolator

2023-02-02 Thread Chamikara Jayalath via user
On Thu, Feb 2, 2023 at 1:56 PM Kaggal, Vinod C. (Vinod C.), M.S. via user < user@beam.apache.org> wrote: > Hello! Thank you for all the hard work on implementing these useful > libraries. > > > > *Background:* We have been using Apache Storm in production for some time > (over 8 years) and have re

ElasticsearchIO write to trigger a percolator

2023-02-02 Thread Kaggal, Vinod C. (Vinod C.), M.S. via user
Hello! Thank you for all the hard work on implementing these useful libraries. Background: We have been using Apache Storm in production for some time (over 8 years) and have recently switched over to Beam. One of the topologies that we had in Storm was to ingest data, index to elastic (write) a