Re: Synchronisation between different sources in flink

2021-10-15 Thread Akshay Agarwal
dumped as files from the backend in regular intervals like every hour, quarter of an hour. *Akshay Agarwal* On Fri, Oct 15, 2021 at 3:48 PM Martijn Visser wrote: > Hi, > > Can you elaborate a bit more on what your use case is and what you're > trying to achieve? > > Best rega

Re: Synchronisation between different sources in flink

2021-10-15 Thread Akshay Agarwal
and keep file source as it is. *Akshay Agarwal* On Fri, Oct 15, 2021 at 2:06 PM Akshay Agarwal wrote: > Nope, I haven't gone through that, will take a look, thanks for the prompt > reply. > > *Akshay Agarwal* > > > > On Fri, Oct 15, 2021 at 2:00 PM Martijn Visser &g

Re: Synchronisation between different sources in flink

2021-10-15 Thread Akshay Agarwal
Nope, I haven't gone through that, will take a look, thanks for the prompt reply. *Akshay Agarwal* On Fri, Oct 15, 2021 at 2:00 PM Martijn Visser wrote: > Hi, > > Have you checked out the Hybrid Source? [1] > > Thanks, Martijn > > [1] > https://ci.apache.org/pro

Synchronisation between different sources in flink

2021-10-15 Thread Akshay Agarwal
flink but did not found any blog/material. It might be a noob question, but if you guys have built something around this, could you let me know. Regards *Akshay Agarwal* -- <https://grofers.com>

Re: Flink Avro Timestamp Precision Issue

2021-08-26 Thread Akshay Agarwal
Thanks Matthias for pointing us to the links, we will definitely follow those. *Regards* *Akshay Agarwal* On Thu, Aug 26, 2021 at 6:43 PM Matthias Pohl wrote: > Hi Akshay, > thanks for reaching out to the community. There was a similar question on > the mailing list earlier this

Flink Avro Timestamp Precision Issue

2021-08-26 Thread Akshay Agarwal
7;T'HH-mm-ss.SS'Z'. Eventually I have read the records as a custom UDF which drops seconds offset but wanted to know if there is a better way to handle this also the reason why isn't it's supported. It would be a great help for us to know about it and we can buil