Re: [DISCUSS] Status of Statefun Project

2023-05-26 Thread Salva Alcántara
Hey Galen, I took a look at StateFun some time ago; not using it in production but I agree that it would be a pity to abandon it. As Martijn said, let's be clear on what lies ahead (what option is finally picked) and how to contribute (if possible) moving forward. Regards, Salva On Sat, May 27

Re: [DISCUSS] Status of Statefun Project

2023-05-26 Thread Galen Warren via user
Ok, I get it. No interest. If this project is being abandoned, I guess I'll work with my own fork. Is there anything I should consider here? Can I share it with other people who use this project? On Tue, May 16, 2023 at 10:50 AM Galen Warren wrote: > Hi Martijn, since you opened this discussion

Bulk storage of protobuf records in files

2023-05-26 Thread Ryan Skraba via user
Hello all! I discovered while investigating FLINK-32008[1] that we can write to the filesystem connector with the protobuf format, but today, the resulting file is pretty unlikely to be useful or rereadable. There's no real standard for storing many protobuf messages in a single file container, a

Re: [ANNOUNCE] Apache Flink 1.16.2 released

2023-05-26 Thread Jing Ge via user
Hi Weijie, Thanks again for your effort. I was wondering if there were any obstacles you had to overcome while releasing 1.16.2 and 1.17.1 that could lead us to any improvement wrt the release process and management? Best regards, Jing On Fri, May 26, 2023 at 4:41 PM Martijn Visser wrote: > Th

Re: [ANNOUNCE] Apache Flink 1.17.1 released

2023-05-26 Thread Jing Ge via user
Hi Weijie, That is earlier than I expected! Thank you so much for your effort! Best regards, Jing On Fri, May 26, 2023 at 4:44 PM Martijn Visser wrote: > Same here as with Flink 1.16.2, thank you Weijie and those who helped with > testing! > > On Fri, May 26, 2023 at 1:08 PM weijie guo > wrot

Re: [ANNOUNCE] Apache Flink 1.17.1 released

2023-05-26 Thread Martijn Visser
Same here as with Flink 1.16.2, thank you Weijie and those who helped with testing! On Fri, May 26, 2023 at 1:08 PM weijie guo wrote: > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.17.1, which is the first bugfix release for the Apache Flink 1.17 > ser

Re: [ANNOUNCE] Apache Flink 1.16.2 released

2023-05-26 Thread Martijn Visser
Thank you Weijie and those who helped with testing! On Fri, May 26, 2023 at 1:06 PM weijie guo wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink 1.16.2, which is the second bugfix release for the Apache > Flink 1.16 series. > > > > Apache Flink® is an op

Re: Backpressure handling in FileSource APIs - Flink 1.16

2023-05-26 Thread Kamal Mittal
Hello Shammon, Can you please point out the classes where like for "FileSource" slow down logic is placed? Just wanted to understand it more better and try it at my end by running various perf. runs, also apply changes in my application if any. Rgds, Kamal On Thu, May 25, 2023 at 9:16 AM Kamal

[ANNOUNCE] Apache Flink 1.17.1 released

2023-05-26 Thread weijie guo
The Apache Flink community is very happy to announce the release of Apache Flink 1.17.1, which is the first bugfix release for the Apache Flink 1.17 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming

[ANNOUNCE] Apache Flink 1.16.2 released

2023-05-26 Thread weijie guo
The Apache Flink community is very happy to announce the release of Apache Flink 1.16.2, which is the second bugfix release for the Apache Flink 1.16 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streamin

Re: IRSA with Flink S3a connector

2023-05-26 Thread Anuj Jain
Hi Martijn, As I can see FLINK-31095 is now closed. I will try the things mentioned there on my test systems and share the results. Thanks for your help. Regards Anuj On Tue, May 23, 2023 at 1:10 PM Martijn Visser wrote: > Hi Anuj, > > I rec