Re: Incorrect checkpoint id used when job is recovering

Hi team, Does anyone have any ideas? On Thu, May 12, 2022 at 9:20 PM tao xiao wrote: > Forgot to mention the Flink version is 1.13.2 and we use kubernetes native > mode > > On Thu, May 12, 2022 at 9:18 PM tao xiao wrote: > >> Hi team, >> >> I met a weird issue when a job tries to recover from

Re: [Discuss] Creating an Apache Flink slack workspace

Hi all, Would just like to share an interesting article from the dbt community[1], which in part describes some of their challenges in managing Slack in a large community. The biggest point it seems to make is that their Slack has become a marketing tool for dbt/data vendors instead of a community

Re: Converting from table to stream, following Avro schema

Hi Dian, This is great news, really! Hope to see this soon in stable :D Thanks a lot! On Fri, 13 May 2022 at 15:25, Dian Fu wrote: > Hi Dhavan, > > This should be a known issue and has already been fixed in > https://issues.apache.org/jira/browse/FLINK-27282. However, this ticket > was fixed

Re: Converting from table to stream, following Avro schema

Hi Dhavan, This should be a known issue and has already been fixed in https://issues.apache.org/jira/browse/FLINK-27282. However, this ticket was fixed recently and so it's still not released. Regards, Dian On Thu, May 12, 2022 at 7:26 PM Dhavan Vaidya wrote: > Hey Dian, > > Though my HTTP ca

Re: Join two data stream using DataStream API using PyFlink

Hi Ian, You need to create two streams, and use https://nightlies.apache.org/flink/flink-docs-master/api/python/pyflink.datastream.html#pyflink.datastream.DataStream.connect to "join" them. On Fri, 13 May 2022 at 14:06, lan tran wrote: > Hi team, I have the use case is that I want to join two d

Join two data stream using DataStream API using PyFlink

Hi team, I have the use case is that I want to join two datastream that have the same id. If we convert into sql we will have something like thisSELECT suppliers.supplier_id, suppliers.supplier_name, orders.order_dateFROM suppliers INNER JOIN ordersON suppliers.supplier_id = orders.supplier_id;Howe

Re: Split string flatmap -> Arraylist/List

Hi Zain, There are different options to achieve this. You can take a look at the WordCount example [1] to get some inspiration. [1] https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/wordcount/WordCount.java Best

Split string flatmap -> Arraylist/List

Hi, I have a comma separated string of the format x,y,z \n a,b,c ... I want to split the string on the basis of '\n' and insert each string into the data stream separately using *flatmap*. Any example on how to do that? If I add the chunks into an Arralist or List and return that from the flatmap