Re: Require help regarding possible issue/bug I'm facing while using Flink

Hi De Xun, I created an answer in the StackOverflow and hope it would be helpful. I’d like repost my answer here for the convenience of people in mailing lists. The first call of RowRowConverter::toInternal is an internal implementation for making a deep copy of the StreamRecord emitted by tab

Re: PyFlink : submission via rest

The dedicated REST API is still not supported. However, you could try to use PythonDriver just like you said and just submit it like a Java Flink job. Regards, Dian On Sun, Mar 6, 2022 at 3:38 AM aryan m wrote: > Thanks Zhilong for taking a look! > > Primarily I am looking for ways to start it

Re: Pyflink1.13 or JavaFlink1.13 + Jpython + Python2.7, which way has better performance?

Hi Vtygoss, >> As far as i know, the python APIs only provide a subset of about 2/3 of what's available in Java APIs; the performance of PyFlink is worse than JavaFlink and some features contributed after 1.10 are not implemented in PyFlink yet. There are two levels of API in Flink: Table API and

Re: Submit job to a session cluster on Kubernetes via REST API

If you want to use the RestClusterClient to do the job submission and lifecycle management, the implementation in the flink-kubernetes-operator[1] project may give you some insights. You could also use /jars/:jarid/run[2] to run a Flink job. It is a pure HTTP interface. [1]. https://github.com/a

Re: How to sort Iterable in ProcessWindowFunction?

Collect the elements to a list, then sort, then collect out. HG 于2022年3月3日周四 22:13写道： > Hi, > I have need to sort the input of the ProcesWindowFunction by one of the > fields of the Tuple4 that is in the Iterator. > > Any advice as to what the best way is? > > static class MyProcessWindowFunc

Require help regarding possible issue/bug I'm facing while using Flink

Greetings, I'm facing a difficult issue/bug while working with Flink. Would definitely appreciate some official expert help on this issue. I have posted my problem on StackOverflow , but have no

Re: Question about Flink counters

Hi Zhanghao Chen, Sure, I can give some context. My team's Flink application runs as a Kinesis Data Analytics streaming application [1] in AWS. Our application receives events from Amazon Simple Queue Service (SQS) [2] in our source, and then uses a property of the SQS event to download from A

Re: Incremental checkpointing & RocksDB Serialization

Hi Vidya, 1. You could tune your job to avoid backpressure. Maybe you can upgrade your flink engine to at least flink-1.13 to know how to monitor the back pressure status [1] 2. You can refer to [2] to know how to custom your serializer. [1] https://nightlies.apache.org/flink/flink-doc