Flink Protobuf serialization messages does not contain a setter for field bitField0_

Hi As mentioned in the documentation I have registered the Protobuf Serializer like below env.getConfig().registerTypeWithKryoSerializer(SelfDescribingMessageDO.class, ProtobufSerializer.clas

📢 Call for Presentations for Flink Forward Global 2021 is extended!

Hi everyone! Planning to submit a talk for Flink Forward Global 2021? The Call for Presentations has been extended to give you a bit more time to work on your great ideas! *The new deadline is next Monday, June 28*, so be sure to finalize your abstracts and speaker information and submit your talk

Re: How to make onTimer() trigger on a CoProcessFunction after a failure?

Hello Piotr, Could you please help me to ensure that I am implementing it in the correct way? I created the WatermarkFunction [1] based on the FilterFunction from Flink and the WatermarkStreamOperator [2] and I am doing unit test [3]. Then there are things that I am not sure how to do. How to ma

Monitoring Exceptions using Bugsnag

Hi all, I'm interested in instrumenting an Apache Flink application so that we can monitor exceptions. I was wondering what the best practices are here? Is there a good way to observe all the exceptions inside of a Flink application, including Flink internals? We are currently thinking of using B

Re: Write Kafka message header using FlinkKafkaProducer

Hi, You can use KafkaSerializationSchema[1] which can create a ProducerRecord with Headers. Best, Dawid [1] https://ci.apache.org/projects/flink/flink-docs-release-1.13/api/java/org/apache/flink/streaming/connectors/kafka/KafkaSerializationSchema.html On 21/06/2021 12:58, Tan, Min wrote: > >

Write Kafka message header using FlinkKafkaProducer

Hi, I would like to add some meta data in the headers of kafka messages using FlinkKakfkaProducer. I googled a bit and have not found an example. Which Flink Serialization Schema should I use? Any suggestions? Thank you very much for your help in advance. Regards, Min E-mails can involve SUBS

Re: How to know (in code) how many times the job restarted?

Just to clarify, I was using isRestored() but I think getAttemptNumber() should be simpler. Regards, Roman On Mon, Jun 21, 2021 at 10:30 AM Felipe Gutierrez wrote: > > ummm, ok. you are using the "getRuntimeContext().getAttemptNumber()". I was > using the "isRestored()". Now it is counting. >

Re: Flink v1.12.2 Kubernetes Session Mode cannot mount log4j.properties in configMap

Hi Chenyu, First of all, there are two different ways of deploying Flink on Kubernetes. - Standalone Kubernetes [1], which uses yaml files to deploy a Flink Standalone cluster on Kubernetes. - Native Kubernetes [2], which Flink ResourceManager interacts with Kubernetes API Server and allocates res

Re: How to know (in code) how many times the job restarted?

ummm, ok. you are using the "getRuntimeContext().getAttemptNumber()". I was using the "isRestored()". Now it is counting. thanks! Felipe On Fri, Jun 18, 2021 at 10:17 PM Roman Khachatryan wrote: > > do you mean inside the processElement() method? > I used a simple mapper with Thread.sleep befor

Re: unsubscribe

You should send a message to user-unsubscr...@flink.apache.org if you want to unsubscribe. On 20/06/2021 00:08, SANDEEP PUNIYA wrote: OpenPGP_signature Description: OpenPGP digital signature

unsubscribe

unsubscribe

Re: unsubscribe

You should send a message to user-unsubscr...@flink.apache.org if you want to unsubscribe. On 19/06/2021 18:04, 林俊良 wrote: > OpenPGP_signature Description: OpenPGP digital signature

Re:

You should send a message to user-unsubscr...@flink.apache.org if you want to unsubscribe. On 21/06/2021 04:25, 张万新 wrote: > unsubscribe OpenPGP_signature Description: OpenPGP digital signature

Re: Task is always created state after submit a example job

I'm glad that you managed to work it out. As far as I understand, without specifying the `taskmanager.host`, Task Manager would try to automatically detect what host/ip address should be advertised to the Job Manager, using which JM can connect to TM. I don't know what is your network setup, what