Re: Flink 1.13.1 Kafka Producer Error

2021-08-24 Thread Arvid Heise
Hi Debraj, such errors are usually caused by having two versions of Kafka in different places. Did you put flink-connector-kafka into lib/, plugin/, or specifically pointed yarn to it in some way? You should only include it into your user jar. The user jar should not reside in any of the aforemen

Re: Flink 1.13.1 Kafka Producer Error

2021-08-24 Thread Debraj Manna
Fabian I am running it inside yarn. Thanks, On Tue, Aug 24, 2021 at 5:27 PM Fabian Paul wrote: > Hi Debraj > > How do you run your application? If you run it from an IDE you can set a > breakpoint and inspect the serializer class which is used. > > Best, > Fabian

Re: Flink 1.13.1 Kafka Producer Error

2021-08-24 Thread Fabian Paul
Hi Debraj How do you run your application? If you run it from an IDE you can set a breakpoint and inspect the serializer class which is used. Best, Fabian

Re: Flink 1.13.1 Kafka Producer Error

2021-08-24 Thread Debraj Manna
yes I initially did not add ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG` or `ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG. I was getting the same error so tried setting them explicitly. I did mvn dependency:tree | grep -i kafka. I did not see any other versions of Kafka in non test dependency and t

Re: Flink 1.13.1 Kafka Producer Error

2021-08-24 Thread Fabian Paul
Hi Debraj, The error looks indeed strange. We recommend to not set any `ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG` or `ProducerConfig.VALUE_SERIALIZER_CLASS_CONFIG` because the connector will take care of it. Can you try to remove these call and check if it makes a difference? Only looking a

Re: Flink 1.13.1 Kafka Producer Error

2021-08-24 Thread Debraj Manna
The same query has been asked in stackoverflow also. Another related question

Flink 1.13.1 Kafka Producer Error

2021-08-23 Thread Debraj Manna
I am trying to use flink kafka producer like below public static FlinkKafkaProducer createProducer() { Properties props = new Properties(); props.setProperty("bootstrap.servers", ""); props.setProperty(ProducerConfig.KEY_SERIALIZER_CLASS_CONFIG, ByteArraySerializer.class.ge