Hi All,
I have set up a flink standalone cluster, with one master and two slave , all
RedHat-7 machines. In the master Dashboard http://flink-master:8081/ I can see
2 Task Manager and 8 task slot as I have set taskmanager.numberOfTaskSlots: 4
in flink-conf.yaml in all of the slaves.
Now when
hema would simply
be an adjustment of the AvroInputFormat to the interface of the
DeserializationSchema.
In your Avro DeserializationSchema, you can probably create the Avro readers
internally with an Avro schema (I believe).
Greetings,
Stephan
On Tue, Aug 2, 2016 at 4:53 PM, Alam, Zee
Hi,
Flink works very well with Kafka if you wish to stream data. Following is how
I am streaming data with Kafka and Flink.
FlinkKafkaConsumer08 kafkaConsumer = new
FlinkKafkaConsumer08<>(KAFKA_AVRO_TOPIC, avroSchema, properties);
DataStream messageStream = env.addSource(kafkaConsumer);
Is th
arey [mailto:sca...@expedia.com]
Sent: Tuesday, August 02, 2016 8:49 PM
To: Alam, Zeeshan; user@flink.apache.org
Subject: Re: How to read AVRO data from Kafka using Flink
I can tell you that we are reading Avro data from Kafka on Flink without
problems. It seems like you have a mistake somewhere in
ings,
Stephan
On Tue, Aug 2, 2016 at 4:04 PM, Alam, Zeeshan
mailto:zeeshan.a...@fmr.com>> wrote:
Hi,
I am using Flink 1.0.3 and FlinkKafkaConsumer08 to read AVRO data from flink. I
am having the AVRO schema file with me which was used to write data in Kafka.
Here
https://ci.apache.org/proj
Hi,
I am using Flink 1.0.3 and FlinkKafkaConsumer08 to read AVRO data from flink. I
am having the AVRO schema file with me which was used to write data in Kafka.
Here
https://ci.apache.org/projects/flink/flink-docs-release-0.8/example_connectors.html
you have mentioned that using the GenericDa
Hi All,
I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting
error. I have posted this issue in Stack Overflow:
http://stackoverflow.com/questions/38715286/how-to-decode-kafka-messages-using-avro-and-flink
. Is there any mistake we can try to look into or there a better w
Hi All,
I am trying to read AVRO data from Kafka using Flink 1.0.3 but I am getting
error. I have posted this issue in Stack Overflow:
http://stackoverflow.com/questions/38698721/how-to-read-avro-data-from-kafka-using-flink
. Is there any mistake we can try to look into?
Thanks & Regards
Zees
