Hi Robert,
Thanks for your reply. This helps, was looking into similar direction.
Thanks,
Hemant
On Wed, 18 Mar 2020 at 8:44 PM, Robert Metzger wrote:
> Hi Hemant,
>
> you could let the Kafka consumer just deserialize your JSON data as into a
> DataStream, then you use a custom processFunction
Hi Hemant,
you could let the Kafka consumer just deserialize your JSON data as into a
DataStream, then you use a custom processFunction to parse the
string to JSON.
In your custom function, you can handle the error more flexibly (like
outputting erroneous records through a side output).
I hope th
Hi Users,
Is there a way I can do a schema validation on read from Kafka in a Flink
job.
I have a pipeline like this
Kafka Topic Raw(json data) -> Kafka Topic Avro(avro data) -> Kafka Topic
Transformed(avro data) -> Sink
While reading from Raw topic I wanted to validate the schema so that in
ca
