Re: Flink, JSON, and JSONSchemas

2022-06-18 Thread Andrew Otto
> > *1. Is there some easy way to use deserialized JSON in DataStream without case classes or POJOs?* > Could you explain what you expected? Do you mean you want to just register a DataType that is able to bridge the received bytes to the POJO objects. No, heh, I don't want to have any POJO objects

Re: Flink, JSON, and JSONSchemas

2022-06-16 Thread Shengkai Fang
Hi. > *1. Is there some easy way to use deserialized JSON in DataStream without case classes or POJOs?* Could you explain what you expected? Do you mean you want to just register a DataType that is able to bridge the received bytes to the POJO objects. I am not sure wether the current RAW type[1]

Flink, JSON, and JSONSchemas

2022-06-16 Thread Andrew Otto
At the Wikimedia Foundation, we use JSON and JSONSchemas for our events in Kafka. There are hundreds of these schemas and topics in Kafka. I'd like to provide library level integration between our 'Event Platform' JSON data and Flink. My main goal: *No case classes or POJOs. *The JSONSchemas s