Watermark and multiple streams

2018-04-10 Thread Filipe Couto
Hello. I'm joining several data streams, using ConnectedStreams. Let's say something like A connect B which outputs AB, and then I join AB with C, which outputs ABC. However, the relationship between A and B, or AB and C may be of 1 to many, or 1 to 1, depending on the case. For the 1 to 1, it'

Serialization and Deserialization of Avro messages stored in Kafka

2018-03-02 Thread Filipe Couto
Hello, I have a few topics that I want to read from Kafka, which consist mainly on a key value pair of: timestamp (key) and value (byte array). The bite array doesn't really have a class to deserialize from, since the Avro Record we have comes from a "SELECT * FROM..." that selects several SQL ta