Getting UnsupportedException in Kyro for proto maps

Hi, I have a proto which has a map field in it. When i try to use it in Flink using Kyro serializer, im getting following error when pushing the output to Kafka Caused by: java.lang.UnsupportedOperationException at java.util.Collections$UnmodifiableCollection.add(Collections.java:1057) at com.eso

Rocksdb state directory path in EMR

Hi, I have enabled rocksdb(State store) with s3 (external checkpoint) on EMR . I am using rocksdb as state store with ValueState and checkpoints are stored in s3. I am able to see checkpoints in s3 and functionality with respect to state store is working fine. But i am trying to dissect rocksdb

Getting Window information from coGroup functin

Hi, I have a usecase where i want to join two streams. I am using coGroup for this KeyBuilder leftKey = new KeyBuilder(jobConfiguration.getConnectStream().getLeftKey()); KeyBuilder rightKey = new KeyBuilder(jobConfiguration.getConnectStream().getRightKey()); leftSource.coGroup(rightSource).where(

Re: Question on stream joins

rectly, and > in join function, the framework will iterate the elements for you and you > can only specify the logic for each (left, right) pair. > > Best, > Yun > > --Original Mail -- > *Sender:*Sudan S > *Send Date:*Fri May 29 01:40:59

Question on stream joins

Hi , I have two usecases 1. I have two streams which `leftSource` and `rightSource` which i want to join without partitioning over a window and find the difference of count of elements of leftSource and rightSource and emit the result of difference. Which is the appropriate join function ican use

Problem getting watermark right with event time

Hi, I am having a problem getting watermark right. The setup is - I have a Flink Job which reads from a Kafka topic, uses Protobuf Deserialization, uses Sliding Window of (120seconds, 30 seconds), sums up the value and finally returns the result. The code is pasted below. The problem here is, I'