Flink state

2024-07-20 Thread banu priya
Hi All, I have a flink job with RMQ Source, filters, tumbling window(uses processing time fires every 2s), aggregator, RMQ Sink. I am trying to understand about states and checkpoints(enabled incremental rocksdb checkpoints). In local rocks db directory, I have .sst files, log, lock, options fil

SavepointReader: Record size is too large for CollectSinkFunction

2024-07-20 Thread Salva Alcántara
Hi all! I'm trying to debug a job via inspecting its savepoints but I'm getting this error message: ``` Caused by: java.lang.RuntimeException: Record size is too large for CollectSinkFunction. Record size is 9627127 bytes, but max bytes per batch is only 2097152 bytes. Please consider increasing