Re: Flink SQL as DSL for flink CEP

2021-07-10 Thread Dipanjan Mazumder
Thanks a lot Jing .  On Wednesday, June 16, 2021, 05:12:01 PM GMT+5:30, JING ZHANG wrote: Hi Dipanjan,I'm not an expert on Flink CEP, however I would like to share my immature ideas, hope it helps.Flink provides CEP library[1] which is a programmatic library which allows user defi

ValueState is null; checkpointing issues

2021-07-10 Thread Marzi K
Hi All, I have a simple POC project to understand Flink state management and integration with Kafka. Thanks in advance for helping me understand and resolve the following issues. I have a FlinkKafkaConsumer that reads payloads from a separate FlinkKafkaProducer. The final 3 operators in my pi

Re: Savepoints with bootstraping a datastream function

2021-07-10 Thread Rakshit Ramesh
Hi Arvid, Since I'm trying to save checkpoints for a bounded process the checkpoint isn't being written on time since the job finishes before that can happen. Looks like one major feature that would be required for this to work is discussed in FLIP-147 https://cwiki.apache.org/confluence/display/F

Re: Subpar performance of temporal joins with RocksDB backend

2021-07-10 Thread Maciej Bryński
Could you please set 2 configuration options: - state.backend.rocksdb.predefined-options = SPINNING_DISK_OPTIMIZED_HIGH_MEM - state.backend.rocksdb.memory.partitioned-index-filters = true Regards, Maciek sob., 10 lip 2021 o 08:54 Adrian Bednarz napisał(a): > > I didn’t tweak any RocksDB knobs. T