Flink checkpointing - exactly once guaranteed understanding

2024-02-09 Thread Kartik Kushwaha
I am using flink checkpointing to restore states of my job. I am using unaligned checkpointing with 100 ms as the checkpointing interval. I see few events getting dropped that were sucessfully processed by the operators or were in-flight that were yet to be captured by checkpoint. That is these wer

Flink connection with AWS OpenSearch Service

2024-02-09 Thread Praveen Chandna via user
Hello As per the Flink OpenSearch connector documentation, it specify how to connect to OpenSearch database. But it doesn't mention anything how to connect with the AWS OpenSearch service. https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/connectors/datastream/opensearch/ Whereas