Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

Hi Lincoln, I did a bit of analysis on small PoC. Please find my comments below: - In general, current design supports streaming workloads. However, as you mentioned it comes with some (implementation-related) difficulties. One of them (as you also mentioned) is that most of the operators utilize

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

Hi Leonard, I did a bit of analysis on possible integration of this FLIP with Kafka source. Please find the sample code and explanations below: public class KafkaDynamicSource implements ScanTableSource, SupportsReadingMetadata, SupportsWatermarkPushDown, SupportsPartitioning { // other

[DISCUSS] FLIP-438: Amazon SQS Sink Connector

Hi Dev, I would like to start a discussion about FLIP-438: Amazon SQS Sink Connector. This FLIP is proposing to add support for AWS SQS sink in flink-connector-aws repo. For more details, see FLIP-438. Loo

[jira] [Created] (FLINK-35021) AggregateQueryOperations produces wrong asSerializableString representation

Dawid Wysakowicz created FLINK-35021: Summary: AggregateQueryOperations produces wrong asSerializableString representation Key: FLINK-35021 URL: https://issues.apache.org/jira/browse/FLINK-35021 P