Re: Unaligned checkpoint blocked by long Async operation

Posting this to dev as well... Thanks Zakelly, Sounds like a solution could be to add a new different version of yield that would actually yield to the checkpoint barrier too. That way operator implementations could decide whether any state modification may or may not have happened and can optiona

[jira] [Created] (FLINK-34692) Update Flink website to point to the new Flink CDC “Get Started” page

Qingsheng Ren created FLINK-34692: - Summary: Update Flink website to point to the new Flink CDC “Get Started” page Key: FLINK-34692 URL: https://issues.apache.org/jira/browse/FLINK-34692 Project: Fli

Chained rebalance() guarantees

Hi, while implementing new transform for Apache Beam, we hit some questions about what guarantees a DataSet#rebalance() method has in terms of chaining. According to [1] there was some suboptimality if execution of chained rebalance with intermediate mapping operation. As a result the impleme

[jira] [Created] (FLINK-34693) Memory leak in KafkaWriter

Stefan Richter created FLINK-34693: -- Summary: Memory leak in KafkaWriter Key: FLINK-34693 URL: https://issues.apache.org/jira/browse/FLINK-34693 Project: Flink Issue Type: Bug Comp

[jira] [Created] (FLINK-34694) Delete num of associations for streaming outer join

Roman Boyko created FLINK-34694: --- Summary: Delete num of associations for streaming outer join Key: FLINK-34694 URL: https://issues.apache.org/jira/browse/FLINK-34694 Project: Flink Issue Type:

[jira] [Created] (FLINK-34695) Move Flink's CI docker container into a public repo

Matthias Pohl created FLINK-34695: - Summary: Move Flink's CI docker container into a public repo Key: FLINK-34695 URL: https://issues.apache.org/jira/browse/FLINK-34695 Project: Flink Issue T

[jira] [Created] (FLINK-34696) GSRecoverableWriterCommitter is generating excessive data blobs

Simon-Shlomo Poil created FLINK-34696: - Summary: GSRecoverableWriterCommitter is generating excessive data blobs Key: FLINK-34696 URL: https://issues.apache.org/jira/browse/FLINK-34696 Project: Fl

Re: [jira] [Created] (FLINK-34696) GSRecoverableWriterCommitter is generating excessive data blobs

Yes, the issue is recoverability. However, there is one thing you can do. Create a separate bucket in GCP for temporary files and initialize the filesystem configuration (via FileSystem.initialize) with *gs.writer.temporary.bucket.name * set to the name of th

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

Hi Benchao, Thanks for your comments. 1. What the parallelism would you take? E.g., 128 + 256 => 128? What > if we cannot have a good greatest common divisor, like 127 + 128, > could we just utilize one side's pre-partitioned attribute, and let > another side just do the shuffle? There are two

[jira] [Created] (FLINK-34697) Finalize release 1.19.0

lincoln lee created FLINK-34697: --- Summary: Finalize release 1.19.0 Key: FLINK-34697 URL: https://issues.apache.org/jira/browse/FLINK-34697 Project: Flink Issue Type: New Feature Rep

[jira] [Created] (FLINK-34700) CLONE - Create Git tag and mark version as released in Jira

lincoln lee created FLINK-34700: --- Summary: CLONE - Create Git tag and mark version as released in Jira Key: FLINK-34700 URL: https://issues.apache.org/jira/browse/FLINK-34700 Project: Flink Is

[jira] [Created] (FLINK-34699) CLONE - Deploy artifacts to Maven Central Repository

lincoln lee created FLINK-34699: --- Summary: CLONE - Deploy artifacts to Maven Central Repository Key: FLINK-34699 URL: https://issues.apache.org/jira/browse/FLINK-34699 Project: Flink Issue Type

[jira] [Created] (FLINK-34701) CLONE - Publish the Dockerfiles for the new release

lincoln lee created FLINK-34701: --- Summary: CLONE - Publish the Dockerfiles for the new release Key: FLINK-34701 URL: https://issues.apache.org/jira/browse/FLINK-34701 Project: Flink Issue Type:

[jira] [Created] (FLINK-34698) CLONE - Deploy Python artifacts to PyPI

lincoln lee created FLINK-34698: --- Summary: CLONE - Deploy Python artifacts to PyPI Key: FLINK-34698 URL: https://issues.apache.org/jira/browse/FLINK-34698 Project: Flink Issue Type: Sub-task