Re: [DISCUSS] Releasing Flink 1.14.1

Hi Martijn, Thanks for bringing up this topic. I think it would be great to release a patch version of 1.14 before the end of the year. Currently, FLINK-24596 is in progress and I would block the release until it is merged because it unblocks se

RocksDBMapState get the binary key bytes

Hi devs: Using RocksDB, when key and namespace both have variable binary length, to prevent [key, namespace] have equal binary number, we add key length and namespace length after key and namespace respectively. Then the format is: Keygroup – key -keyLength– namespace-namespaceLenth

[jira] [Created] (FLINK-25050) Translate "Metrics" page of "Operations" into Chinese

ZhiJie Yang created FLINK-25050: --- Summary: Translate "Metrics" page of "Operations" into Chinese Key: FLINK-25050 URL: https://issues.apache.org/jira/browse/FLINK-25050 Project: Flink Issue Typ

[jira] [Created] (FLINK-25049) sql-client.sh execute batch job in async mode failed with java.io.FileNotFoundException

macdoor615 created FLINK-25049: -- Summary: sql-client.sh execute batch job in async mode failed with java.io.FileNotFoundException Key: FLINK-25049 URL: https://issues.apache.org/jira/browse/FLINK-25049 P

Re: [DISCUSS] Releasing Flink 1.14.1

Hi Martijn, I moved the fix version of "FLINK-21788 - Throw PartitionNotFoundException if the partition file has been lost for blocking shuffle" to 1.15.0 Best, Yingjie Martijn Visser 于2021年11月25日周四 上午2:40写道： > Hi all, > > I would like to sta

[DISCUSS] Releasing Flink 1.14.1

Hi all, I would like to start a discussion on releasing Flink 1.14.1. Flink 1.14 was released on the 29th of September [1] and so far 107 issues have been resolved, including multiple blockers and critical priorities [2]. There are currently 169 open tickets which contain a fixVersion for 1.14.1

Re: [VOTE] FLIP-188 Introduce Built-in Dynamic Table Storage

Thanks for all the details and explanation. With the conclusion of the discussion, also +1 from my side for this FLIP On Sat, Nov 13, 2021 at 12:23 PM Jingsong Li wrote: > Thanks Stephan and Timo, I have a rough look at your replies. They are > all valuable opinions. I will take time to discuss

[jira] [Created] (FLINK-25048) 在某个option后设置watermark，如果这个option里面有 outputTag，则此outputTag 不会有数据输出，只会在主流输出数据

xinli liang created FLINK-25048: --- Summary: 在某个option后设置watermark，如果这个option里面有 outputTag，则此outputTag 不会有数据输出，只会在主流输出数据 Key: FLINK-25048 URL: https://issues.apache.org/jira/browse/FLINK-25048 Project: Fl

[jira] [Created] (FLINK-25047) Resolve most (trivial) architectural violations in flink-table

Ingo Bürk created FLINK-25047: - Summary: Resolve most (trivial) architectural violations in flink-table Key: FLINK-25047 URL: https://issues.apache.org/jira/browse/FLINK-25047 Project: Flink Iss

[jira] [Created] (FLINK-25046) Convert forward edge to rescale when using adapive batch scheduler

Lijie Wang created FLINK-25046: -- Summary: Convert forward edge to rescale when using adapive batch scheduler Key: FLINK-25046 URL: https://issues.apache.org/jira/browse/FLINK-25046 Project: Flink

[jira] [Created] (FLINK-25045) Introduce AdaptiveBatchScheduler

Lijie Wang created FLINK-25045: -- Summary: Introduce AdaptiveBatchScheduler Key: FLINK-25045 URL: https://issues.apache.org/jira/browse/FLINK-25045 Project: Flink Issue Type: Sub-task C

[jira] [Created] (FLINK-25044) Add More Unit Test For Pulsar Source

Yufei Zhang created FLINK-25044: --- Summary: Add More Unit Test For Pulsar Source Key: FLINK-25044 URL: https://issues.apache.org/jira/browse/FLINK-25044 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

Hi Stephan, Thanks for your reply. Data never expires automatically. If there is a need for data retention, the user can choose one of the following options: - In the SQL for querying the managed table, users filter the data by themselves - Define the time partition, and users can delete the exp

[jira] [Created] (FLINK-25043) Allow calls to public @VisibleForTesting from the same package

Chesnay Schepler created FLINK-25043: Summary: Allow calls to public @VisibleForTesting from the same package Key: FLINK-25043 URL: https://issues.apache.org/jira/browse/FLINK-25043 Project: Flink

[jira] [Created] (FLINK-25042) Allow calls to @VisibleForTesting from inner classes

Chesnay Schepler created FLINK-25042: Summary: Allow calls to @VisibleForTesting from inner classes Key: FLINK-25042 URL: https://issues.apache.org/jira/browse/FLINK-25042 Project: Flink

[jira] [Created] (FLINK-25041) E2E tar ball cache fails without error message if target directory not specified

Fabian Paul created FLINK-25041: --- Summary: E2E tar ball cache fails without error message if target directory not specified Key: FLINK-25041 URL: https://issues.apache.org/jira/browse/FLINK-25041 Projec

[jira] [Created] (FLINK-25040) FlinkKafkaInternalProducerITCase.testInitTransactionId failed on AZP

Till Rohrmann created FLINK-25040: - Summary: FlinkKafkaInternalProducerITCase.testInitTransactionId failed on AZP Key: FLINK-25040 URL: https://issues.apache.org/jira/browse/FLINK-25040 Project: Flink

[jira] [Created] (FLINK-25039) AZP fails with license check

Till Rohrmann created FLINK-25039: - Summary: AZP fails with license check Key: FLINK-25039 URL: https://issues.apache.org/jira/browse/FLINK-25039 Project: Flink Issue Type: Bug Comp

Re: [DISCUSS] Drop Zookeeper 3.4

Thanks for starting this discussion, Chesnay. +1 from my side. It's time to move forward with the ZK support considering the EOL of 3.4 you already mentioned. The benefits we gain from upgrading Curator to 5.x as a consequence is another plus point. Just for reference on the inconsistent state issu

[jira] [Created] (FLINK-25038) Refactor FlinkContainer to split JM and TMs into different containers and supports HA

Qingsheng Ren created FLINK-25038: - Summary: Refactor FlinkContainer to split JM and TMs into different containers and supports HA Key: FLINK-25038 URL: https://issues.apache.org/jira/browse/FLINK-25038

[jira] [Created] (FLINK-25037) Compilation of compile_cron_python_wheels failed on AZP

Till Rohrmann created FLINK-25037: - Summary: Compilation of compile_cron_python_wheels failed on AZP Key: FLINK-25037 URL: https://issues.apache.org/jira/browse/FLINK-25037 Project: Flink Iss

Re: [DISCUSS] Automated architectural tests

Hi everyone, I'm happy to announce now that we finished this test and it has been merged (thanks to Chesnay for his help here). You can also find some documentation for it here[1]. I haven't implemented all of the suggested rules, but we can of course expand our checks here. The current rules show

[DISCUSS] Drop Zookeeper 3.4

Hello, I'd like to drop support for Zookeeper 3.4 in 1.15, upgrading the default to 3.5 with an opt-in for 3.6. Supporting Zookeeper 3.4 (which is already EOL) prevents us from upgrading Curator to 5.x, which would allow us to properly fix an issue with inconsistent state. It is also require

[jira] [Created] (FLINK-25036) Introduce stage-wised scheduling strategy

Lijie Wang created FLINK-25036: -- Summary: Introduce stage-wised scheduling strategy Key: FLINK-25036 URL: https://issues.apache.org/jira/browse/FLINK-25036 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25035) Shuffle Service Supports Consuming Subpartition Range

Lijie Wang created FLINK-25035: -- Summary: Shuffle Service Supports Consuming Subpartition Range Key: FLINK-25035 URL: https://issues.apache.org/jira/browse/FLINK-25035 Project: Flink Issue Type:

[jira] [Created] (FLINK-25034) Support flexible number of subpartitions in IntermediateResultPartition

Lijie Wang created FLINK-25034: -- Summary: Support flexible number of subpartitions in IntermediateResultPartition Key: FLINK-25034 URL: https://issues.apache.org/jira/browse/FLINK-25034 Project: Flink

[jira] [Created] (FLINK-25033) Let some scheduler components updatable.

Lijie Wang created FLINK-25033: -- Summary: Let some scheduler components updatable. Key: FLINK-25033 URL: https://issues.apache.org/jira/browse/FLINK-25033 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25032) Allow to create execution vertices and execution edges lazily

Lijie Wang created FLINK-25032: -- Summary: Allow to create execution vertices and execution edges lazily Key: FLINK-25032 URL: https://issues.apache.org/jira/browse/FLINK-25032 Project: Flink Is

[VOTE][FLIP-195] Improve the name and structure of vertex and operator name for job

+1 (non-binding) On 11/24/2021 15:50，Sergey Nuyanzin wrote： +1 (non-binding) On Wed, Nov 24, 2021 at 8:38 AM godfrey he wrote: +1 (binding) Best, Godfrey Jark Wu 于2021年11月24日周三 下午12:02写道： +1 (binding) Btw, @JingZhang I think your vote can be counted into binding now. Best, Jark On Tue

[jira] [Created] (FLINK-25031) Job finishes iff all job vertices finish

Lijie Wang created FLINK-25031: -- Summary: Job finishes iff all job vertices finish Key: FLINK-25031 URL: https://issues.apache.org/jira/browse/FLINK-25031 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-25030) Unexpected record in KafkaSourceITCase$IntegrationTests.testMultipleSplits

Matthias created FLINK-25030: Summary: Unexpected record in KafkaSourceITCase$IntegrationTests.testMultipleSplits Key: FLINK-25030 URL: https://issues.apache.org/jira/browse/FLINK-25030 Project: Flink

Re: [VOTE][FLIP-195] Improve the name and structure of vertex and operator name for job

+1 (binding) Also, this will further slim down the TaskDeploymentDescriptor. Best, Yangze Guo On Wed, Nov 24, 2021 at 3:57 PM Yun Tang wrote: > > +1 (binding) > > Best > Yun Tang > > On 2021/11/24 07:50:15 Sergey Nuyanzin wrote: > > +1 (non-binding) > > > > On Wed, Nov 24, 2021 at 8:38 AM godfr