[jira] [Created] (FLINK-26175) Make local cleanup being called in global cleanup situations

2022-02-15 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26175: - Summary: Make local cleanup being called in global cleanup situations Key: FLINK-26175 URL: https://issues.apache.org/jira/browse/FLINK-26175 Project: Flink

[jira] [Created] (FLINK-26174) KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation

2022-02-15 Thread Yun Gao (Jira)
Yun Gao created FLINK-26174: --- Summary: KinesisDataStreamsSink.restoreWriter failed due to Architecture Violation Key: FLINK-26174 URL: https://issues.apache.org/jira/browse/FLINK-26174 Project: Flink

[jira] [Created] (FLINK-26173) Sink GlobalCommitter's behavior is not compatible

2022-02-15 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-26173: Summary: Sink GlobalCommitter's behavior is not compatible Key: FLINK-26173 URL: https://issues.apache.org/jira/browse/FLINK-26173 Project: Flink Issue Type:

[jira] [Created] (FLINK-26172) some sql in `Table API&Sql` has syntax error

2022-02-15 Thread backspace (Jira)
backspace created FLINK-26172: - Summary: some sql in `Table API&Sql` has syntax error Key: FLINK-26172 URL: https://issues.apache.org/jira/browse/FLINK-26172 Project: Flink Issue Type: Improvemen

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Yang Wang
Thanks for the explanation. Given that it is unrelated with java version in Flink. Starting with java11 for the flink-kubernetes-operator makes sense to me. Best, Yang Thomas Weise 于2022年2月15日周二 23:57写道: > Hi, > > At this point I see no reason to support Java 8 for a new project. > Java 8 is b

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread K Fred
Hi Gyula! Alright! For clarity, the savepoint path and other savepoint related configuration can be put into flinkConfiguration. On the side, I think the automatic savepoint generation for instance should be put into JobSpec along with other job options, and FlinkConfiguration only configures what

[jira] [Created] (FLINK-26171) pyFlink -py options has issue with path that starts with //

2022-02-15 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-26171: -- Summary: pyFlink -py options has issue with path that starts with // Key: FLINK-26171 URL: https://issues.apache.org/jira/browse/FLINK-26171 Project: Flink Issu

[jira] [Created] (FLINK-26170) checkpoint time it too long

2022-02-15 Thread zhangqw152 (Jira)
zhangqw152 created FLINK-26170: -- Summary: checkpoint time it too long Key: FLINK-26170 URL: https://issues.apache.org/jira/browse/FLINK-26170 Project: Flink Issue Type: Bug Reporte

[jira] [Created] (FLINK-26169) There is a typo in the annotation for the WatermarkAlignmentParams class

2022-02-15 Thread Echo Lee (Jira)
Echo Lee created FLINK-26169: Summary: There is a typo in the annotation for the WatermarkAlignmentParams class Key: FLINK-26169 URL: https://issues.apache.org/jira/browse/FLINK-26169 Project: Flink

[jira] [Created] (FLINK-26168) The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner

2022-02-15 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-26168: -- Summary: The judgment of chainable ignores StreamExchangeMode when partitioner is ForwardForConsecutiveHashPartitioner Key: FLINK-26168 URL: https://issues.apache.org/jira/browse/FLIN

[jira] [Created] (FLINK-26167) Explicitly set the partitioner for the sql operators whose shuffle and sort are removed

2022-02-15 Thread godfrey he (Jira)
godfrey he created FLINK-26167: -- Summary: Explicitly set the partitioner for the sql operators whose shuffle and sort are removed Key: FLINK-26167 URL: https://issues.apache.org/jira/browse/FLINK-26167 P

[jira] [Created] (FLINK-26166) flink-runtime-web fails to compile if newline is cr lf

2022-02-15 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-26166: - Summary: flink-runtime-web fails to compile if newline is cr lf Key: FLINK-26166 URL: https://issues.apache.org/jira/browse/FLINK-26166 Project: Flink Issu

[jira] [Created] (FLINK-26165) SavepointFormatITCase fails on azure

2022-02-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26165: - Summary: SavepointFormatITCase fails on azure Key: FLINK-26165 URL: https://issues.apache.org/jira/browse/FLINK-26165 Project: Flink Issue Type: Bu

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Thomas Weise
Hi, At this point I see no reason to support Java 8 for a new project. Java 8 is being phased out, we should start with 11. Also, since the operator isn't a library but effectively just a docker image, the ability to change the Java version isn't as critical as it is for Flink core, which needs t

Re: [VOTE] Release 1.13.6, release candidate #1

2022-02-15 Thread Anton Kalashnikov
+1 (non-binding) - signatures OK - checksums OK - tag OK - all artifacts OK - PR OK run examples -- Best regards, Anton Kalashnikov 15.02.2022 09:30, Dawid Wysakowicz пишет: +1 (binding) - signatures OK - checksums OK - tag OK - PR looks good - built from sources - run example - checke

[jira] [Created] (FLINK-26164) Document watermark alignment

2022-02-15 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-26164: Summary: Document watermark alignment Key: FLINK-26164 URL: https://issues.apache.org/jira/browse/FLINK-26164 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Márton Balassi
Good catch, Yang Wang and Gyula on the Java version. I personally prefer that we simply can not support Java 8 for the operator, since it is a net new project we are better off starting support at Java 11 right away. As Gyula outlined above, it is important to note that it only affects the operato

[jira] [Created] (FLINK-26163) Refactor FlinkUtils#getEffectiveConfig into smaller pieces

2022-02-15 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26163: -- Summary: Refactor FlinkUtils#getEffectiveConfig into smaller pieces Key: FLINK-26163 URL: https://issues.apache.org/jira/browse/FLINK-26163 Project: Flink Issue

[jira] [Created] (FLINK-26162) Revamp security section of the documentation

2022-02-15 Thread Daisy Tsang (Jira)
Daisy Tsang created FLINK-26162: --- Summary: Revamp security section of the documentation Key: FLINK-26162 URL: https://issues.apache.org/jira/browse/FLINK-26162 Project: Flink Issue Type: Improv

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Gyula Fóra
Hi Devs, Yang Wang discovered that the current prototype is not compatible with Java 8 but only 11 and upwards. The reason for this is that the java operator SDK itself is not java 8 compatible unfortunately. Given that Java 8 is on the road to deprecation and that the operator runs as a contain

[jira] [Created] (FLINK-26161) Pulsar Connector: edge case: splits should be added to finishedSplits if was empty from beginning

2022-02-15 Thread Yufei Zhang (Jira)
Yufei Zhang created FLINK-26161: --- Summary: Pulsar Connector: edge case: splits should be added to finishedSplits if was empty from beginning Key: FLINK-26161 URL: https://issues.apache.org/jira/browse/FLINK-26161

[jira] [Created] (FLINK-26160) Pulsar Connector: stopCursor description should be changed. Connector only stop when auto discovery is disabled.

2022-02-15 Thread Yufei Zhang (Jira)
Yufei Zhang created FLINK-26160: --- Summary: Pulsar Connector: stopCursor description should be changed. Connector only stop when auto discovery is disabled. Key: FLINK-26160 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-26159) Pulsar Connector: should add description MAX_FETCH_RECORD in doc to explain slow consumption

2022-02-15 Thread Yufei Zhang (Jira)
Yufei Zhang created FLINK-26159: --- Summary: Pulsar Connector: should add description MAX_FETCH_RECORD in doc to explain slow consumption Key: FLINK-26159 URL: https://issues.apache.org/jira/browse/FLINK-26159

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Yang Wang
I also lean to not introduce the savepoint/checkpoint related fields to the job spec, especially in the very beginning of flink-kubernetes-operator. Best, Yang Gyula Fóra 于2022年2月15日周二 19:02写道: > Hi Peng Yuan! > > While I do agree that savepoint path is a very important production > configurat

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Gyula Fóra
Hi Peng Yuan! While I do agree that savepoint path is a very important production configuration there are a lot of other things that come to my mind: - savepoint dir - checkpoint dir - checkpoint interval/timeout - high availability settings (provider/storagedir etc) just to name a few... Wh

[jira] [Created] (FLINK-26158) Update statefun-playground examples to use playground ingress/egress

2022-02-15 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-26158: - Summary: Update statefun-playground examples to use playground ingress/egress Key: FLINK-26158 URL: https://issues.apache.org/jira/browse/FLINK-26158 Project: Flink

[jira] [Created] (FLINK-26157) Containers Should Not Run As Root

2022-02-15 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-26157: - Summary: Containers Should Not Run As Root Key: FLINK-26157 URL: https://issues.apache.org/jira/browse/FLINK-26157 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26156) Event Time Temporal Join Watermark lag

2022-02-15 Thread tao.yang03 (Jira)
tao.yang03 created FLINK-26156: -- Summary: Event Time Temporal Join Watermark lag Key: FLINK-26156 URL: https://issues.apache.org/jira/browse/FLINK-26156 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26155) Add playground ingress/egress for cURL interaction

2022-02-15 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-26155: - Summary: Add playground ingress/egress for cURL interaction Key: FLINK-26155 URL: https://issues.apache.org/jira/browse/FLINK-26155 Project: Flink Issue Ty

[jira] [Created] (FLINK-26154) SavepointFormatITCase fails on azure

2022-02-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26154: - Summary: SavepointFormatITCase fails on azure Key: FLINK-26154 URL: https://issues.apache.org/jira/browse/FLINK-26154 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-26153) Add script to update README playground links for Statefun

2022-02-15 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-26153: - Summary: Add script to update README playground links for Statefun Key: FLINK-26153 URL: https://issues.apache.org/jira/browse/FLINK-26153 Project: Flink I

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread K Fred
Hi Matyas! Thanks for your reply! For 1. and 3. scenarios,I couldn't agree more with the podTemplate solution , i missed this part. For savepoint related configuration, I think it's very important to be specified in JobSpec, Because savepoint is a very common configuration for upgrading a job, if

[jira] [Created] (FLINK-26152) Translate the page of SQL/queries/WITH clause

2022-02-15 Thread wenyibo (Jira)
wenyibo created FLINK-26152: --- Summary: Translate the page of SQL/queries/WITH clause Key: FLINK-26152 URL: https://issues.apache.org/jira/browse/FLINK-26152 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26151) inprogressfileRecoverable not be clean up after restoring the bucket

2022-02-15 Thread WangXiaoyong (Jira)
WangXiaoyong created FLINK-26151: Summary: inprogressfileRecoverable not be clean up after restoring the bucket Key: FLINK-26151 URL: https://issues.apache.org/jira/browse/FLINK-26151 Project: Flink

[jira] [Created] (FLINK-26150) [pulsar] enable requestTimeoutMs configuration

2022-02-15 Thread Aiden Gong (Jira)
Aiden Gong created FLINK-26150: -- Summary: [pulsar] enable requestTimeoutMs configuration Key: FLINK-26150 URL: https://issues.apache.org/jira/browse/FLINK-26150 Project: Flink Issue Type: Improv

[jira] [Created] (FLINK-26149) Build ArchUnit rule for connector reference implementation after connector has been moved to the external repo

2022-02-15 Thread Jing Ge (Jira)
Jing Ge created FLINK-26149: --- Summary: Build ArchUnit rule for connector reference implementation after connector has been moved to the external repo Key: FLINK-26149 URL: https://issues.apache.org/jira/browse/FLINK-26

[jira] [Created] (FLINK-26148) Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX"

2022-02-15 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-26148: -- Summary: Change the format of adaptive batch scheduler config option to "jobmanager.adaptive-batch-scheduler.XXX" Key: FLINK-26148 URL: https://issues.apache.org/jira/browse/FLINK-261

[jira] [Created] (FLINK-26145) k8s docs jobmanager-pod-template artifacts-fetcher:latest image is not exist, we can use busybox to replace it

2022-02-15 Thread jackylau (Jira)
jackylau created FLINK-26145: Summary: k8s docs jobmanager-pod-template artifacts-fetcher:latest image is not exist, we can use busybox to replace it Key: FLINK-26145 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-26147) Deleting incremental savepoints directory in CLAIM mode

2022-02-15 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26147: -- Summary: Deleting incremental savepoints directory in CLAIM mode Key: FLINK-26147 URL: https://issues.apache.org/jira/browse/FLINK-26147 Project: Flink I

[jira] [Created] (FLINK-26146) Add test coverage for native format flink upgrades (minor versions)

2022-02-15 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26146: -- Summary: Add test coverage for native format flink upgrades (minor versions) Key: FLINK-26146 URL: https://issues.apache.org/jira/browse/FLINK-26146 Project: Flin

[jira] [Created] (FLINK-26144) SavepointFormatITCase did NOT fail with changelog.enabled randomized

2022-02-15 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26144: - Summary: SavepointFormatITCase did NOT fail with changelog.enabled randomized Key: FLINK-26144 URL: https://issues.apache.org/jira/browse/FLINK-26144 Proje

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-15 Thread Őrhidi Mátyás
Hi Peng, Thanks for your feedback. Regarding 1. and 3. scenarios, the podTemplate functionality in the operator could cover both. We also need to be careful about introducing proxy parameters in the CRD spec. The savepoint path is usually accompanied with a bunch of other configurations for exampl

Re: [VOTE] Release 1.13.6, release candidate #1

2022-02-15 Thread Dawid Wysakowicz
+1 (binding) - signatures OK - checksums OK - tag OK - PR looks good - built from sources - run example - checked dependency version changes from 1.13.5 and notice files Best, Dawid On 05/02/2022 21:06, Konstantin Knauf wrote: Hi everyone, Please review and vote on the release candidate