Re: [ANNOUNCE] Apache Flink 1.1.4.4 released

2022-03-16 Thread Konstantin Knauf
Hi Xingbo, you are totally right. Thank you for noticing. This also affected Flink 1.13.6, the other release I was recently managing. I simply skipped a step in the release guide. It should be fixed now. Could you double-check? Cheers, Konstantin On Wed, Mar 16, 2022 at 4:07 AM Xingbo Huang w

[DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Aitozi
Hi Guys: I would like to open a discussion for support session job management in kubernetes operator. It’s intended to enhance the flink-kubernetes-operator to manage the session job with k8s tooling. I have drafted the design doc[1]. Please refer to it and give me some feedback . [1] https:

[jira] [Created] (FLINK-26673) ChangelogPeriodicMaterializationITCase.testNonMaterialization failed on master

2022-03-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26673: - Summary: ChangelogPeriodicMaterializationITCase.testNonMaterialization failed on master Key: FLINK-26673 URL: https://issues.apache.org/jira/browse/FLINK-26673 Proj

Re: [DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Gyula Fóra
Thank you Aitozi! I think this will be a very nice (and simple) addition to enable these use-cases. I have 2 comments regarding the proposal: 1. I think if we want to support different filesystems to download jars from, we probably need some clever ways to add external operator dependencies (jar

[jira] [Created] (FLINK-26674) flink-tests module exit with code 137

2022-03-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-26674: --- Summary: flink-tests module exit with code 137 Key: FLINK-26674 URL: https://issues.apache.org/jira/browse/FLINK-26674 Project: Flink Issue Type: Bug Compone

[jira] [Created] (FLINK-26675) Parallelized heavy serialization operations in StreamingJobGraphGenerator

2022-03-16 Thread Yangze Guo (Jira)
Yangze Guo created FLINK-26675: -- Summary: Parallelized heavy serialization operations in StreamingJobGraphGenerator Key: FLINK-26675 URL: https://issues.apache.org/jira/browse/FLINK-26675 Project: Flink

Re: [DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Aitozi
Hi Gyula Thanks for your quick response. Regarding the different filesystems dependency, I think we can make it optional and pluggable, and let it choose by user when building their operator image. Users can build their image from the base operator image and add filesystem dependency they want

Re: [DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Yang Wang
# How to download the user jars I agree with Gyula that it will be a burden if we bundle the flink filesystem dependencies in the operator image. Maybe we could have a *ArtifactFetcher* interface in the flink-kubernetes-operator. By default, we provide the local and http implementation, which means

Re: [ANNOUNCE] Apache Flink 1.1.4.4 released

2022-03-16 Thread Xingbo Huang
Hi Konstantin, I have installed the wheel packages of 1.13.6 and 1.14.4 respectively, and tested them through some examples. Thanks a lot for your work. Best, Xingbo Konstantin Knauf 于2022年3月16日周三 15:29写道: > Hi Xingbo, > > you are totally right. Thank you for noticing. This also affected Flink

Re: [DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Aitozi
Hi Yang Wang Thanks for your feedback, Provide the local and http implementation for the first version makes sense to me. +1 for it. Best, Aitozi Yang Wang 于2022年3月16日周三 16:44写道: > # How to download the user jars > I agree with Gyula that it will be a burden if we bundle the flink > filesys

[jira] [Created] (FLINK-26676) Set ClusterIP service type when watching specific namespaces

2022-03-16 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26676: -- Summary: Set ClusterIP service type when watching specific namespaces Key: FLINK-26676 URL: https://issues.apache.org/jira/browse/FLINK-26676 Project: Flink Iss

[jira] [Created] (FLINK-26677) Make flink-connector-base dependency consistent

2022-03-16 Thread Yubin Li (Jira)
Yubin Li created FLINK-26677: Summary: Make flink-connector-base dependency consistent Key: FLINK-26677 URL: https://issues.apache.org/jira/browse/FLINK-26677 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26678) make flink-console.sh script clean

2022-03-16 Thread jackylau (Jira)
jackylau created FLINK-26678: Summary: make flink-console.sh script clean Key: FLINK-26678 URL: https://issues.apache.org/jira/browse/FLINK-26678 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26679) Add FileStore Continuous Reading ITCase

2022-03-16 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-26679: Summary: Add FileStore Continuous Reading ITCase Key: FLINK-26679 URL: https://issues.apache.org/jira/browse/FLINK-26679 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26680) SessionDispatcherLeaderProcess#onAddJobGraph crashes if the job is marked as deleted

2022-03-16 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-26680: Summary: SessionDispatcherLeaderProcess#onAddJobGraph crashes if the job is marked as deleted Key: FLINK-26680 URL: https://issues.apache.org/jira/browse/FLINK-26680

[jira] [Created] (FLINK-26681) Remove possbile semicolon in the end of SQL statemnt in HiveParser

2022-03-16 Thread luoyuxia (Jira)
luoyuxia created FLINK-26681: Summary: Remove possbile semicolon in the end of SQL statemnt in HiveParser Key: FLINK-26681 URL: https://issues.apache.org/jira/browse/FLINK-26681 Project: Flink I

[jira] [Created] (FLINK-26682) Migrate regression check script to python and to main repository

2022-03-16 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-26682: -- Summary: Migrate regression check script to python and to main repository Key: FLINK-26682 URL: https://issues.apache.org/jira/browse/FLINK-26682 Project: Flink

[jira] [Created] (FLINK-26683) Terminate the job anyway if savepoint finished when stop-with-savepoint

2022-03-16 Thread Liu (Jira)
Liu created FLINK-26683: --- Summary: Terminate the job anyway if savepoint finished when stop-with-savepoint Key: FLINK-26683 URL: https://issues.apache.org/jira/browse/FLINK-26683 Project: Flink Issue

[jira] [Created] (FLINK-26684) Build failure in ChangelogPeriodicMaterializationITCase.testFailedMaterialization due to NoSuchFileException

2022-03-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26684: - Summary: Build failure in ChangelogPeriodicMaterializationITCase.testFailedMaterialization due to NoSuchFileException Key: FLINK-26684 URL: https://issues.apache.org/jira/brows

[jira] [Created] (FLINK-26685) Investigate/improve tests stability when using InMemory Changelog implementation

2022-03-16 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-26685: - Summary: Investigate/improve tests stability when using InMemory Changelog implementation Key: FLINK-26685 URL: https://issues.apache.org/jira/browse/FLINK-26685

[jira] [Created] (FLINK-26686) Use a junit temp folder for TestingTaskManagerRuntimeInfo tmpWorkingDirectory

2022-03-16 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-26686: --- Summary: Use a junit temp folder for TestingTaskManagerRuntimeInfo tmpWorkingDirectory Key: FLINK-26686 URL: https://issues.apache.org/jira/browse/FLINK-26686 P

[jira] [Created] (FLINK-26687) Remove NiFi connector

2022-03-16 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-26687: -- Summary: Remove NiFi connector Key: FLINK-26687 URL: https://issues.apache.org/jira/browse/FLINK-26687 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-26688) Remove usages of deprecated TableConfig options

2022-03-16 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-26688: --- Summary: Remove usages of deprecated TableConfig options Key: FLINK-26688 URL: https://issues.apache.org/jira/browse/FLINK-26688 Project: Flink Issue T

[jira] [Created] (FLINK-26689) Replace TableConfig with ReadableConfig where possible

2022-03-16 Thread Marios Trivyzas (Jira)
Marios Trivyzas created FLINK-26689: --- Summary: Replace TableConfig with ReadableConfig where possible Key: FLINK-26689 URL: https://issues.apache.org/jira/browse/FLINK-26689 Project: Flink

[jira] [Created] (FLINK-26690) DefaultJobGraphStore.globalCleanup does not trigger the cleanup when retrying the cleanup after a failover

2022-03-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26690: - Summary: DefaultJobGraphStore.globalCleanup does not trigger the cleanup when retrying the cleanup after a failover Key: FLINK-26690 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-26691) pyflink failed with quite a few connection refused errors

2022-03-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26691: - Summary: pyflink failed with quite a few connection refused errors Key: FLINK-26691 URL: https://issues.apache.org/jira/browse/FLINK-26691 Project: Flink I

Beam College is starting soon!

2022-03-16 Thread Carolina Escobar
[image: Beam College 2022] Beam College 2022 season is coming! Hello! We are so excited to share with you that season 2022 of Beam College *is confirmed with live sessions on May 10th-13th, 2022*. What's new?For this year’s edition we will focus on: - Implem

[jira] [Created] (FLINK-26692) migrate TpcdsTestProgram.java to new source

2022-03-16 Thread zl (Jira)
zl created FLINK-26692: -- Summary: migrate TpcdsTestProgram.java to new source Key: FLINK-26692 URL: https://issues.apache.org/jira/browse/FLINK-26692 Project: Flink Issue Type: Improvement Com

答复: [DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Geng Biao
Thanks Aitozi for the work! I lean to option#2 of using JarRunHeaders with uber job jar as well. As Yang said, the user defined dependencies may be better supported in upstream flink. A follow-up thought: I think we should care the potential influence on user experiences: as the job graph is ge

[jira] [Created] (FLINK-26693) Modify the grammar mistakes in savepoints.md

2022-03-16 Thread Liu (Jira)
Liu created FLINK-26693: --- Summary: Modify the grammar mistakes in savepoints.md Key: FLINK-26693 URL: https://issues.apache.org/jira/browse/FLINK-26693 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Support the session job management in kubernetes operator

2022-03-16 Thread Aitozi
Hi Biao Geng: Thanks for your feedback, I'm +1 to go with option#2. It's a good point that we should improve the error message debugging for the session job, I think it can be a follow up work as an improvement after we support the session job operation. Best, Aitozi. Geng Biao 于2022年3

[jira] [Created] (FLINK-26694) LookupFunction doesn't support multilevel inheritance

2022-03-16 Thread tsianglei (Jira)
tsianglei created FLINK-26694: - Summary: LookupFunction doesn't support multilevel inheritance Key: FLINK-26694 URL: https://issues.apache.org/jira/browse/FLINK-26694 Project: Flink Issue Type: B

[jira] [Created] (FLINK-26695) Fabric8FlinkKubeClient.deleteConfigMap doesn't necessarily fail if the deletion didn't succeed

2022-03-16 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26695: - Summary: Fabric8FlinkKubeClient.deleteConfigMap doesn't necessarily fail if the deletion didn't succeed Key: FLINK-26695 URL: https://issues.apache.org/jira/browse/FLINK-26695