[jira] [Created] (FLINK-29617) Cost too much time to start SourceCoordinator of hdfsFileSource when start JobMaster

2022-10-13 Thread LI Mingkun (Jira)
LI Mingkun created FLINK-29617: -- Summary: Cost too much time to start SourceCoordinator of hdfsFileSource when start JobMaster Key: FLINK-29617 URL: https://issues.apache.org/jira/browse/FLINK-29617 Proj

[GitHub] [flink] snuyanzin commented on pull request #20850: [FLINK-20873][Table SQl/API] Update to calcite 1.27

2022-10-13 Thread GitBox
snuyanzin commented on PR #20850: URL: https://github.com/apache/flink/pull/20850#issuecomment-1277125751 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [flink] bzhaoopenstack commented on pull request #20636: [FLINK-28831][k8s]Support pluginable decorators mechanism - part 1st

2022-10-13 Thread GitBox
bzhaoopenstack commented on PR #20636: URL: https://github.com/apache/flink/pull/20636#issuecomment-1277132324 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[jira] [Created] (FLINK-29618) YARNSessionFIFOSecuredITCase.testDetachedMode timed out in Azure CI

2022-10-13 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29618: - Summary: YARNSessionFIFOSecuredITCase.testDetachedMode timed out in Azure CI Key: FLINK-29618 URL: https://issues.apache.org/jira/browse/FLINK-29618 Project: Flink

[jira] [Updated] (FLINK-29618) YARNSessionFIFOSecuredITCase.testDetachedMode timed out in Azure CI

2022-10-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-29618: -- Attachment: build-20221012.7.YARNSessionFIFOSecuredITCase.testDetachedMode.log > YARNSessionF

[GitHub] [flink] zoucao opened a new pull request, #21044: [FLINK-26726][bp-1.14][connector][hive]Hive enumerators do not assign splits to unregistered (failed) readers

2022-10-13 Thread GitBox
zoucao opened a new pull request, #21044: URL: https://github.com/apache/flink/pull/21044 backport of https://github.com/apache/flink/pull/19250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [flink-kubernetes-operator] gaborgsomogyi commented on a diff in pull request #394: [FLINK-29394] Add observe Flink job health

2022-10-13 Thread GitBox
gaborgsomogyi commented on code in PR #394: URL: https://github.com/apache/flink-kubernetes-operator/pull/394#discussion_r994249637 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/observer/deployment/ApplicationObserver.java: ## @@ -32,15 +33,21

[GitHub] [flink] flinkbot commented on pull request #21044: [FLINK-26726][bp-1.14][connector][hive]Hive enumerators do not assign splits to unregistered (failed) readers

2022-10-13 Thread GitBox
flinkbot commented on PR #21044: URL: https://github.com/apache/flink/pull/21044#issuecomment-1277146431 ## CI report: * e542f32f3ef1eb1e460c407dedf87b81e70e5091 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-29616) Polish Table Store Pom file to avoid warning.

2022-10-13 Thread Aiden Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiden Gong updated FLINK-29616: --- Priority: Minor (was: Major) > Polish Table Store Pom file to avoid warning. >

[jira] [Created] (FLINK-29619) Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-13 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-29619: - Summary: Remove redundant MeterView updater thread from KubernetesClientMetrics Key: FLINK-29619 URL: https://issues.apache.org/jira/browse/FLINK-29619 Project: Fli

[jira] [Updated] (FLINK-29619) Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-13 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-29619: -- Priority: Minor (was: Major) > Remove redundant MeterView updater thread from KubernetesClien

[jira] [Updated] (FLINK-29619) Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-13 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-29619: -- Affects Version/s: kubernetes-operator-1.2.0 > Remove redundant MeterView updater thread from

[jira] [Updated] (FLINK-29619) Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-13 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-29619: -- Fix Version/s: kubernetes-operator-1.3.0 > Remove redundant MeterView updater thread from Kube

[GitHub] [flink] zoucao commented on pull request #19250: [FLINK-26726][connector][hive]Hive enumerators do not assign splits to unregistered (failed) readers.

2022-10-13 Thread GitBox
zoucao commented on PR #19250: URL: https://github.com/apache/flink/pull/19250#issuecomment-1277154078 @luoyuxia plz help to confirm it. to 1.16 https://github.com/apache/flink/pull/21036 to 1.15 https://github.com/apache/flink/pull/21038 to 1.14 https://github.com/apache/flink/pull/

[GitHub] [flink] xuxiaowei-com-cn closed pull request #21046: fix(sec): upgrade com.google.guava:guava to 30.0-jre

2022-10-13 Thread GitBox
xuxiaowei-com-cn closed pull request #21046: fix(sec): upgrade com.google.guava:guava to 30.0-jre URL: https://github.com/apache/flink/pull/21046 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [flink-kubernetes-operator] gaborgsomogyi commented on a diff in pull request #394: [FLINK-29394] Add observe Flink job health

2022-10-13 Thread GitBox
gaborgsomogyi commented on code in PR #394: URL: https://github.com/apache/flink-kubernetes-operator/pull/394#discussion_r994261269 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/health/ClusterHealthInfo.java: ## @@ -0,0 +1,78 @@ +/* + * License

[GitHub] [flink-kubernetes-operator] gaborgsomogyi commented on a diff in pull request #394: [FLINK-29394] Add observe Flink job health

2022-10-13 Thread GitBox
gaborgsomogyi commented on code in PR #394: URL: https://github.com/apache/flink-kubernetes-operator/pull/394#discussion_r994261269 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/health/ClusterHealthInfo.java: ## @@ -0,0 +1,78 @@ +/* + * License

[GitHub] [flink] xuxiaowei-com-cn closed pull request #21045: fix(sec): upgrade com.google.guava:guava to 30.0-jre

2022-10-13 Thread GitBox
xuxiaowei-com-cn closed pull request #21045: fix(sec): upgrade com.google.guava:guava to 30.0-jre URL: https://github.com/apache/flink/pull/21045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Created] (FLINK-29620) Flink deployment stuck in UPGRADING state when changing configuration

2022-10-13 Thread liad shachoach (Jira)
liad shachoach created FLINK-29620: -- Summary: Flink deployment stuck in UPGRADING state when changing configuration Key: FLINK-29620 URL: https://issues.apache.org/jira/browse/FLINK-29620 Project: Fl

[jira] [Commented] (FLINK-29398) Utilize Rack Awareness in Flink Consumer

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616846#comment-17616846 ] Martijn Visser commented on FLINK-29398: Let me know if any of you needs permiss

[jira] [Commented] (FLINK-29617) Cost too much time to start SourceCoordinator of hdfsFileSource when start JobMaster

2022-10-13 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616855#comment-17616855 ] luoyuxia commented on FLINK-29617: -- [~dangshazi] Thanks for raising it and detail expla

[jira] [Created] (FLINK-29621) Append-only with eventual log.consistency can not work

2022-10-13 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-29621: Summary: Append-only with eventual log.consistency can not work Key: FLINK-29621 URL: https://issues.apache.org/jira/browse/FLINK-29621 Project: Flink Issue

[jira] [Updated] (FLINK-29621) Append-only with eventual log.consistency can not work

2022-10-13 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-29621: - Description: {code:java} "CREATE TABLE T (i INT, j INT) WITH ("

[GitHub] [flink-table-store] JingsongLi opened a new pull request, #318: [FLINK-29621] Append-only with eventual log.consistency can not work

2022-10-13 Thread GitBox
JingsongLi opened a new pull request, #318: URL: https://github.com/apache/flink-table-store/pull/318 ``` "CREATE TABLE T (i INT, j INT) WITH (" + "'log.system'='kafka', " + "'write-mode'='append-

[jira] [Updated] (FLINK-29621) Append-only with eventual log.consistency can not work

2022-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29621: --- Labels: pull-request-available (was: ) > Append-only with eventual log.consistency can not

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-29615: --- Fix Version/s: (was: 1.17.0) > MetricStore does not remove metrics of nonexistent subtas

[jira] [Commented] (FLINK-29613) An error occurred during the running of the Flink pulsar,it shows "We only support normal message id currently."

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616859#comment-17616859 ] Martijn Visser commented on FLINK-29613: I don't think this is a bug, like the e

[jira] [Updated] (FLINK-29613) An error occurred during the running of the Flink pulsar,it shows "We only support normal message id currently."

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-29613: --- Issue Type: New Feature (was: Bug) > An error occurred during the running of the Flink puls

[GitHub] [flink-table-store] JingsongLi commented on pull request #317: [FLINK-29616] Polish Table Store Pom file to avoid warning.

2022-10-13 Thread GitBox
JingsongLi commented on PR #317: URL: https://github.com/apache/flink-table-store/pull/317#issuecomment-1277201106 Thanks @GOODBOY008 Can you show me where the warning is? I can not find it in my ide. -- This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Comment Edited] (FLINK-29613) An error occurred during the running of the Flink pulsar,it shows "We only support normal message id currently."

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616859#comment-17616859 ] Martijn Visser edited comment on FLINK-29613 at 10/13/22 8:04 AM:

[jira] [Assigned] (FLINK-29619) Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-13 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-29619: -- Assignee: Matyas Orhidi > Remove redundant MeterView updater thread from KubernetesClientMetr

[jira] [Commented] (FLINK-29549) Flink sql to add support of using AWS glue as metastore

2022-10-13 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616862#comment-17616862 ] Samrat Deb commented on FLINK-29549: *There are two Use Cases:*   # Using Glue as

[GitHub] [flink-table-store] GOODBOY008 commented on pull request #317: [FLINK-29616] Polish Table Store Pom file to avoid warning.

2022-10-13 Thread GitBox
GOODBOY008 commented on PR #317: URL: https://github.com/apache/flink-table-store/pull/317#issuecomment-1277223111 ![image](https://user-images.githubusercontent.com/13617900/195542194-b15bafa5-70a1-47b9-b7ef-506b825c63b0.png) -- This is an automated message from the Apache Git Servi

[jira] [Commented] (FLINK-29611) Fix flaky tests in CoBroadcastWithNonKeyedOperatorTest

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616866#comment-17616866 ] Martijn Visser commented on FLINK-29611: [~sopan98] Are you encountering this on

[GitHub] [flink] kristoffSC commented on a diff in pull request #21022: [FLINK-29512][streaming] Align the checkpointId of recovered CommittableWithLinages with the CommittableSummary

2022-10-13 Thread GitBox
kristoffSC commented on code in PR #21022: URL: https://github.com/apache/flink/pull/21022#discussion_r994322968 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/operators/sink/committables/CommittableCollectorSerializer.java: ## @@ -161,6 +162,22 @@ publ

[jira] [Created] (FLINK-29622) KerberosDelegationTokenManager fails to load DelegationTokenProvider due to NoClassDefFoundError in various tests

2022-10-13 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-29622: - Summary: KerberosDelegationTokenManager fails to load DelegationTokenProvider due to NoClassDefFoundError in various tests Key: FLINK-29622 URL: https://issues.apache.org/jira/b

[GitHub] [flink] snuyanzin commented on a diff in pull request #20850: [FLINK-20873][Table SQl/API] Update to calcite 1.27

2022-10-13 Thread GitBox
snuyanzin commented on code in PR #20850: URL: https://github.com/apache/flink/pull/20850#discussion_r994327282 ## flink-table/flink-table-planner/src/test/resources/org/apache/flink/table/planner/plan/batch/sql/join/NestedLoopSemiAntiJoinTest.xml: ## @@ -673,8 +673,8 @@ Calc(se

[GitHub] [flink] snuyanzin commented on a diff in pull request #20850: [FLINK-20873][Table SQl/API] Update to calcite 1.27

2022-10-13 Thread GitBox
snuyanzin commented on code in PR #20850: URL: https://github.com/apache/flink/pull/20850#discussion_r994327542 ## flink-table/flink-table-planner/src/test/resources/org/apache/flink/table/planner/plan/rules/logical/subquery/SubQueryAntiJoinTest.xml: ## @@ -1833,8 +1833,8 @@ Log

[jira] [Updated] (FLINK-29622) KerberosDelegationTokenManager fails to load DelegationTokenProvider due to NoClassDefFoundError in various ITCases

2022-10-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-29622: -- Summary: KerberosDelegationTokenManager fails to load DelegationTokenProvider due to NoClassDe

[GitHub] [flink] snuyanzin commented on a diff in pull request #20850: [FLINK-20873][Table SQl/API] Update to calcite 1.27

2022-10-13 Thread GitBox
snuyanzin commented on code in PR #20850: URL: https://github.com/apache/flink/pull/20850#discussion_r994327282 ## flink-table/flink-table-planner/src/test/resources/org/apache/flink/table/planner/plan/batch/sql/join/NestedLoopSemiAntiJoinTest.xml: ## @@ -673,8 +673,8 @@ Calc(se

[jira] [Updated] (FLINK-28982) Start TaskInterrupter when task switch from DEPLOYING to CANCELING

2022-10-13 Thread LI Mingkun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Mingkun updated FLINK-28982: --- Description: Task will start TaskInterrupter only when `ExecutionState` is INITIALIZING or RUNNING

[jira] [Updated] (FLINK-28643) Job archive file contains too much Job json file on Flink HistoryServer

2022-10-13 Thread LI Mingkun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Mingkun updated FLINK-28643: --- Attachment: image-2022-10-13-16-39-25-887.png > Job archive file contains too much Job json file on

[jira] [Updated] (FLINK-28643) Job archive file contains too much Job json file on Flink HistoryServer

2022-10-13 Thread LI Mingkun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Mingkun updated FLINK-28643: --- Attachment: image-2022-10-13-16-39-46-486.png > Job archive file contains too much Job json file on

[jira] [Updated] (FLINK-28643) Job archive file contains too much Job json file on Flink HistoryServer

2022-10-13 Thread LI Mingkun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Mingkun updated FLINK-28643: --- Description: In History Server, 'HistoryServerArchiveFetcher' fetch job archived file,and pass it i

[jira] [Updated] (FLINK-28643) Job archive file contains too much Job json file on Flink HistoryServer

2022-10-13 Thread LI Mingkun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] LI Mingkun updated FLINK-28643: --- Description: In History Server, 'HistoryServerArchiveFetcher' fetch job archived file,and pass it i

[jira] [Commented] (FLINK-29620) Flink deployment stuck in UPGRADING state when changing configuration

2022-10-13 Thread liad shachoach (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616879#comment-17616879 ] liad shachoach commented on FLINK-29620: might be related to FLINK-26345 > Flin

[jira] [Updated] (FLINK-29622) KerberosDelegationTokenManager fails to load DelegationTokenProvider due to NoClassDefFoundError in various ITCases

2022-10-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-29622: -- Description: There are multiple ITCases (e.g. {{EventTimeWindowCheckpointingITCase}}) that pr

[GitHub] [flink] kristoffSC commented on a diff in pull request #21022: [FLINK-29512][streaming] Align the checkpointId of recovered CommittableWithLinages with the CommittableSummary

2022-10-13 Thread GitBox
kristoffSC commented on code in PR #21022: URL: https://github.com/apache/flink/pull/21022#discussion_r994347832 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/runtime/operators/sink/committables/CommittableCollectorSerializerTest.java: ## @@ -107,6 +109,29 @@

[jira] [Commented] (FLINK-28984) FsCheckpointStateOutputStream is not being released normally

2022-10-13 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616886#comment-17616886 ] Yanfei Lei commented on FLINK-28984: Hi [~ChangjiGuo], do you mean the {{FsCheckpoin

[jira] [Commented] (FLINK-28440) EventTimeWindowCheckpointingITCase.testSlidingTimeWindow failed with restore

2022-10-13 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616887#comment-17616887 ] Matthias Pohl commented on FLINK-28440: --- https://dev.azure.com/apache-flink/apache

[jira] [Commented] (FLINK-25343) HBaseConnectorITCase.testTableSourceSinkWithDDL fail on azure

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616890#comment-17616890 ] Martijn Visser commented on FLINK-25343: [~ferenc-csaky] I don't think that vali

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanghao Chen updated FLINK-29615: -- Description: *Problem* MetricStore does not remove metrics of nonexistent subtasks when adapt

[jira] [Comment Edited] (FLINK-29617) Cost too much time to start SourceCoordinator of hdfsFileSource when start JobMaster

2022-10-13 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616855#comment-17616855 ] luoyuxia edited comment on FLINK-29617 at 10/13/22 9:06 AM:

[jira] [Created] (FLINK-29623) Bump Prometheus Java Client to 0.16.0

2022-10-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29623: -- Summary: Bump Prometheus Java Client to 0.16.0 Key: FLINK-29623 URL: https://issues.apache.org/jira/browse/FLINK-29623 Project: Flink Issue Type: Technic

[jira] [Comment Edited] (FLINK-29617) Cost too much time to start SourceCoordinator of hdfsFileSource when start JobMaster

2022-10-13 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616855#comment-17616855 ] luoyuxia edited comment on FLINK-29617 at 10/13/22 9:07 AM:

[GitHub] [flink] MartijnVisser opened a new pull request, #21047: [FLINK-29623][Metrics][Prometheus] Update Prometheus Java Client to 0.16.0

2022-10-13 Thread GitBox
MartijnVisser opened a new pull request, #21047: URL: https://github.com/apache/flink/pull/21047 ## What is the purpose of the change * Flink uses an old and no longer supported version of io.prometheus:simpleclient. We should upgrade to the latest version ## Brief change log

[jira] [Updated] (FLINK-29623) Bump Prometheus Java Client to 0.16.0

2022-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29623: --- Labels: pull-request-available (was: ) > Bump Prometheus Java Client to 0.16.0 > --

[jira] [Created] (FLINK-29624) Upgrade org.apache.commons:commons-lang3 from 3.3.2 to 3.12.0

2022-10-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29624: -- Summary: Upgrade org.apache.commons:commons-lang3 from 3.3.2 to 3.12.0 Key: FLINK-29624 URL: https://issues.apache.org/jira/browse/FLINK-29624 Project: Flink

[GitHub] [flink] MartijnVisser opened a new pull request, #21048: [FLINK-29624][Common][Connector][Filesystem] Upgrade commons-lang3 to 3.12.0

2022-10-13 Thread GitBox
MartijnVisser opened a new pull request, #21048: URL: https://github.com/apache/flink/pull/21048 ## What is the purpose of the change * Upgrade org.apache.commons:commons-lang3 from 3.3.2 to 3.12.0 to avoid being falsely flagged for CVEs CVE-2021-29425 and CVE-2020-15250 ## Bri

[jira] [Updated] (FLINK-29624) Upgrade org.apache.commons:commons-lang3 from 3.3.2 to 3.12.0

2022-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29624: --- Labels: pull-request-available (was: ) > Upgrade org.apache.commons:commons-lang3 from 3.3.

[GitHub] [flink] flinkbot commented on pull request #21047: [FLINK-29623][Metrics][Prometheus] Update Prometheus Java Client to 0.16.0

2022-10-13 Thread GitBox
flinkbot commented on PR #21047: URL: https://github.com/apache/flink/pull/21047#issuecomment-1277296241 ## CI report: * 501fef3138ba445d1e16af0e6e94bb0dfdee8b81 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-29625) Optimize changelog normalize

2022-10-13 Thread Jiabao Sun (Jira)
Jiabao Sun created FLINK-29625: -- Summary: Optimize changelog normalize Key: FLINK-29625 URL: https://issues.apache.org/jira/browse/FLINK-29625 Project: Flink Issue Type: Improvement Co

[GitHub] [flink] flinkbot commented on pull request #21048: [FLINK-29624][Common][Connector][Filesystem] Upgrade commons-lang3 to 3.12.0

2022-10-13 Thread GitBox
flinkbot commented on PR #21048: URL: https://github.com/apache/flink/pull/21048#issuecomment-1277303075 ## CI report: * 7ce8f51bbfe58ad4831a51b2af04ff1f45535929 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-29626) Update Akka to 2.6.20

2022-10-13 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-29626: -- Summary: Update Akka to 2.6.20 Key: FLINK-29626 URL: https://issues.apache.org/jira/browse/FLINK-29626 Project: Flink Issue Type: Technical Debt

[GitHub] [flink] MartijnVisser opened a new pull request, #21049: [FLINK-29626][Runtime] Update Akka to 2.6.20

2022-10-13 Thread GitBox
MartijnVisser opened a new pull request, #21049: URL: https://github.com/apache/flink/pull/21049 ## What is the purpose of the change * Update Akka to the latest 2.6 patch version, which is still under Apache license ## Brief change log * Updated POM and NOTICE files

[jira] [Updated] (FLINK-29626) Update Akka to 2.6.20

2022-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29626: --- Labels: pull-request-available (was: ) > Update Akka to 2.6.20 > - > >

[GitHub] [flink] fredia opened a new pull request, #21050: [FLINK-29095][state] Improve logging in SharedStateRegistry

2022-10-13 Thread GitBox
fredia opened a new pull request, #21050: URL: https://github.com/apache/flink/pull/21050 ## What is the purpose of the change Improve logging in SharedStateRegistry and make the conditional logic more clear. This PR is copied from https://github.com/apache/flink/pull/207

[GitHub] [flink] flinkbot commented on pull request #21049: [FLINK-29626][Runtime] Update Akka to 2.6.20

2022-10-13 Thread GitBox
flinkbot commented on PR #21049: URL: https://github.com/apache/flink/pull/21049#issuecomment-1277311447 ## CI report: * 862f866ab2dca08ecf92a4c90f4fddc884bf4327 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-29625) Optimize changelog normalize

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616911#comment-17616911 ] Martijn Visser commented on FLINK-29625: The ChangelogNormalize operator is need

[GitHub] [flink] flinkbot commented on pull request #21050: [FLINK-29095][state] Improve logging in SharedStateRegistry

2022-10-13 Thread GitBox
flinkbot commented on PR #21050: URL: https://github.com/apache/flink/pull/21050#issuecomment-1277322015 ## CI report: * df50f2a707fe85d3f96a9b7cb0324092fcb2917e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] X-czh opened a new pull request, #21051: [FLINK-29615] Retain active subtasks in TaskMetricStore when fetching metrics to accommodate dynamic scaling

2022-10-13 Thread GitBox
X-czh opened a new pull request, #21051: URL: https://github.com/apache/flink/pull/21051 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on e

[jira] [Updated] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29615: --- Labels: pull-request-available (was: ) > MetricStore does not remove metrics of nonexistent

[GitHub] [flink] luoyuxia commented on pull request #21026: [FLINK-29590][hive] fix literal issue in Hive dialect

2022-10-13 Thread GitBox
luoyuxia commented on PR #21026: URL: https://github.com/apache/flink/pull/21026#issuecomment-1277356823 @wuchong Could you please help merge? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [flink] zentol commented on pull request #20955: [FLINK-29502][Filesystem][S3] Update the Hadoop implementation for filesystems to 3.3.4

2022-10-13 Thread GitBox
zentol commented on PR #20955: URL: https://github.com/apache/flink/pull/20955#issuecomment-1277361972 Can you clean up the commits to have 1 with the version bump + exclusions and 1 with the NOTICE sorting? -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [flink] flinkbot commented on pull request #21051: [FLINK-29615] Retain active subtasks in TaskMetricStore when fetching metrics to accommodate dynamic scaling

2022-10-13 Thread GitBox
flinkbot commented on PR #21051: URL: https://github.com/apache/flink/pull/21051#issuecomment-1277367622 ## CI report: * 88a4b0369f9bba4948d7bbe687b1ac748b7aa3dc UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-29627) Sink - Duplicate key exception during recover more than 1 committable.

2022-10-13 Thread Krzysztof Chmielewski (Jira)
Krzysztof Chmielewski created FLINK-29627: - Summary: Sink - Duplicate key exception during recover more than 1 committable. Key: FLINK-29627 URL: https://issues.apache.org/jira/browse/FLINK-29627

[GitHub] [flink] X-czh commented on pull request #21051: [FLINK-29615] Retain active subtasks in TaskMetricStore when fetching metrics to accommodate dynamic scaling

2022-10-13 Thread GitBox
X-czh commented on PR #21051: URL: https://github.com/apache/flink/pull/21051#issuecomment-1277374725 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (FLINK-29625) Optimize changelog normalize

2022-10-13 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616923#comment-17616923 ] Jiabao Sun commented on FLINK-29625: Thanks [~martijnvisser]  for the reply. At pre

[jira] [Commented] (FLINK-29615) MetricStore does not remove metrics of nonexistent subtasks when adaptive scheduler lowers job parallelism

2022-10-13 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616924#comment-17616924 ] Zhanghao Chen commented on FLINK-29615: --- [~chesnay] could you help take a look? I'

[jira] [Commented] (FLINK-29627) Sink - Duplicate key exception during recover more than 1 committable.

2022-10-13 Thread Krzysztof Chmielewski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616925#comment-17616925 ] Krzysztof Chmielewski commented on FLINK-29627: --- I have a fix and tests fo

[GitHub] [flink] Samrat002 commented on pull request #20937: [FLINK-29478][flink-connector/hive] Flink connector hive upgrade to 3.1.3

2022-10-13 Thread GitBox
Samrat002 commented on PR #20937: URL: https://github.com/apache/flink/pull/20937#issuecomment-1277381643 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-29558) Use select count(*) from xxx; and get SQL syntax

2022-10-13 Thread Hang HOU (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hang HOU updated FLINK-29558: - Description: Hi, I use flink sql to make kafka records to mysql. so I create these 2 tables in flink sql

[jira] [Assigned] (FLINK-29627) Sink - Duplicate key exception during recover more than 1 committable.

2022-10-13 Thread Fabian Paul (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Paul reassigned FLINK-29627: --- Assignee: Krzysztof Chmielewski > Sink - Duplicate key exception during recover more than 1

[jira] [Updated] (FLINK-29558) Use select count(*) from xxx; and get SQL syntax

2022-10-13 Thread Hang HOU (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hang HOU updated FLINK-29558: - Description: Hi, I use flink sql to make kafka records to mysql. so I create these 2 tables in flink sql

[jira] [Updated] (FLINK-29627) Sink - Duplicate key exception during recover more than 1 committable.

2022-10-13 Thread Krzysztof Chmielewski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Chmielewski updated FLINK-29627: -- Description: Recovery more than one Committable causes `IllegalStateException

[jira] [Commented] (FLINK-27344) FLIP-222: Support full job lifecycle statements in SQL client

2022-10-13 Thread Paul Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616929#comment-17616929 ] Paul Lin commented on FLINK-27344: -- [~AlexeyLV]  Thanks a lot for your input! It's very

[jira] [Updated] (FLINK-29627) Sink - Duplicate key exception during recover more than 1 committable.

2022-10-13 Thread Krzysztof Chmielewski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krzysztof Chmielewski updated FLINK-29627: -- Description: Recovery more than one Committable causes `IllegalStateException

[GitHub] [flink] kristoffSC opened a new pull request, #21052: [Draft] Flink 29627 Fix duplicate key exception during recover more than 1 committable.

2022-10-13 Thread GitBox
kristoffSC opened a new pull request, #21052: URL: https://github.com/apache/flink/pull/21052 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them

[jira] [Commented] (FLINK-29625) Optimize changelog normalize for upsert source

2022-10-13 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616934#comment-17616934 ] Martijn Visser commented on FLINK-29625: [~jark] I think you can answer this que

[jira] [Updated] (FLINK-29625) Optimize changelog normalize for upsert source

2022-10-13 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiabao Sun updated FLINK-29625: --- Summary: Optimize changelog normalize for upsert source (was: Optimize changelog normalize) > Opti

[jira] [Updated] (FLINK-29620) Flink deployment stuck in UPGRADING state when changing configuration

2022-10-13 Thread liad shachoach (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liad shachoach updated FLINK-29620: --- Description: When I update the configuration of a flink deployment I observe one of two sce

[GitHub] [flink] flinkbot commented on pull request #21052: [Draft] Flink 29627 Fix duplicate key exception during recover more than 1 committable.

2022-10-13 Thread GitBox
flinkbot commented on PR #21052: URL: https://github.com/apache/flink/pull/21052#issuecomment-1277395256 ## CI report: * 12889a83c1c9de33251f6058d69ca3d795ff0c5b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink-connector-dynamodb] dannycranmer commented on pull request #9: [FLINK-29443] Replicate packaging tests

2022-10-13 Thread GitBox
dannycranmer commented on PR #9: URL: https://github.com/apache/flink-connector-dynamodb/pull/9#issuecomment-1277404827 @darenwkt the checks are failing on CI -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [flink] MartijnVisser commented on pull request #20955: [FLINK-29502][Filesystem][S3] Update the Hadoop implementation for filesystems to 3.3.4

2022-10-13 Thread GitBox
MartijnVisser commented on PR #20955: URL: https://github.com/apache/flink/pull/20955#issuecomment-1277408985 > Ideally, first sort, then version bump. @zentol Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [flink] zentol commented on a diff in pull request #21019: [FLINK-29576][runtime] Adds concurrency support to JobVertex#addOperatorCoordinator

2022-10-13 Thread GitBox
zentol commented on code in PR #21019: URL: https://github.com/apache/flink/pull/21019#discussion_r99447 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java: ## @@ -298,6 +303,27 @@ private JobGraph createJobGraph() {

[jira] [Commented] (FLINK-28758) Failed to stop with savepoint

2022-10-13 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616946#comment-17616946 ] Yanfei Lei commented on FLINK-28758: Hi [~hjw] , from the log, this is because the s

[jira] [Updated] (FLINK-29157) Clarify the contract between CompletedCheckpointStore and SharedStateRegistry

2022-10-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29157: --- Labels: pull-request-available (was: ) > Clarify the contract between CompletedCheckpointSt

[GitHub] [flink] fredia opened a new pull request, #21053: [FLINK-29157][doc] Clarify the contract between CompletedCheckpointStore and SharedStateRegistry

2022-10-13 Thread GitBox
fredia opened a new pull request, #21053: URL: https://github.com/apache/flink/pull/21053 ## What is the purpose of the change Improve logging in CompletedCheckpointStore ## Verifying this change This change is a trivial rework without any (new) test coverage.

[GitHub] [flink-connector-dynamodb] YuriGusev commented on a diff in pull request #1: [FLINK-24229][Connectors][DynamoDB] - Add AWS DynamoDB connector

2022-10-13 Thread GitBox
YuriGusev commented on code in PR #1: URL: https://github.com/apache/flink-connector-dynamodb/pull/1#discussion_r994483063 ## flink-connector-aws-dynamodb/src/main/java/org/apache/flink/streaming/connectors/dynamodb/config/DynamoDbTablesConfig.java: ## @@ -0,0 +1,77 @@ +/* + *

[jira] [Commented] (FLINK-24999) flink-python doesn't work on Java 17

2022-10-13 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616950#comment-17616950 ] Chesnay Schepler commented on FLINK-24999: -- What's the state here? > flink-pyt

  1   2   3   >