[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749498#comment-17749498 ] Qingsheng Ren commented on FLINK-32223: --- I can't find any confirmation from RMs ab

[jira] [Comment Edited] (FLINK-32645) Flink pulsar sink is having poor performance

2023-08-01 Thread Vijaya Bhaskar V (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746603#comment-17746603 ] Vijaya Bhaskar V edited comment on FLINK-32645 at 8/1/23 7:04 AM:

[jira] [Commented] (FLINK-32645) Flink pulsar sink is having poor performance

2023-08-01 Thread Vijaya Bhaskar V (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749501#comment-17749501 ] Vijaya Bhaskar V commented on FLINK-32645: -- [~syhily]  thanks its working fine

[jira] [Assigned] (FLINK-32706) Add SPLIT(STRING) support in SQL & Table API

2023-08-01 Thread Konstantin Knauf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Knauf reassigned FLINK-32706: Assignee: Hanyu Zheng > Add SPLIT(STRING) support in SQL & Table API > --

[jira] [Created] (FLINK-32722) 239 exit code in flink-runtime

2023-08-01 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-32722: - Summary: 239 exit code in flink-runtime Key: FLINK-32722 URL: https://issues.apache.org/jira/browse/FLINK-32722 Project: Flink Issue Type: Bug Co

[jira] [Commented] (FLINK-32722) 239 exit code in flink-runtime

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749506#comment-17749506 ] Matthias Pohl commented on FLINK-32722: --- I did a log analysis on unfinished tests

[jira] [Created] (FLINK-32723) FLIP-334 : Decoupling autoscaler and kubernetes

2023-08-01 Thread Rui Fan (Jira)
Rui Fan created FLINK-32723: --- Summary: FLIP-334 : Decoupling autoscaler and kubernetes Key: FLINK-32723 URL: https://issues.apache.org/jira/browse/FLINK-32723 Project: Flink Issue Type: New Feature

[GitHub] [flink] lindong28 commented on a diff in pull request #22931: [FLINK-32514] Support configuring checkpointing interval during process backlog

2023-08-01 Thread via GitHub
lindong28 commented on code in PR #22931: URL: https://github.com/apache/flink/pull/22931#discussion_r1280153092 ## flink-runtime/src/main/java/org/apache/flink/runtime/source/event/EndOfDataEvent.java: ## @@ -0,0 +1,24 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Assigned] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-32681: - Assignee: Stefan Richter > RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure u

[GitHub] [flink] JunRuiLee commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280227631 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGeneratorTest.java: ## @@ -1693,6 +1723,10 @@ public JobGraph createGraphW

[GitHub] [flink] JunRuiLee commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280228067 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGeneratorTest.java: ## @@ -1693,6 +1723,10 @@ public JobGraph createGraphW

[GitHub] [flink] JunRuiLee commented on pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on PR #23085: URL: https://github.com/apache/flink/pull/23085#issuecomment-1659747018 @wanglijie95 Thanks for CR and I've updated this pr, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [flink] JunRuiLee commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280229513 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGeneratorTest.java: ## @@ -1655,28 +1655,58 @@ void testSlotSharingResour

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749522#comment-17749522 ] Feifan Wang commented on FLINK-32681: - Hi [~srichter] , I'm also very interested in

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749523#comment-17749523 ] Qingsheng Ren commented on FLINK-32663: --- [~fanrui] Could you help investigating th

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749525#comment-17749525 ] Rui Fan commented on FLINK-32663: - Thanks for the report, I will take a look asap. cc [~

[GitHub] [flink] zoltar9264 opened a new pull request, #23111: [FLINK-32681][rocksdb][tests] Add TaskFailureCleaner to RocksDBStateD…

2023-08-01 Thread via GitHub
zoltar9264 opened a new pull request, #23111: URL: https://github.com/apache/flink/pull/23111 …ownloader ## What is the purpose of the change Fix unstable test : RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure , discuss in [FLINK-32681](https://issues.apache.org/jir

[jira] [Updated] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32681: --- Labels: pull-request-available test-stability (was: test-stability) > RocksDBStateDownloade

[jira] [Comment Edited] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749522#comment-17749522 ] Feifan Wang edited comment on FLINK-32681 at 8/1/23 8:03 AM: -

[jira] [Commented] (FLINK-15736) Support Java 17 (LTS)

2023-08-01 Thread Konstantin Knauf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749535#comment-17749535 ] Konstantin Knauf commented on FLINK-15736: -- How do users usually learn about su

[GitHub] [flink] flinkbot commented on pull request #23111: [FLINK-32681][rocksdb][tests] Add TaskFailureCleaner to RocksDBStateD…

2023-08-01 Thread via GitHub
flinkbot commented on PR #23111: URL: https://github.com/apache/flink/pull/23111#issuecomment-1659784617 ## CI report: * 4194cd88a4b5f3e51d2d54d99fb7325cc0a2b8b7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-32570) Deprecate API that uses Flink's Time implementation (related to FLINK-14638)

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32570: -- Parent: (was: FLINK-32557) Issue Type: Technical Debt (was: Sub-task) > Deprecate

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749541#comment-17749541 ] Feifan Wang commented on FLINK-32681: - Sorry [~mapohl]  I didn't notice that the tic

[GitHub] [flink] reswqa opened a new pull request, #23112: Do not suspend task thread if changelog writer is available.

2023-08-01 Thread via GitHub
reswqa opened a new pull request, #23112: URL: https://github.com/apache/flink/pull/23112 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on

[GitHub] [flink] reswqa commented on pull request #23112: Do not suspend task thread if changelog writer is available.

2023-08-01 Thread via GitHub
reswqa commented on PR #23112: URL: https://github.com/apache/flink/pull/23112#issuecomment-1659794575 Before: ![image](https://github.com/apache/flink/assets/19502505/f61aecb8-63e2-45b0-93f6-a0e4e90e9737) After: ![image](https://github.com/apache/flink/assets/19502505/e9d0e933

[GitHub] [flink] flinkbot commented on pull request #23112: Do not suspend task thread if changelog writer is available.

2023-08-01 Thread via GitHub
flinkbot commented on PR #23112: URL: https://github.com/apache/flink/pull/23112#issuecomment-1659808707 ## CI report: * ead319a56e310e4d0c9330d68736bbde25708a4a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] gaborgsomogyi commented on pull request #21788: [FLINK-30812][yarn] Fix uploading local files when using YARN with S3

2023-08-01 Thread via GitHub
gaborgsomogyi commented on PR #21788: URL: https://github.com/apache/flink/pull/21788#issuecomment-1659816555 @MartijnVisser are you fine w/ the PR? I'm merging if you say to... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Created] (FLINK-32724) Mark CEP API classes as Public / PublicEvolving

2023-08-01 Thread Dian Fu (Jira)
Dian Fu created FLINK-32724: --- Summary: Mark CEP API classes as Public / PublicEvolving Key: FLINK-32724 URL: https://issues.apache.org/jira/browse/FLINK-32724 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-32725) Add option to control writing of timestamp to Kafka topic in KafkaRecordSerializationSchema.builder

2023-08-01 Thread xiechenling (Jira)
xiechenling created FLINK-32725: --- Summary: Add option to control writing of timestamp to Kafka topic in KafkaRecordSerializationSchema.builder Key: FLINK-32725 URL: https://issues.apache.org/jira/browse/FLINK-32725

[jira] [Updated] (FLINK-32559) Deprecate Queryable State

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32559: --- Labels: pull-request-available (was: ) > Deprecate Queryable State > --

[GitHub] [flink] flinkbot commented on pull request #23113: [FLINK-32559] Deprecate Queryable State

2023-08-01 Thread via GitHub
flinkbot commented on PR #23113: URL: https://github.com/apache/flink/pull/23113#issuecomment-1659884336 ## CI report: * 8b84ef3eea6dfedc5f54117e103691db65cbd9de UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] WencongLiu commented on pull request #23100: [FLINK-32708][network] Fix the write logic in remote tier of hybrid shuffle

2023-08-01 Thread via GitHub
WencongLiu commented on PR #23100: URL: https://github.com/apache/flink/pull/23100#issuecomment-1659886610 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Created] (FLINK-32726) [Umbrella] Test Flink Release 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-32726: - Summary: [Umbrella] Test Flink Release 1.18 Key: FLINK-32726 URL: https://issues.apache.org/jira/browse/FLINK-32726 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-32726) [Umbrella] Test Flink Release 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32726: -- Labels: release-testing (was: ) > [Umbrella] Test Flink Release 1.18 > --

[jira] [Updated] (FLINK-32678) Release Testing: Stress-Test to cover multiple low-level changes in Flink

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32678: -- Summary: Release Testing: Stress-Test to cover multiple low-level changes in Flink (was: Stre

[jira] [Updated] (FLINK-32678) Stress-Test to cover multiple low-level changes in Flink

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32678: -- Parent: FLINK-32726 Issue Type: Sub-task (was: Technical Debt) > Stress-Test to cover

[jira] [Commented] (FLINK-32557) API deprecations in Flink 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749579#comment-17749579 ] Qingsheng Ren commented on FLINK-32557: --- As discussed in the release sync, these d

[jira] [Updated] (FLINK-32557) API deprecations in Flink 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32557: -- Priority: Major (was: Blocker) > API deprecations in Flink 1.18 > ---

[jira] [Updated] (FLINK-32559) Deprecate Queryable State

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32559: -- Priority: Major (was: Blocker) > Deprecate Queryable State > - > >

[jira] [Updated] (FLINK-32558) Properly deprecate DataSet API

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32558: -- Priority: Major (was: Blocker) > Properly deprecate DataSet API > ---

[jira] [Updated] (FLINK-32560) Properly deprecate all Scala APIs

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32560: -- Priority: Major (was: Blocker) > Properly deprecate all Scala APIs >

[jira] [Commented] (FLINK-32570) Deprecate API that uses Flink's Time implementation (related to FLINK-14638)

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749582#comment-17749582 ] Qingsheng Ren commented on FLINK-32570: --- Downgrading to Major as deprecations will

[jira] [Updated] (FLINK-32570) Deprecate API that uses Flink's Time implementation (related to FLINK-14638)

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32570: -- Priority: Major (was: Blocker) > Deprecate API that uses Flink's Time implementation (related

[GitHub] [flink] XComp merged pull request #22585: [FLINK-32098][runtime] Dispatcher#submitJob calls Dispatcher#isInGloballyTerminalState up to three times which might be expensive due to IO

2023-08-01 Thread via GitHub
XComp merged PR #22585: URL: https://github.com/apache/flink/pull/22585 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.

[GitHub] [flink] XComp commented on pull request #22585: [FLINK-32098][runtime] Dispatcher#submitJob calls Dispatcher#isInGloballyTerminalState up to three times which might be expensive due to IO

2023-08-01 Thread via GitHub
XComp commented on PR #22585: URL: https://github.com/apache/flink/pull/22585#issuecomment-1659944337 The 1.18 release managers allowed to merge this change even after the feature freeze (see [ML discussion](https://lists.apache.org/thread/b232d9or85vlorrbl41916rrdk6c4bwh)). I'm going to g

[jira] [Resolved] (FLINK-32098) Dispatcher#submitJob calls Dispatcher#isInGloballyTerminalState up to three times which might be expensive due to IO

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl resolved FLINK-32098. --- Assignee: Weijie Guo Resolution: Fixed master: c6d58e17e8ce736a062234e1558ac8d7b65990e

[jira] [Updated] (FLINK-32098) Dispatcher#submitJob calls Dispatcher#isInGloballyTerminalState up to three times which might be expensive due to IO

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32098: -- Fix Version/s: 1.18.0 > Dispatcher#submitJob calls Dispatcher#isInGloballyTerminalState up to

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749599#comment-17749599 ] Stefan Richter commented on FLINK-32681: [~Feifan Wang]Thanks for the offer but

[GitHub] [flink] xintongsong commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
xintongsong commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280384166 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum - **F

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: Hybrid Shuffle supports storing the shuffle data in remote storage. The remote storage p

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: Hybrid Shuffle supports storing the shuffle data in remote storage. The remote storage p

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749616#comment-17749616 ] Gabor Somogyi commented on FLINK-32223: --- > It introduced a compilation error on ma

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749616#comment-17749616 ] Gabor Somogyi edited comment on FLINK-32223 at 8/1/23 10:44 AM: --

[GitHub] [flink] XComp commented on pull request #23114: [REVERT][FLINK-32223][runtime][security] Add Hive delegation token support

2023-08-01 Thread via GitHub
XComp commented on PR #23114: URL: https://github.com/apache/flink/pull/23114#issuecomment-1660067221 `git revert 70e6359` performed without any conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749619#comment-17749619 ] Matthias Pohl commented on FLINK-32223: --- Thanks for the quick response. I created

[GitHub] [flink] xintongsong commented on a diff in pull request #23113: [FLINK-32559] Deprecate Queryable State

2023-08-01 Thread via GitHub
xintongsong commented on code in PR #23113: URL: https://github.com/apache/flink/pull/23113#discussion_r1280456502 ## docs/content.zh/docs/deployment/resource-providers/standalone/docker.md: ## @@ -574,7 +574,7 @@ You can customize the Flink image in several ways: $ echo

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749619#comment-17749619 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 10:53 AM: --

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749619#comment-17749619 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 10:53 AM: --

[GitHub] [flink] MartijnVisser commented on a diff in pull request #23087: [FLINK-32665][format] Support reading null value for csv format

2023-08-01 Thread via GitHub
MartijnVisser commented on code in PR #23087: URL: https://github.com/apache/flink/pull/23087#discussion_r1280458306 ## flink-formats/flink-csv/src/main/java/org/apache/flink/formats/csv/CsvToRowDataConverters.java: ## @@ -185,48 +187,57 @@ private CsvToRowDataConverter createCo

[GitHub] [flink] xintongsong commented on pull request #23113: [FLINK-32559] Deprecate Queryable State

2023-08-01 Thread via GitHub
xintongsong commented on PR #23113: URL: https://github.com/apache/flink/pull/23113#issuecomment-1660074077 > 1. Remove the generated doc: queryable_state_configuration.html > 2. Remove other related doc/link, e.g.: Yep. I was hoping the CI docs_404_check to find all the missing lin

[GitHub] [flink] flinkbot commented on pull request #23114: [REVERT][FLINK-32223][runtime][security] Add Hive delegation token support

2023-08-01 Thread via GitHub
flinkbot commented on PR #23114: URL: https://github.com/apache/flink/pull/23114#issuecomment-1660075239 ## CI report: * 8639303d70e39376a1de051345aa4d1e053a9bba UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] StefanRRichter opened a new pull request, #23115: [FLINK-32681] Wait for RocksDBStateDownloader threads on failure to ensure proper cleanup.

2023-08-01 Thread via GitHub
StefanRRichter opened a new pull request, #23115: URL: https://github.com/apache/flink/pull/23115 ## What is the purpose of the change Fixes a test failure in `RocksDBStateDownloaderTest` by ensuring that on failure we first wait for all parallel download threads to complete and close

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749622#comment-17749622 ] Rui Fan commented on FLINK-32663: - Don't find the root cause, just updating some tempora

[GitHub] [flink] flinkbot commented on pull request #23115: [FLINK-32681] Wait for RocksDBStateDownloader threads on failure to ensure proper cleanup.

2023-08-01 Thread via GitHub
flinkbot commented on PR #23115: URL: https://github.com/apache/flink/pull/23115#issuecomment-1660101777 ## CI report: * 15e5ae87167dc6ecf69f2ad1e830552b1dd9af5a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749628#comment-17749628 ] Gabor Somogyi commented on FLINK-32223: --- Thanks for taking care, approved the reve

[jira] [Updated] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32663: Attachment: screenshot-1.png > RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749651#comment-17749651 ] Rui Fan commented on FLINK-32663: - This bug is caused by FLINK-28386, this test doesn't

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749656#comment-17749656 ] Rui Fan commented on FLINK-32663: - Hi [~lindong], I see you help reviewed the FLINK-2838

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-28386: Fix Version/s: 1.18.0 > Trigger an immediate checkpoint after all sources finished > -

[GitHub] [flink] Tartarus0zm opened a new pull request, #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
Tartarus0zm opened a new pull request, #23116: URL: https://github.com/apache/flink/pull/23116 ## What is the purpose of the change Add docs for atomic CTAS and RTAS ## Brief change log add docs ## Verifying this change no need test ## Does this p

[jira] [Assigned] (FLINK-32685) Performance regression on sortedMultiInput and sortedTwoInput since 2023-07-18

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32685: -- Assignee: Weijie Guo > Performance regression on sortedMultiInput and sortedTwoInput since 20

[jira] [Comment Edited] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749651#comment-17749651 ] Rui Fan edited comment on FLINK-32663 at 8/1/23 12:04 PM: -- This

[jira] [Updated] (FLINK-32581) Add document for atomic CTAS

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32581: --- Labels: pull-request-available (was: ) > Add document for atomic CTAS > ---

[GitHub] [flink] Tartarus0zm commented on pull request #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
Tartarus0zm commented on PR #23116: URL: https://github.com/apache/flink/pull/23116#issuecomment-1660176464 @luoyuxia PTAL, if you have time, thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Updated] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32663: Priority: Blocker (was: Critical) > RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749667#comment-17749667 ] Rui Fan commented on FLINK-32663: - The priority is upgraded to blocker due to it's cause

[jira] [Commented] (FLINK-32685) Performance regression on sortedMultiInput and sortedTwoInput since 2023-07-18

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749668#comment-17749668 ] Weijie Guo commented on FLINK-32685: Through some investigation, I have found this m

[jira] [Assigned] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32686: -- Assignee: Wencong Liu > Performance regression on startScheduling.BATCH and startScheduling.S

[jira] [Resolved] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-32686. Fix Version/s: 1.18.0 Resolution: Fixed master(1.18) via 8ed28b45109f11c62ded0d020dba46da74

[jira] [Closed] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-32686. -- > Performance regression on startScheduling.BATCH and startScheduling.STREAMING > since 2023-07-24 > ---

[GitHub] [flink] flinkbot commented on pull request #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
flinkbot commented on PR #23116: URL: https://github.com/apache/flink/pull/23116#issuecomment-1660196198 ## CI report: * b03be34d352ba59c03a768fa9d1576887467e01b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] TanYuxin-tyx commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
TanYuxin-tyx commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280542679 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum - **

[GitHub] [flink] TanYuxin-tyx commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
TanYuxin-tyx commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280543215 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum - **

[jira] [Updated] (FLINK-32709) Fix the bug of low memory utilization for Hybrid Shuffle

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32709: -- Summary: Fix the bug of low memory utilization for Hybrid Shuffle (was: Improve memory utilization fo

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks finished

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks finished (was: Trigger an immediate checkpoint

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has received end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks has received end-of-data (was: Trigger an imme

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has received end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Description: Currently for bounded job in streaming mode, by default it will wait for one more checkpoin

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has reached end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks has reached end-of-data (was: Trigger an immed

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has reached end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Description: Currently for bounded job in streaming mode, by default it will wait for one more checkpoin

[jira] [Comment Edited] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749656#comment-17749656 ] Rui Fan edited comment on FLINK-32663 at 8/1/23 12:39 PM: -- Hi [

[jira] [Assigned] (FLINK-32662) JobMasterTest.testRetrievingCheckpointStats fails with NPE on AZP

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-32662: - Assignee: Matthias Pohl (was: Hong Liang Teoh) > JobMasterTest.testRetrievingCheckpoin

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749719#comment-17749719 ] Dong Lin commented on FLINK-32663: -- Hi [~fanrui], FLINK-28386 will let Flink runtime tr

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749725#comment-17749725 ] Rui Fan commented on FLINK-32663: - Hi [~lindong], thanks for your quick feedback. {quot

[GitHub] [flink-kubernetes-operator] mxm commented on pull request #637: [FLINK-29634] Support periodic checkpoint triggering

2023-08-01 Thread via GitHub
mxm commented on PR #637: URL: https://github.com/apache/flink-kubernetes-operator/pull/637#issuecomment-1660275978 There was a test failure in the last run which probably is not fixed by the latest changes: https://github.com/apache/flink-kubernetes-operator/actions/runs/5668229506/job/15

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Fix Version/s: (was: 1.18.0) > Add Hive delegation token support > --

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749752#comment-17749752 ] Matthias Pohl commented on FLINK-32223: --- I merged the revert into {{master}} and u

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Priority: Major (was: Blocker) > Add Hive delegation token support > ---

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749762#comment-17749762 ] Matthias Pohl commented on FLINK-32223: --- {quote} How can one double check that bef

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749752#comment-17749752 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:43 PM: ---

[GitHub] [flink] XComp opened a new pull request, #23117: [FLINK-32662][test] Fixes JobMasterTest#testRetrievingCheckpointStats with the AdaptiveScheduler

2023-08-01 Thread via GitHub
XComp opened a new pull request, #23117: URL: https://github.com/apache/flink/pull/23117 ## What is the purpose of the change The `AdaptiveScheduler` requires resources to be available before starting the job. The previous version of the test didn't provide these resources which left

  1   2   >