[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2025-02-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930113#comment-17930113 ] Arvid Heise commented on FLINK-34554: - Hi [~loserwang1024] , I have properly linked

[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2025-02-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930151#comment-17930151 ] Arvid Heise commented on FLINK-34554: - I'll draft a FLIP. I see the point that it's

[jira] [Commented] (FLINK-37067) Cross-team verification for “Introduce DataStream API V2”

2025-02-25 Thread Yutong Han (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930180#comment-17930180 ] Yutong Han commented on FLINK-37067: Hi [~yyhx]  I should be able to wrap thing up

[jira] [Created] (FLINK-37382) Early optimization for adaptive join when one input is below broadcast threshold

2025-02-25 Thread xingbe (Jira)
xingbe created FLINK-37382: -- Summary: Early optimization for adaptive join when one input is below broadcast threshold Key: FLINK-37382 URL: https://issues.apache.org/jira/browse/FLINK-37382 Project: Flink

Re: [PR] [FLINK-37376] Upgrade to flink-shaded 20.0 [flink]

2025-02-25 Thread via GitHub
snuyanzin commented on code in PR #26206: URL: https://github.com/apache/flink/pull/26206#discussion_r1969286874 ## flink-formats/flink-csv/src/test/java/org/apache/flink/formats/csv/CsvRowDataSerDeSchemaTest.java: ## @@ -84,11 +84,11 @@ void testSerializeDeserialize() throws Ex

[jira] [Assigned] (FLINK-37382) Early optimization for adaptive join when one input is below broadcast threshold

2025-02-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37382: -- Assignee: xingbe > Early optimization for adaptive join when one input is below broadcast >

Re: [PR] [FLINK-37374][table] Add the built-in function JSON for JSON_ARRAY [flink]

2025-02-25 Thread via GitHub
davidradl commented on code in PR #26199: URL: https://github.com/apache/flink/pull/26199#discussion_r1969505434 ## docs/data/sql_functions.yml: ## @@ -1098,6 +1099,15 @@ json: -- {"K": null} JSON_OBJECT('K' VALUE JSON('')) + + -- [{"K2":42}] + JS

Re: [PR] [FLINK-37374][table] Add the built-in function JSON for JSON_ARRAY [flink]

2025-02-25 Thread via GitHub
davidradl commented on code in PR #26199: URL: https://github.com/apache/flink/pull/26199#discussion_r1969505434 ## docs/data/sql_functions.yml: ## @@ -1098,6 +1099,15 @@ json: -- {"K": null} JSON_OBJECT('K' VALUE JSON('')) + + -- [{"K2":42}] + JS

[jira] [Updated] (FLINK-35350) Add documentation for Kudu

2025-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35350: --- Labels: pull-request-available (was: ) > Add documentation for Kudu > -

[PR] FLINK-35350 [flink-connector-kudu]

2025-02-25 Thread via GitHub
dinchamion opened a new pull request, #9: URL: https://github.com/apache/flink-connector-kudu/pull/9 Adding documentation for the Kudu connector. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] [FLINK-37125] [conf] fixed env.log.max java.lang.NumberFormatException [flink]

2025-02-25 Thread via GitHub
sehajsandhu123 commented on PR #26037: URL: https://github.com/apache/flink/pull/26037#issuecomment-2681468611 Hi @dawidwys , Could you review and merge this PR for [FLINK-37125]? It fixes a NumberFormatException in env.log.max by ensuring correct parsing. The PR is already approved by @

Re: [PR] [FLINK-37381] [doc] Fix typo in Join document [flink]

2025-02-25 Thread via GitHub
davidradl commented on PR #26209: URL: https://github.com/apache/flink/pull/26209#issuecomment-2681588572 fyi I checked the chinese version and it does not require changing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] [FLINK-37225] Remove remaining test resources of Gelly [flink]

2025-02-25 Thread via GitHub
X-czh commented on PR #26081: URL: https://github.com/apache/flink/pull/26081#issuecomment-2681580376 @MartijnVisser Hi, if there's no other issues, would you mind helping to merge this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-02-25 Thread via GitHub
kurtostfeld commented on PR #25896: URL: https://github.com/apache/flink/pull/25896#issuecomment-2683421100 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[jira] [Commented] (FLINK-37068) Cross-team verification for FLIP-473

2025-02-25 Thread Shuai Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930508#comment-17930508 ] Shuai Xu commented on FLINK-37068: -- Hi, [~xuyangzhong]. I have tested this according to

[jira] [Updated] (FLINK-37384) the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios

2025-02-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37384: --- Fix Version/s: (was: 2.1.0) > the execution time of DefaultVertexParallelismAndInputInfosDecider

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
JunRuiLee commented on code in PR #26211: URL: https://github.com/apache/flink/pull/26211#discussion_r1970803935 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/graph/StreamGraphContext.java: ## @@ -76,12 +76,13 @@ public interface StreamGraphContext { boolean

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
SinBex commented on PR #26211: URL: https://github.com/apache/flink/pull/26211#issuecomment-2683784835 Thanks to @JunRuiLee for reviewing, all comments have been fixed, PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
SinBex opened a new pull request, #26212: URL: https://github.com/apache/flink/pull/26212 ## What is the purpose of the change When the large table side has not yet initialized, if the small table side finishes early and the output data volume is smaller than the broadcast threshold,

Re: [PR] [FLINK-3154][API] Upgrade from Kryo 2.x to Kryo 5.x. Removed twitter … [flink]

2025-02-25 Thread via GitHub
kurtostfeld commented on PR #25896: URL: https://github.com/apache/flink/pull/25896#issuecomment-2683795140 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[jira] [Commented] (FLINK-37067) Cross-team verification for “Introduce DataStream API V2”

2025-02-25 Thread xuhuang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930521#comment-17930521 ] xuhuang commented on FLINK-37067: - Hi, [~yutonghan1718]  The Flink 2.0 preview1 and 2.0

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
flinkbot commented on PR #26212: URL: https://github.com/apache/flink/pull/26212#issuecomment-2683804804 ## CI report: * c2ca084e684550dd4102f0503335b544253fb80a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-37247][FileSystems][Tests] Implement common Hadoop file system integration tests for GCS. [flink]

2025-02-25 Thread via GitHub
cnauroth commented on PR #26102: URL: https://github.com/apache/flink/pull/26102#issuecomment-2683550295 @MartijnVisser , gentle reminder requesting code review here on #26102 adding integration test coverage for the GCS file system path. Then, I'm also aiming for a GCS dependency upgrade:

Re: [PR] Reorder dependency flink-table-runtime in pom.xml to avoid dependency conflict. [flink-cdc]

2025-02-25 Thread via GitHub
github-actions[bot] commented on PR #2754: URL: https://github.com/apache/flink-cdc/pull/2754#issuecomment-2683562506 This pull request has been closed because it has not had recent activity. You could reopen it if you try to continue your work, and anyone who are interested in it are encou

Re: [PR] Reorder dependency flink-table-runtime in pom.xml to avoid dependency conflict. [flink-cdc]

2025-02-25 Thread via GitHub
github-actions[bot] closed pull request #2754: Reorder dependency flink-table-runtime in pom.xml to avoid dependency conflict. URL: https://github.com/apache/flink-cdc/pull/2754 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [FLINK-36997] Add Log4j JSONTemplateLayout to flink-dist [flink]

2025-02-25 Thread via GitHub
ryanvanhuuksloot commented on PR #25888: URL: https://github.com/apache/flink/pull/25888#issuecomment-2683374563 Thoughts on merging as part of Flink 2.0? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Commented] (FLINK-31197) Unable to write Parquet files containing Arrays with complex types.

2025-02-25 Thread Brett Randall (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930538#comment-17930538 ] Brett Randall commented on FLINK-31197: --- I think this is duplicated by FLINK-33759

[jira] [Commented] (FLINK-37248) Scala was removed in flink 2.0

2025-02-25 Thread 911432 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930527#comment-17930527 ] 911432 commented on FLINK-37248: [~kunni] [~Zhanghao Chen]  How can I know when and how

Re: [PR] [FLINK-37120][cdc-connector] Add ending split chunk first to avoid TaskManager oom [flink-cdc]

2025-02-25 Thread via GitHub
beryllw commented on PR #3856: URL: https://github.com/apache/flink-cdc/pull/3856#issuecomment-2684163060 @leonardBang Is there anything else that needs to be completed? I'm concerned about potential conflicts later on.Could you please help me move this forward? -- This is an automated

[jira] [Resolved] (FLINK-37274) Add examples for datastream api v2

2025-02-25 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-37274. Fix Version/s: 2.0.0 Resolution: Done release-2.0 via 05325ccade17d5ceb7e7073bd15d5750255b5

[PR] [FLINK-37337][sql-client] No need to add sql-client jar [flink]

2025-02-25 Thread via GitHub
fsk119 opened a new pull request, #26213: URL: https://github.com/apache/flink/pull/26213 ## What is the purpose of the change *No need to add sql client jar. Because sql client is only used to compile the SQL and don't need to upload as job dependencies.* -- Th

[jira] [Updated] (FLINK-37337) Deploy script SQL Client in Embedded Mode to Kubernetes Results in FileNotFoundException

2025-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37337: --- Labels: pull-request-available (was: ) > Deploy script SQL Client in Embedded Mode to Kuber

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
JunRuiLee closed pull request #26211: [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. URL: https://github.com/apache/flink/pull/26211 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
JunRuiLee merged PR #26212: URL: https://github.com/apache/flink/pull/26212 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] FLINK-35350 [flink-connector-kudu]

2025-02-25 Thread via GitHub
dinchamion commented on PR #9: URL: https://github.com/apache/flink-connector-kudu/pull/9#issuecomment-2684015587 @ferenc-csaky all changes are done from your feedback! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (FLINK-37366) Allow configurable retry for Kafka topic metadata fetch

2025-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37366: --- Labels: pull-request-available (was: ) > Allow configurable retry for Kafka topic metadata

Re: [PR] [FLINK-37366] Allow configurable retry for Kafka topic metadata fetch [flink-connector-kafka]

2025-02-25 Thread via GitHub
boring-cyborg[bot] commented on PR #155: URL: https://github.com/apache/flink-connector-kafka/pull/155#issuecomment-2684198018 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is

[jira] [Closed] (FLINK-37382) Early optimization for adaptive join when one input is below broadcast threshold

2025-02-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37382. -- Fix Version/s: 2.0.0 2.0.1 Resolution: Done master 69559fb5d231d704633fed807

Re: [PR] [BP-2.0][FLINK-37274] Add examples for DataStream V2 [flink]

2025-02-25 Thread via GitHub
reswqa merged PR #26179: URL: https://github.com/apache/flink/pull/26179 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Comment Edited] (FLINK-37274) Add examples for datastream api v2

2025-02-25 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930564#comment-17930564 ] Weijie Guo edited comment on FLINK-37274 at 2/26/25 7:06 AM: -

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
JunRuiLee commented on PR #26211: URL: https://github.com/apache/flink/pull/26211#issuecomment-2684052017 https://github.com/SinBex/flink/actions/runs/13537602087 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Updated] (FLINK-37333) Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect

2025-02-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37333: --- Fix Version/s: 2.0.1 > Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effec

[jira] [Commented] (FLINK-36402) Improper variable naming

2025-02-25 Thread Nil Madhab (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930566#comment-17930566 ] Nil Madhab commented on FLINK-36402: Can I pick this task? > Improper variable nami

[jira] [Commented] (FLINK-36402) Improper variable naming

2025-02-25 Thread Nil Madhab (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930567#comment-17930567 ] Nil Madhab commented on FLINK-36402: How can I assign myself in the task? > Imprope

[jira] [Commented] (FLINK-37248) Scala was removed in flink 2.0

2025-02-25 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930530#comment-17930530 ] Zhanghao Chen commented on FLINK-37248: --- [~911432] You can find links to externali

Re: [PR] [FLINK-37008] [runtime-web] Flink UI should show the type of checkpoint (full vs incremental) [flink]

2025-02-25 Thread via GitHub
ryanvanhuuksloot commented on PR #25899: URL: https://github.com/apache/flink/pull/25899#issuecomment-2683373596 We realized that it is quite difficult to determine at the correct layer if a checkpoint is full when it isn't explicitly marked as full. This needs a more in-depth dive into the

Re: [PR] [FLINK-37008] [runtime-web] Flink UI should show the type of checkpoint (full vs incremental) [flink]

2025-02-25 Thread via GitHub
ryanvanhuuksloot closed pull request #25899: [FLINK-37008] [runtime-web] Flink UI should show the type of checkpoint (full vs incremental) URL: https://github.com/apache/flink/pull/25899 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Assigned] (FLINK-37384) the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios

2025-02-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37384: -- Assignee: Lei Yang > the execution time of DefaultVertexParallelismAndInputInfosDecider excee

[jira] [Commented] (FLINK-37068) Cross-team verification for FLIP-473

2025-02-25 Thread Xuyang Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930518#comment-17930518 ] Xuyang Zhong commented on FLINK-37068: -- [~xu_shuai_] Thanks very much for these pro

[jira] [Closed] (FLINK-37068) Cross-team verification for FLIP-473

2025-02-25 Thread Xuyang Zhong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuyang Zhong closed FLINK-37068. Resolution: Fixed > Cross-team verification for FLIP-473 > >

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970341449 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSplitGenerator.java: ## @@ -0,0 +1,88 @@ +/* + * Licensed to th

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970341077 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSplitGenerator.java: ## @@ -0,0 +1,88 @@ +/* + * Licensed to th

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970341805 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumerator.java: ## @@ -0,0 +1,222 @@ +/* + * Licensed to

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970342621 ## flink-connector-kudu/src/test/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumeratorStateSerializerTest.java: ## @@ -0,0 +1,83 @@ +

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970342327 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/split/KuduSourceSplitSerializer.java: ## @@ -0,0 +1,54 @@ +/* + * Licensed to

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970345677 ## flink-connector-kudu/src/test/java/org/apache/flink/connector/kudu/source/enumerator/KuduSourceEnumeratorTest.java: ## @@ -0,0 +1,112 @@ +/* + * License

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1970345363 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSplitGenerator.java: ## @@ -0,0 +1,88 @@ +/* + * Licensed to th

Re: [PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
flinkbot commented on PR #26211: URL: https://github.com/apache/flink/pull/26211#issuecomment-2682068450 ## CI report: * 774f9bfbd757d2e761ca92921e60e1f8579d5f41 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-37383) ThrottleIterator from examples/utils does not properly throttle on next window after throttle is applied

2025-02-25 Thread Rafael Zimmermann (Jira)
Rafael Zimmermann created FLINK-37383: - Summary: ThrottleIterator from examples/utils does not properly throttle on next window after throttle is applied Key: FLINK-37383 URL: https://issues.apache.org/jira/br

[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2025-02-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930287#comment-17930287 ] Hongshun Wang commented on FLINK-34554: --- [~arvid] Thanks for you. If you need, I'd

[jira] [Comment Edited] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2025-02-25 Thread Hongshun Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930287#comment-17930287 ] Hongshun Wang edited comment on FLINK-34554 at 2/25/25 11:25 AM: -

[jira] [Comment Edited] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930325#comment-17930325 ] slankka edited comment on FLINK-37378 at 2/25/25 12:57 PM: --- Th

Re: [PR] FLINK-35350 [flink-connector-kudu]

2025-02-25 Thread via GitHub
ferenc-csaky commented on code in PR #9: URL: https://github.com/apache/flink-connector-kudu/pull/9#discussion_r1970137712 ## content/docs/connectors/table/kudu/overview.md: ## @@ -0,0 +1,129 @@ +--- +title: Overview +weight: 1 +type: docs +aliases: +- /docs/connectors/table/ku

Re: [PR] FLINK-35350 [flink-connector-kudu]

2025-02-25 Thread via GitHub
ferenc-csaky commented on code in PR #9: URL: https://github.com/apache/flink-connector-kudu/pull/9#discussion_r1970126739 ## content/docs/connectors/table/kudu/overview.md: ## @@ -0,0 +1,129 @@ +--- +title: Overview +weight: 1 +type: docs +aliases: +- /docs/connectors/table/ku

[jira] [Comment Edited] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930338#comment-17930338 ] slankka edited comment on FLINK-37378 at 2/25/25 1:35 PM: -- Verf

Re: [PR] [hotfix] Update version to 21.0 [flink-shaded]

2025-02-25 Thread via GitHub
snuyanzin merged PR #145: URL: https://github.com/apache/flink-shaded/pull/145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

Re: [PR] [FLINK-37376] Upgrade to flink-shaded 20.0 [flink]

2025-02-25 Thread via GitHub
snuyanzin merged PR #26206: URL: https://github.com/apache/flink/pull/26206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] [FLINK-37383][flink-examples]Correct throttling logic on ThrottledIterator [flink]

2025-02-25 Thread via GitHub
rafaelzimmermann commented on PR #26203: URL: https://github.com/apache/flink/pull/26203#issuecomment-2681666408 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[jira] [Updated] (FLINK-37383) ThrottleIterator from examples/utils does not properly throttle on next window after throttle is applied

2025-02-25 Thread Rafael Zimmermann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafael Zimmermann updated FLINK-37383: -- Description: The throttle function available on `flink-examples/flink-examples-stream

Re: [PR] Bump io.netty:netty-common from 4.1.46.Final to 4.1.118.Final in /flink-end-to-end-tests/flink-end-to-end-tests-hive [flink]

2025-02-25 Thread via GitHub
dependabot[bot] commented on PR #26158: URL: https://github.com/apache/flink/pull/26158#issuecomment-2681668104 Dependabot couldn't find a pom.xml. Because of this, Dependabot cannot update this pull request. -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] Bump org.apache.hive:hive-exec from 2.3.10 to 4.0.1 in /flink-connectors/flink-sql-connector-hive-2.3.10 [flink]

2025-02-25 Thread via GitHub
dependabot[bot] commented on PR #26090: URL: https://github.com/apache/flink/pull/26090#issuecomment-2681668082 Dependabot couldn't find a pom.xml. Because of this, Dependabot cannot update this pull request. -- This is an automated message from the Apache Git Service. To respond to the m

[jira] [Updated] (FLINK-37383) ThrottleIterator from examples/utils does not properly throttle on next window after throttle is applied

2025-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37383: --- Labels: pull-request-available (was: ) > ThrottleIterator from examples/utils does not prop

[jira] [Updated] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] slankka updated FLINK-37378: Description: Thanks to [~gaborgsomogyi] , he  The configuation of token provider renewer should be docume

[jira] [Reopened] (FLINK-33353) SQL fails because "TimestampType.kind" is not serialized

2025-02-25 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reopened FLINK-33353: -- > SQL fails because "TimestampType.kind" is not serialized >

[jira] [Updated] (FLINK-37282) Add backchannel for producer recycling

2025-02-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-37282: Description: We should employ the same trick that statefun uses to establish a backchannel to unif

[jira] [Commented] (FLINK-36569) flink kafka connector do not close kafka produer when it checkpoint success

2025-02-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930362#comment-17930362 ] Arvid Heise commented on FLINK-36569: - Are you running unchained by any chance? If s

[jira] [Commented] (FLINK-37356) Recycle use of kafka producer(which commit error) maybe send data without AddPartitionsToTxnRequest

2025-02-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930363#comment-17930363 ] Arvid Heise commented on FLINK-37356: - {noformat} In KafkaSinkBuilder{noformat} {nof

Re: [PR] Kudu continuous source initial commit. [flink-connector-kudu]

2025-02-25 Thread via GitHub
martongreber commented on code in PR #8: URL: https://github.com/apache/flink-connector-kudu/pull/8#discussion_r1969959855 ## flink-connector-kudu/src/main/java/org/apache/flink/connector/kudu/source/enumerator/KuduSplitGenerator.java: ## @@ -0,0 +1,88 @@ +/* + * Licensed to th

Re: [PR] [FLINK-37336][python] Introduce TablePipeline descriptor to Python Table API [flink]

2025-02-25 Thread via GitHub
autophagy commented on code in PR #26167: URL: https://github.com/apache/flink/pull/26167#discussion_r1969998175 ## flink-python/docs/reference/pyflink.table/descriptors.rst: ## @@ -140,3 +140,18 @@ The set of changes contained in a changelog. ChangelogMode.insert_only

[jira] [Reopened] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] slankka reopened FLINK-37378: - Thanks to [dinchamion (Greg 'Dinchamion' Fazekas) · GitHub|https://github.com/dinchamion] He's PR in Cloud

[jira] [Closed] (FLINK-33353) SQL fails because "TimestampType.kind" is not serialized

2025-02-25 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky closed FLINK-33353. Fix Version/s: 1.20.1 Resolution: Fixed The linked issue fixes this problem. > SQL fails b

[jira] [Closed] (FLINK-33353) SQL fails because "TimestampType.kind" is not serialized

2025-02-25 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky closed FLINK-33353. Resolution: Won't Fix > SQL fails because "TimestampType.kind" is not serialized > --

[jira] [Updated] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] slankka updated FLINK-37378: Description: Thanks to [~gaborgsomogyi] , he created FLINK-28608, we found it is helpful to solve log agg

Re: [PR] [FLINK-37383][flink-examples]Correct throttling logic on ThrottledIterator [flink]

2025-02-25 Thread via GitHub
rafaelzimmermann commented on PR #26203: URL: https://github.com/apache/flink/pull/26203#issuecomment-2681871149 /flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] [FLINK-37384][runtime] Optimize the parallelism decide logic for pointwise [flink]

2025-02-25 Thread via GitHub
flinkbot commented on PR #26210: URL: https://github.com/apache/flink/pull/26210#issuecomment-2682026984 ## CI report: * f534fa4effcf63fcaaead372871e60a36096a36b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-37382) Early optimization for adaptive join when one input is below broadcast threshold

2025-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37382: --- Labels: pull-request-available (was: ) > Early optimization for adaptive join when one inpu

[PR] [FLINK-37382][runtime] Early optimization for adaptive join when either input is below broadcast threshold. [flink]

2025-02-25 Thread via GitHub
SinBex opened a new pull request, #26211: URL: https://github.com/apache/flink/pull/26211 ## What is the purpose of the change When the large table side has not yet initialized, if the small table side finishes early and the output data volume is smaller than the broadcast threshold,

[jira] [Created] (FLINK-37384) the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios

2025-02-25 Thread Lei Yang (Jira)
Lei Yang created FLINK-37384: Summary: the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios Key: FLINK-37384 URL: https://issues.apache.org/jira/browse/FLINK-3

[jira] [Updated] (FLINK-37384) the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios

2025-02-25 Thread Lei Yang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei Yang updated FLINK-37384: - Description: When a Flink job contains a rescale edge converted from hash egde, the execution time of De

[jira] [Commented] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930335#comment-17930335 ] Gabor Somogyi commented on FLINK-37378: --- > I even did not create pr for Flink. Th

[jira] [Commented] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930338#comment-17930338 ] slankka commented on FLINK-37378: - Verfiying Spark soon. I also found that the similar

[jira] [Commented] (FLINK-37376) Bump flink-shaded to 20.0

2025-02-25 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930337#comment-17930337 ] Sergey Nuyanzin commented on FLINK-37376: - Merged as [e8019511a800cc77759862884

[jira] [Resolved] (FLINK-37376) Bump flink-shaded to 20.0

2025-02-25 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-37376. - Fix Version/s: 2.1.0 Resolution: Fixed > Bump flink-shaded to 20.0 >

[PR] [FLINK-37384][runtime] Optimize the parallelism decide logic for pointwise [flink]

2025-02-25 Thread via GitHub
noorall opened a new pull request, #26210: URL: https://github.com/apache/flink/pull/26210 ## What is the purpose of the change When a Flink job contains a Rescale edge converted from Hash, the pre-determined parallelism limits the flexibility of parallelism derivation for Pointwise-type

[jira] [Comment Edited] (FLINK-37378) Yarn log aggregation fails with Kerberos DT issues

2025-02-25 Thread slankka (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930338#comment-17930338 ] slankka edited comment on FLINK-37378 at 2/25/25 1:31 PM: -- Verf

[jira] [Updated] (FLINK-37384) the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios

2025-02-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-37384: --- Labels: pull-request-available (was: ) > the execution time of DefaultVertexParallelismAndI

[jira] [Resolved] (FLINK-37377) Sync guava with guava in flink-shaded

2025-02-25 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin resolved FLINK-37377. - Fix Version/s: 2.1.0 Resolution: Fixed Merged as [e8354665a28fc3e7b890f0255a0aea

[jira] [Created] (FLINK-37385) Add support for smile format in flink main repo

2025-02-25 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-37385: --- Summary: Add support for smile format in flink main repo Key: FLINK-37385 URL: https://issues.apache.org/jira/browse/FLINK-37385 Project: Flink Issue T