Re: [PR] [docs] Polish quickstart guide & migrate maven links from ververica to apache [flink-cdc]

2024-06-04 Thread via GitHub
gtk96 commented on PR #3343: URL: https://github.com/apache/flink-cdc/pull/3343#issuecomment-2146793364 cc @Jiabao-Sun @GOODBOY008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Commented] (FLINK-35473) FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-06-04 Thread Jane Chan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851938#comment-17851938 ] Jane Chan commented on FLINK-35473: --- [~lincoln.86xy] Thank you for the reminder. I'm p

Re: [PR] [FLINK-34559] Limit Global & Local Aggregation buffers [flink]

2024-06-04 Thread via GitHub
twalthr commented on code in PR #24869: URL: https://github.com/apache/flink/pull/24869#discussion_r1625562520 ## flink-core/src/main/java/org/apache/flink/api/common/ExecutionConfig.java: ## @@ -276,6 +277,16 @@ public long getLatencyTrackingInterval() { return configu

[PR] Update ttlConfig in state.md [flink]

2024-06-04 Thread via GitHub
lizhigong opened a new pull request, #24884: URL: https://github.com/apache/flink/pull/24884 Duration.ofSeconds(1) is no longer accepted by the API, use Time.seconds(1) instead. ## What is the purpose of the change Change typos. ## Brief change log In the document

Re: [PR] Update ttlConfig in state.md [flink]

2024-06-04 Thread via GitHub
lizhigong closed pull request #24884: Update ttlConfig in state.md URL: https://github.com/apache/flink/pull/24884 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[jira] [Created] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35517: -- Summary: CI pipeline triggered by pull request seems unstable Key: FLINK-35517 URL: https://issues.apache.org/jira/browse/FLINK-35517 Project: Flink Issue Type:

[jira] [Updated] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35517: --- Priority: Blocker (was: Major) > CI pipeline triggered by pull request seems unstable > ---

Re: [PR] [FLINK-35464] Fixes operator state backwards compatibility from CDC 3.0.x [flink-cdc]

2024-06-04 Thread via GitHub
PatrickRen commented on code in PR #3369: URL: https://github.com/apache/flink-cdc/pull/3369#discussion_r1625602137 ## flink-cdc-migration-tests/pom.xml: ## @@ -19,13 +19,10 @@ limitations under the License. xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";

Re: [PR] [FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink [flink-cdc]

2024-06-04 Thread via GitHub
PatrickRen merged PR #3233: URL: https://github.com/apache/flink-cdc/pull/3233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

Re: [PR] [FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink [flink-cdc]

2024-06-04 Thread via GitHub
PatrickRen commented on PR #3233: URL: https://github.com/apache/flink-cdc/pull/3233#issuecomment-2146945078 @loserwang1024 Could you cherry-pick this commit to release-3.1 branch? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [FLINK-35282][python] Upgrade pyarrow and beam [flink]

2024-06-04 Thread via GitHub
hlteoh37 merged PR #24875: URL: https://github.com/apache/flink/pull/24875 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

[jira] [Commented] (FLINK-35149) Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink

2024-06-04 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851955#comment-17851955 ] Qingsheng Ren commented on FLINK-35149: --- flink-cdc master: 33891869a9fffa2abf8b8ae

[jira] [Assigned] (FLINK-35149) Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink

2024-06-04 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren reassigned FLINK-35149: - Assignee: Hongshun Wang > Fix DataSinkTranslator#sinkTo ignoring pre-write topology if

[jira] [Resolved] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh resolved FLINK-35282. - Resolution: Fixed > PyFlink Support for Apache Beam > 2.49 > ---

[jira] [Updated] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh updated FLINK-35282: Fix Version/s: (was: 1.19.1) > PyFlink Support for Apache Beam > 2.49 > --

[jira] [Commented] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851954#comment-17851954 ] Hong Liang Teoh commented on FLINK-35282: -  merged commit [{{91a9e06}}|https://

[jira] [Updated] (FLINK-35149) Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink

2024-06-04 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-35149: -- Fix Version/s: cdc-3.1.1 > Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not >

[jira] [Assigned] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-35282: --- Assignee: Antonio Vespoli > PyFlink Support for Apache Beam > 2.49 > --

Re: [PR] [FLINK-35129][cdc][postgres] Add checkpoint cycle option for commit offsets [flink-cdc]

2024-06-04 Thread via GitHub
leonardBang merged PR #3349: URL: https://github.com/apache/flink-cdc/pull/3349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink

[jira] [Commented] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851962#comment-17851962 ] Weijie Guo commented on FLINK-35517: I have reached out [~lorenzo.affetti] to see if

[jira] [Resolved] (FLINK-35129) Postgres source commits the offset after every multiple checkpoint cycles.

2024-06-04 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-35129. Resolution: Implemented Implemented via master: 5b28d1a579919b29acac6acded46d9bee5596bde > Postgr

[jira] [Created] (FLINK-35518) CI Bot doesn't run on PRs

2024-06-04 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-35518: -- Summary: CI Bot doesn't run on PRs Key: FLINK-35518 URL: https://issues.apache.org/jira/browse/FLINK-35518 Project: Flink Issue Type: Bug Compo

[jira] [Updated] (FLINK-35518) CI Bot doesn't run on PRs - status UNKNOWN

2024-06-04 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-35518: --- Summary: CI Bot doesn't run on PRs - status UNKNOWN (was: CI Bot doesn't run on PRs) > CI

[jira] [Commented] (FLINK-35518) CI Bot doesn't run on PRs - status UNKNOWN

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851969#comment-17851969 ] Weijie Guo commented on FLINK-35518: Yes, I have created a ticket(FLINK-35517) also

[jira] [Assigned] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge reassigned FLINK-35517: --- Assignee: Jing Ge > CI pipeline triggered by pull request seems unstable >

Re: [PR] [FLINK-35464] Fixes operator state backwards compatibility from CDC 3.0.x [flink-cdc]

2024-06-04 Thread via GitHub
yuxiqian commented on PR #3369: URL: https://github.com/apache/flink-cdc/pull/3369#issuecomment-2147045294 Thanks for the tips! Addressed your comments to simplify pom files. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Created] (FLINK-35519) Flink Job fails with SingleValueAggFunction received more than one element

2024-06-04 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-35519: Summary: Flink Job fails with SingleValueAggFunction received more than one element Key: FLINK-35519 URL: https://issues.apache.org/jira/browse/FLINK-35519 Pr

Re: [PR] [FLINK-35305]Amazon SQS Sink Connector [flink-connector-aws]

2024-06-04 Thread via GitHub
hlteoh37 commented on code in PR #141: URL: https://github.com/apache/flink-connector-aws/pull/141#discussion_r1625636303 ## docs/content.zh/docs/connectors/datastream/sqs.md: ## @@ -0,0 +1,134 @@ +--- +title: DynamoDB +weight: 5 +type: docs +aliases: +- /zh/dev/connectors/dyna

[jira] [Created] (FLINK-35520) Nightly build can't compile as problems were detected from NoticeFileChecker

2024-06-04 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-35520: -- Summary: Nightly build can't compile as problems were detected from NoticeFileChecker Key: FLINK-35520 URL: https://issues.apache.org/jira/browse/FLINK-35520 Project: Fli

[jira] [Updated] (FLINK-35520) Nightly build can't compile as problems were detected from NoticeFileChecker

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Description: 09:26:55,177 ERROR org.apache.flink.tools.ci.licensecheck.JarFileChecker [] - Jar file

Re: [PR] [FLINK-35305]Amazon SQS Sink Connector [flink-connector-aws]

2024-06-04 Thread via GitHub
hlteoh37 commented on PR #141: URL: https://github.com/apache/flink-connector-aws/pull/141#issuecomment-2147097522 We seem to be having quite a few `.` in the class folders. Can we change them to `/` instead? e.g. `flink-connector-aws/flink-connector-sqs/src/test/java/org.apache.flink/c

[jira] [Updated] (FLINK-35520) Nightly build can't compile as problems were detected from NoticeFileChecker

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Description: [] - Jar file /tmp/flink-validation-deployment/org/apache/flink/flink-python/1.20-SNAP

[jira] [Updated] (FLINK-35520) Nightly build can't compile

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Summary: Nightly build can't compile (was: Nightly build can't compile as problems were detected fr

Re: [PR] [FLINK-35305]Amazon SQS Sink Connector [flink-connector-aws]

2024-06-04 Thread via GitHub
hlteoh37 commented on code in PR #141: URL: https://github.com/apache/flink-connector-aws/pull/141#discussion_r1625705602 ## flink-connector-aws/flink-connector-sqs/src/main/java/org.apache.flink.connector.sqs/sink/SqsSinkElementConverter.java: ## @@ -0,0 +1,105 @@ +/* + * Lice

[jira] [Updated] (FLINK-35520) Nightly build can't compile as license check failed

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Summary: Nightly build can't compile as license check failed (was: Nightly build can't compile) >

[jira] [Updated] (FLINK-35520) Nightly build can't compile as license check failed

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Description: [https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=60024&view=logs

[jira] [Updated] (FLINK-35520) Nightly build can't compile as license check failed

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Description: https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=60024&view=logs&

[jira] [Commented] (FLINK-35520) Nightly build can't compile as license check failed

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851983#comment-17851983 ] Weijie Guo commented on FLINK-35520: Hi [~antoniovespoli], would you mind taking a l

[jira] [Comment Edited] (FLINK-35520) Nightly build can't compile as license check failed

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851983#comment-17851983 ] Weijie Guo edited comment on FLINK-35520 at 6/4/24 9:53 AM:

[jira] [Updated] (FLINK-35520) master can't compile as license check failed

2024-06-04 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-35520: --- Summary: master can't compile as license check failed (was: Nightly build can't compile as license

Re: [PR] [FLINK-35435] Add timeout Configuration to Async Sink [flink]

2024-06-04 Thread via GitHub
vahmed-hamdy commented on PR #24839: URL: https://github.com/apache/flink/pull/24839#issuecomment-2147156792 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Commented] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851994#comment-17851994 ] Jing Ge commented on FLINK-35517: - It should work again. [~Weijie Guo] please let me kno

[jira] [Commented] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851995#comment-17851995 ] Rui Fan commented on FLINK-35517: - Hi [~jingge] , may I know whether all old PRs can be

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-04 Thread via GitHub
JingGe commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624540081 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Found

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-04 Thread via GitHub
JingGe commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624540081 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Found

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-04 Thread via GitHub
JingGe commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1624540081 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Found

[jira] [Comment Edited] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851995#comment-17851995 ] Rui Fan edited comment on FLINK-35517 at 6/4/24 10:52 AM: -- Hi [

[jira] [Assigned] (FLINK-32229) Implement metrics and logging for Initial implementation

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Liang Teoh reassigned FLINK-32229: --- Assignee: Burak Ozakinci > Implement metrics and logging for Initial implementation

[jira] [Reopened] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reopened FLINK-35282: - I noticed that it was reverted by [~hong] at [caa68c2481f7c483d0364206d36654af26f2074f|http

[jira] [Commented] (FLINK-32229) Implement metrics and logging for Initial implementation

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17851998#comment-17851998 ] Hong Liang Teoh commented on FLINK-32229: - [~chalixar] sorry I didn't manage to

[jira] [Closed] (FLINK-35518) CI Bot doesn't run on PRs - status UNKNOWN

2024-06-04 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge closed FLINK-35518. --- Resolution: Duplicate > CI Bot doesn't run on PRs - status UNKNOWN > ---

[jira] [Commented] (FLINK-35520) master can't compile as license check failed

2024-06-04 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852001#comment-17852001 ] Sergey Nuyanzin commented on FLINK-35520: - so far it was reverted as mentioned i

[jira] [Assigned] (FLINK-35518) CI Bot doesn't run on PRs - status UNKNOWN

2024-06-04 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge reassigned FLINK-35518: --- Assignee: Jing Ge > CI Bot doesn't run on PRs - status UNKNOWN > --

[jira] [Resolved] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge resolved FLINK-35517. - Fix Version/s: 1.20.0 Resolution: Fixed > CI pipeline triggered by pull request seems unstable >

[jira] [Commented] (FLINK-35517) CI pipeline triggered by pull request seems unstable

2024-06-04 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852002#comment-17852002 ] Jing Ge commented on FLINK-35517: - [~fanrui] all PRs will be recovered. > CI pipeline t

[jira] [Commented] (FLINK-35512) ArtifactFetchManagerTest unit tests fail

2024-06-04 Thread Elphas Toringepi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852005#comment-17852005 ] Elphas Toringepi commented on FLINK-35512: -- [~hong] +1, I reproduced the error

[PR] [FLINK-35516][Connector/Files] Update the Experimental annotation for files connector [flink]

2024-06-04 Thread via GitHub
RocMarshal opened a new pull request, #24885: URL: https://github.com/apache/flink/pull/24885 ## What is the purpose of the change Update the Experimental annotation for files connector ## Brief change log Update the Experimental annotation for files c

[jira] [Updated] (FLINK-35516) Update the Experimental annotation to PublicEvolving for files connector

2024-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35516: --- Labels: pull-request-available (was: ) > Update the Experimental annotation to PublicEvolvi

Re: [PR] [FLINK-35516][Connector/Files] Update the Experimental annotation for files connector [flink]

2024-06-04 Thread via GitHub
flinkbot commented on PR #24885: URL: https://github.com/apache/flink/pull/24885#issuecomment-2147260985 ## CI report: * d303ba9557f4cbef16b70565a97ba35b829f9bc6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-26050] Manually compact small SST files [flink]

2024-06-04 Thread via GitHub
rkhachatryan merged PR #24880: URL: https://github.com/apache/flink/pull/24880 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Closed] (FLINK-35506) disable kafka auto-commit and rely on flink’s checkpointing if both are enabled

2024-06-04 Thread elon_X (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] elon_X closed FLINK-35506. -- Resolution: Not A Problem > disable kafka auto-commit and rely on flink’s checkpointing if both are > enabled

Re: [PR] [FLINK-32081][checkpoint] Compatibility between file-merging on and off across job runs [flink]

2024-06-04 Thread via GitHub
ljz2051 commented on code in PR #24873: URL: https://github.com/apache/flink/pull/24873#discussion_r1625978087 ## flink-tests/src/test/java/org/apache/flink/test/checkpointing/SnapshotFileMergingCompatibilityITCase.java: ## @@ -0,0 +1,126 @@ +/* + * Licensed to the Apache Softwa

Re: [PR] [FLINK-32081][checkpoint] Compatibility between file-merging on and off across job runs [flink]

2024-06-04 Thread via GitHub
ljz2051 commented on code in PR #24873: URL: https://github.com/apache/flink/pull/24873#discussion_r1625978087 ## flink-tests/src/test/java/org/apache/flink/test/checkpointing/SnapshotFileMergingCompatibilityITCase.java: ## @@ -0,0 +1,126 @@ +/* + * Licensed to the Apache Softwa

Re: [PR] [FLINK-35353][docs-zh]Translate "Profiler" page into Chinese [flink]

2024-06-04 Thread via GitHub
drymatini commented on PR #24822: URL: https://github.com/apache/flink/pull/24822#issuecomment-2147503847 Hi @JingGe , thank you for the review, I have already made adjustment based on your opinion, please check my commit again. -- This is an automated message from the Apache Git Service.

Re: [PR] [FLINK-35475][runtime] Introduce isInternalSorterSupport to OperatorAttributes [flink]

2024-06-04 Thread via GitHub
jeyhunkarimov commented on PR #24874: URL: https://github.com/apache/flink/pull/24874#issuecomment-2147546699 Thanks @Sxnan LGTM! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[PR] [hotfix][docs] Fix typo in Log Example Given on upgrade.md File [flink-kubernetes-operator]

2024-06-04 Thread via GitHub
nacisimsek opened a new pull request, #835: URL: https://github.com/apache/flink-kubernetes-operator/pull/835 The ID in the savepoint folder name that is passed as a parameter, and the ID in the folder name that is given as the log example do NOT match. Expected ID in log example: `a

Re: [PR] [FLINK-35501] Use common IO thread pool for RocksDB data transfer [flink]

2024-06-04 Thread via GitHub
rkhachatryan commented on PR #24882: URL: https://github.com/apache/flink/pull/24882#issuecomment-2147612702 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [FLINK-20398][e2e] Migrate test_batch_sql.sh to Java e2e tests framework [flink]

2024-06-04 Thread via GitHub
XComp commented on code in PR #24471: URL: https://github.com/apache/flink/pull/24471#discussion_r1626077906 ## flink-end-to-end-tests/flink-batch-sql-test/src/test/java/org/apache/flink/sql/tests/Generator.java: ## @@ -0,0 +1,82 @@ +/* + * Licensed to the Apache Software Founda

[jira] [Commented] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852074#comment-17852074 ] Hong Liang Teoh commented on FLINK-35282: - Yes. Reopned JIRA > PyFlink Support

[jira] (FLINK-35282) PyFlink Support for Apache Beam > 2.49

2024-06-04 Thread Hong Liang Teoh (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35282 ] Hong Liang Teoh deleted comment on FLINK-35282: - was (Author: hong): Yes. Reopned JIRA > PyFlink Support for Apache Beam > 2.49 > -- > >

Re: [PR] [FLINK-34487][ci] Adds Python Wheels nightly GHA workflow [flink]

2024-06-04 Thread via GitHub
XComp commented on code in PR #24426: URL: https://github.com/apache/flink/pull/24426#discussion_r1626117295 ## .github/workflows/nightly.yml: ## @@ -94,3 +94,46 @@ jobs: s3_bucket: ${{ secrets.IT_CASE_S3_BUCKET }} s3_access_key: ${{ secrets.IT_CASE_S3_ACCESS_KEY }

Re: [PR] [hotfix] A couple of hotfixes [flink]

2024-06-04 Thread via GitHub
JingGe commented on code in PR #24883: URL: https://github.com/apache/flink/pull/24883#discussion_r1626162425 ## flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/StateAssignmentOperationTest.java: ## @@ -563,7 +563,7 @@ private InflightDataGateOrPartitionRescaling

Re: [PR] [FLINK-35501] Use common IO thread pool for RocksDB data transfer [flink]

2024-06-04 Thread via GitHub
rkhachatryan commented on PR #24882: URL: https://github.com/apache/flink/pull/24882#issuecomment-2147786034 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] [hotfix] A couple of hotfixes [flink]

2024-06-04 Thread via GitHub
pnowojski commented on code in PR #24883: URL: https://github.com/apache/flink/pull/24883#discussion_r1626244851 ## flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/StateAssignmentOperationTest.java: ## @@ -563,7 +563,7 @@ private InflightDataGateOrPartitionRescal

Re: [PR] [hotfix] A couple of hotfixes [flink]

2024-06-04 Thread via GitHub
pnowojski merged PR #24883: URL: https://github.com/apache/flink/pull/24883 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[jira] [Commented] (FLINK-31533) CREATE TABLE AS SELECT should support to define partition

2024-06-04 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-31533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852110#comment-17852110 ] Sergio Peña commented on FLINK-31533: - Hi [~luoyuxia] [~aitozi], I'd like to make so

[jira] [Created] (FLINK-35521) Flink FileSystem SQL Connector Generating SUCESS File Multiple Times

2024-06-04 Thread EMERSON WANG (Jira)
EMERSON WANG created FLINK-35521: Summary: Flink FileSystem SQL Connector Generating SUCESS File Multiple Times Key: FLINK-35521 URL: https://issues.apache.org/jira/browse/FLINK-35521 Project: Flink

[jira] [Updated] (FLINK-35521) Flink FileSystem SQL Connector Generating SUCESS File Multiple Times

2024-06-04 Thread EMERSON WANG (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] EMERSON WANG updated FLINK-35521: - Description: Our Flink table SQL job received data from the Kafka streams and then sinked all p

[jira] [Updated] (FLINK-35515) Upgrade hive version to 4.0.0

2024-06-04 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-35515: --- Fix Version/s: (was: 1.18.2) > Upgrade hive version to 4.0.0 > -

[jira] [Updated] (FLINK-35515) Upgrade hive version to 4.0.0

2024-06-04 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-35515: --- Issue Type: New Feature (was: Improvement) > Upgrade hive version to 4.0.0 > --

[jira] [Commented] (FLINK-24605) org.apache.flink.kafka.shaded.org.apache.kafka.clients.consumer.NoOffsetForPartitionException: Undefined offset with no reset policy for partitions

2024-06-04 Thread EMERSON WANG (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852128#comment-17852128 ] EMERSON WANG commented on FLINK-24605: -- We got the same exception when scan.startup

[jira] [Commented] (FLINK-35502) compress the checkpoint metadata generated by ZK/ETCD HA Services

2024-06-04 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852132#comment-17852132 ] Mingliang Liu commented on FLINK-35502: --- I guess in my day job I don't see user re

[PR] [FLINK-34172] Add support for altering a distribution via ALTER TABLE [flink]

2024-06-04 Thread via GitHub
jnh5y opened a new pull request, #24886: URL: https://github.com/apache/flink/pull/24886 ## What is the purpose of the change This PR implements the SQL parser changes for ALTER TABLE to support ADD, MODIFY, and DROP DISTRIBUTION statements. ## Brief change log The SQL Parse

[jira] [Updated] (FLINK-34172) Add support for altering a distribution via ALTER TABLE

2024-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34172: --- Labels: pull-request-available (was: ) > Add support for altering a distribution via ALTER

Re: [PR] [FLINK-34172] Add support for altering a distribution via ALTER TABLE [flink]

2024-06-04 Thread via GitHub
flinkbot commented on PR #24886: URL: https://github.com/apache/flink/pull/24886#issuecomment-2148475342 ## CI report: * 4081f6d00def12b386970d94681364dd99d089a6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-35504] Improve Elasticsearch 8 connector observability [flink-connector-elasticsearch]

2024-06-04 Thread via GitHub
liuml07 commented on PR #106: URL: https://github.com/apache/flink-connector-elasticsearch/pull/106#issuecomment-2148526213 @reswqa Could you help review and merge? Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[jira] [Created] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

2024-06-04 Thread xingbe (Jira)
xingbe created FLINK-35522: -- Summary: The source task may get stuck after a failover occurs in batch jobs Key: FLINK-35522 URL: https://issues.apache.org/jira/browse/FLINK-35522 Project: Flink Issu

[jira] [Commented] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

2024-06-04 Thread xingbe (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852240#comment-17852240 ] xingbe commented on FLINK-35522: I have a solution to fix it, Could you please assign th

Re: [PR] [FLINK-35354] Support host mapping in Flink tikv cdc [flink-cdc]

2024-06-04 Thread via GitHub
Mrart commented on PR #3336: URL: https://github.com/apache/flink-cdc/pull/3336#issuecomment-2148692911 @leonardBang Can you help me review it again? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Assigned] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

2024-06-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-35522: --- Assignee: xingbe > The source task may get stuck after a failover occurs in batch jobs > --

[jira] [Commented] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

2024-06-04 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852241#comment-17852241 ] Zhu Zhu commented on FLINK-35522: - Thanks for reporting this problem and volunteering to

[jira] [Commented] (FLINK-35512) ArtifactFetchManagerTest unit tests fail

2024-06-04 Thread Rob Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17852243#comment-17852243 ] Rob Young commented on FLINK-35512: --- The additional artifact looks arbitrary from the

Re: [PR] [FLINK-31664] Implement ARRAY_INTERSECT function [flink]

2024-06-04 Thread via GitHub
liuyongvs commented on code in PR #24526: URL: https://github.com/apache/flink/pull/24526#discussion_r1626831685 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CollectionFunctionsITCase.java: ## @@ -1723,6 +1724,83 @@ private Stream arr

Re: [PR] [FLINK-31664] Implement ARRAY_INTERSECT function [flink]

2024-06-04 Thread via GitHub
liuyongvs commented on code in PR #24526: URL: https://github.com/apache/flink/pull/24526#discussion_r1626831821 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CollectionFunctionsITCase.java: ## @@ -1723,6 +1724,83 @@ private Stream arr

[jira] [Updated] (FLINK-35522) The source task may get stuck after a failover occurs in batch jobs

2024-06-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35522: --- Labels: pull-request-available (was: ) > The source task may get stuck after a failover occ

[PR] [FLINK-35522][runtime] Fix the issue that the source task may get stuck in speculative execution mode. [flink]

2024-06-04 Thread via GitHub
SinBex opened a new pull request, #24887: URL: https://github.com/apache/flink/pull/24887 ## What is the purpose of the change If the source task does not get assigned a split because the SplitEnumerator has no more splits, and a failover occurs during the closing process, the Source

Re: [PR] [FLINK-31664] Implement ARRAY_INTERSECT function [flink]

2024-06-04 Thread via GitHub
liuyongvs commented on PR #24526: URL: https://github.com/apache/flink/pull/24526#issuecomment-2148729746 @snuyanzin fix your review, thanks very much -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[PR] [BP-3.1.1][FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink (#3233) [flink-cdc]

2024-06-04 Thread via GitHub
loserwang1024 opened a new pull request, #3386: URL: https://github.com/apache/flink-cdc/pull/3386 BP https://issues.apache.org/jira/browse/FLINK-35149 to 3.1.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] [BP-3.1.1][FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink (#3233) [flink-cdc]

2024-06-04 Thread via GitHub
loserwang1024 closed pull request #3386: [BP-3.1.1][FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink (#3233) URL: https://github.com/apache/flink-cdc/pull/3386 -- This is an automated message from the Apache Git Service. To re

[PR] [BP-3.1.1][FLINK-35149][cdc-composer] Fix DataSinkTranslator#sinkTo ignoring pre-write topology if not TwoPhaseCommittingSink (#3233) [flink-cdc]

2024-06-04 Thread via GitHub
loserwang1024 opened a new pull request, #3387: URL: https://github.com/apache/flink-cdc/pull/3387 BP https://issues.apache.org/jira/browse/FLINK-35149 to 3.1.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

  1   2   >