[jira] [Updated] (FLINK-26081) Update document,becasue of add maven wrapper.

2024-08-17 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong updated FLINK-26081: Description: Update document,becasue of add maven wapper. Related files: building.md.

Re: [PR] [FLINK-26081][docs] Update flink build document with maven wrapper [flink]

2024-08-17 Thread via GitHub
flinkbot commented on PR #25212: URL: https://github.com/apache/flink/pull/25212#issuecomment-2295141501 ## CI report: * 16a0fa640b86ab5b9e6e9693e10950fbd7efda64 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-26081) Update document,becasue of add maven wrapper.

2024-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-26081: --- Labels: pull-request-available (was: ) > Update document,becasue of add maven wrapper. > --

Re: [PR] [FLINK-26081][docs] Update flink build document with maven wrapper [flink]

2024-08-17 Thread via GitHub
GOODBOY008 commented on PR #25212: URL: https://github.com/apache/flink/pull/25212#issuecomment-2295140732 @Jiabao-Sun PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[PR] [FLINK-26081][docs] Update flink build document with maven wrapper [flink]

2024-08-17 Thread via GitHub
GOODBOY008 opened a new pull request, #25212: URL: https://github.com/apache/flink/pull/25212 Changes: - Update flink build doc with maven wrapper. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Assigned] (FLINK-36081) Flink CDC MySQL source connector missing some columns data of newly added tables

2024-08-17 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36081: -- Assignee: Mingya Wang > Flink CDC MySQL source connector missing some columns data of newly a

[jira] [Updated] (FLINK-36082) Fix NotSerializableException for KafkaDataSink

2024-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36082: --- Labels: pull-request-available (was: ) > Fix NotSerializableException for KafkaDataSink > -

[PR] [FLINK-36082][pipeline-connector][kafka] fix NotSerializableException for KafkaDataSink. [flink-cdc]

2024-08-17 Thread via GitHub
lvyanquan opened a new pull request, #3549: URL: https://github.com/apache/flink-cdc/pull/3549 Avoiding using lambda class. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Assigned] (FLINK-36082) Fix NotSerializableException for KafkaDataSink

2024-08-17 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-36082: -- Assignee: LvYanquan > Fix NotSerializableException for KafkaDataSink > --

[jira] [Commented] (FLINK-36082) Fix NotSerializableException for KafkaDataSink

2024-08-17 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874607#comment-17874607 ] Leonard Xu commented on FLINK-36082: Thanks [~kunni] , assigned to you > Fix NotSer

[jira] [Resolved] (FLINK-35638) Modify OceanBase Docker container to make the test cases runnable on non-Linux systems

2024-08-17 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong resolved FLINK-35638. - Fix Version/s: cdc-3.3.0 Resolution: Resolved Merged to master via : cbb33bb8708d

[jira] [Assigned] (FLINK-35638) Modify OceanBase Docker container to make the test cases runnable on non-Linux systems

2024-08-17 Thread Zhongqiang Gong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongqiang Gong reassigned FLINK-35638: --- Assignee: He Wang > Modify OceanBase Docker container to make the test cases runnab

Re: [PR] [FLINK-35638] Refactor OceanBase test cases and remove dependency on host network [flink-cdc]

2024-08-17 Thread via GitHub
GOODBOY008 merged PR #3439: URL: https://github.com/apache/flink-cdc/pull/3439 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.

[jira] [Commented] (FLINK-36082) Fix NotSerializableException for KafkaDataSink

2024-08-17 Thread LvYanquan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874601#comment-17874601 ] LvYanquan commented on FLINK-36082: --- I've found that it may related to lambda class in

[jira] [Created] (FLINK-36082) Fix NotSerializableException for KafkaDataSink

2024-08-17 Thread LvYanquan (Jira)
LvYanquan created FLINK-36082: - Summary: Fix NotSerializableException for KafkaDataSink Key: FLINK-36082 URL: https://issues.apache.org/jira/browse/FLINK-36082 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-36081) Flink CDC MySQL source connector missing some columns data of newly added tables

2024-08-17 Thread Mingya Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874600#comment-17874600 ] Mingya Wang commented on FLINK-36081: - ok, my pleasure, I have submitted a PR to fix

[jira] [Updated] (FLINK-36081) Flink CDC MySQL source connector missing some columns data of newly added tables

2024-08-17 Thread Mingya Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingya Wang updated FLINK-36081: Labels: mysql-cdc-connector pull-request-available (was: pull-request-available) > Flink CDC MyS

[jira] [Updated] (FLINK-36081) Flink CDC MySQL source connector missing some columns data of newly added tables

2024-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36081: --- Labels: pull-request-available (was: ) > Flink CDC MySQL source connector missing some colu

[PR] [FLINK-36081][cdc-base][mysql] Fix that MySQL source connector missing some columns data of newly added tables [flink-cdc]

2024-08-17 Thread via GitHub
kevinwangcs opened a new pull request, #3548: URL: https://github.com/apache/flink-cdc/pull/3548 **Problem Description:** When adding a new table, the Flink CDC MySQL source connector experiences missing data for some columns of the newly added table. **Reproduction Scenario:**

[jira] [Commented] (FLINK-36081) Flink CDC MySQL source connector missing some columns data of newly added tables

2024-08-17 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874599#comment-17874599 ] Leonard Xu commented on FLINK-36081: Thanks for reporting this issue, [~kevinwang] ,

[jira] [Created] (FLINK-36081) Flink CDC MySQL source connector missing some columns data of newly added tables

2024-08-17 Thread Mingya Wang (Jira)
Mingya Wang created FLINK-36081: --- Summary: Flink CDC MySQL source connector missing some columns data of newly added tables Key: FLINK-36081 URL: https://issues.apache.org/jira/browse/FLINK-36081 Projec

Re: [PR] [FLINK-30481][FLIP-277] GlueCatalog Implementation [flink-connector-aws]

2024-08-17 Thread via GitHub
foxus commented on PR #47: URL: https://github.com/apache/flink-connector-aws/pull/47#issuecomment-2295043353 @Samrat002, thanks for agreeing to collaborate, I've resolved some of the comments but left it as a separate commit to allow you to review and squash if you're happy whilst you're

Re: [PR] [FLINK-30481][FLIP-277] GlueCatalog Implementation [flink-connector-aws]

2024-08-17 Thread via GitHub
foxus commented on code in PR #47: URL: https://github.com/apache/flink-connector-aws/pull/47#discussion_r1720860598 ## flink-catalog-aws/flink-catalog-aws-glue/src/main/java/org/apache/flink/table/catalog/glue/TypeMapper.java: ## @@ -0,0 +1,124 @@ +/* + * Licensed to the Apach

Re: [PR] [FLINK-30481][FLIP-277] GlueCatalog Implementation [flink-connector-aws]

2024-08-17 Thread via GitHub
foxus commented on code in PR #47: URL: https://github.com/apache/flink-connector-aws/pull/47#discussion_r1720844609 ## flink-catalog-aws/flink-catalog-aws-glue/src/main/java/org/apache/flink/table/catalog/glue/operator/GlueFunctionOperator.java: ## @@ -0,0 +1,272 @@ +/* + * Li

[jira] [Commented] (FLINK-29991) KinesisFirehoseSinkTest#firehoseSinkFailsWhenUnableToConnectToRemoteService failed

2024-08-17 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874478#comment-17874478 ] Ahmed Hamdy commented on FLINK-29991: - Since we externalised aws connectors and the

[jira] [Commented] (FLINK-29031) FlinkKinesisConsumerTest.testSourceSynchronization failed with AssertionFailedError

2024-08-17 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874477#comment-17874477 ] Ahmed Hamdy commented on FLINK-29031: - Given the connectors are now externalized and

[jira] [Commented] (FLINK-26058) KinesisDynamicTableFactory implements DynamicSourceFactory but uses sink options

2024-08-17 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874476#comment-17874476 ] Ahmed Hamdy commented on FLINK-26058: - This is not a bug > KinesisDynamicTableFacto

[jira] [Closed] (FLINK-26058) KinesisDynamicTableFactory implements DynamicSourceFactory but uses sink options

2024-08-17 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hamdy closed FLINK-26058. --- Resolution: Not A Problem > KinesisDynamicTableFactory implements DynamicSourceFactory but uses sink

Re: [PR] [FLINK-35401] Add Sqs Table API connector [flink-connector-aws]

2024-08-17 Thread via GitHub
vahmed-hamdy commented on PR #155: URL: https://github.com/apache/flink-connector-aws/pull/155#issuecomment-2294817367 @hlteoh37 Since you reviewed the datastream connector, could you please take a look? -- This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Created] (FLINK-36080) Add SQL Connector for SQS

2024-08-17 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-36080: --- Summary: Add SQL Connector for SQS Key: FLINK-36080 URL: https://issues.apache.org/jira/browse/FLINK-36080 Project: Flink Issue Type: Sub-task Repo

[jira] [Created] (FLINK-36079) Add Documentation for SQS Table API connector

2024-08-17 Thread Ahmed Hamdy (Jira)
Ahmed Hamdy created FLINK-36079: --- Summary: Add Documentation for SQS Table API connector Key: FLINK-36079 URL: https://issues.apache.org/jira/browse/FLINK-36079 Project: Flink Issue Type: Sub-t

[jira] [Updated] (FLINK-35401) Add SQS Table API support

2024-08-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-35401: --- Labels: pull-request-available (was: ) > Add SQS Table API support > --

[PR] [FLINK-35401] Add Sqs Table API connector [flink-connector-aws]

2024-08-17 Thread via GitHub
vahmed-hamdy opened a new pull request, #155: URL: https://github.com/apache/flink-connector-aws/pull/155 ## Purpose of the change Implements the Table API for the Sqs Sink Connector. ## Verifying this change - Added unit tests - Manually verified by running th

[jira] [Commented] (FLINK-35886) Incorrect watermark idleness timeout accounting when subtask is backpressured/blocked

2024-08-17 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17874458#comment-17874458 ] Piotr Nowojski commented on FLINK-35886: Merged to master as 308f05a911d..5f6200

Re: [PR] [FLINK-35886][task] Fix watermark idleness timeout accounting when subtask is backpressured/blocked [flink]

2024-08-17 Thread via GitHub
pnowojski merged PR #25167: URL: https://github.com/apache/flink/pull/25167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

[PR] [Mysql Pipline] Support mysql pipline rate limit [flink-cdc]

2024-08-17 Thread via GitHub
gaoyan1998 opened a new pull request, #3547: URL: https://github.com/apache/flink-cdc/pull/3547 This PR Support speed rate, Prevent too much data in the initial stage from causing pressure downstream usageļ¼š ```yaml source: type: mysql sink: