Re: [PR] [FLINK-35822] Introduce DESCRIBE FUNCTION [flink]

2024-10-14 Thread via GitHub
nateab commented on code in PR #25115: URL: https://github.com/apache/flink/pull/25115#discussion_r1800019486 ## flink-table/flink-sql-client/src/test/resources/sql/function.q: ## @@ -346,3 +346,159 @@ show user functions; SHOW JARS; Empty set !ok + +# ===

[jira] [Created] (FLINK-36532) Kafka group offsets are not committed on stop with savepoint

2024-10-14 Thread LEONID ILYEVSKY (Jira)
LEONID ILYEVSKY created FLINK-36532: --- Summary: Kafka group offsets are not committed on stop with savepoint Key: FLINK-36532 URL: https://issues.apache.org/jira/browse/FLINK-36532 Project: Flink

Re: [PR] [FLINK-35822] Introduce DESCRIBE FUNCTION [flink]

2024-10-14 Thread via GitHub
nateab commented on code in PR #25115: URL: https://github.com/apache/flink/pull/25115#discussion_r1800063746 ## flink-table/flink-sql-client/src/test/resources/sql/function.q: ## @@ -346,3 +346,159 @@ show user functions; SHOW JARS; Empty set !ok + +# ===

Re: [PR] [FLINK-35822] Introduce DESCRIBE FUNCTION [flink]

2024-10-14 Thread via GitHub
nateab commented on code in PR #25115: URL: https://github.com/apache/flink/pull/25115#discussion_r1800150565 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/DescribeFunctionOperation.java: ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache S

Re: [PR] [FLINK-35016] catalog changes for model resource [flink]

2024-10-14 Thread via GitHub
lihaosky commented on PR #25036: URL: https://github.com/apache/flink/pull/25036#issuecomment-2412469319 Close in favor of https://github.com/apache/flink/pull/25211 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [FLINK-35016] catalog changes for model resource [flink]

2024-10-14 Thread via GitHub
lihaosky closed pull request #25036: [FLINK-35016] catalog changes for model resource URL: https://github.com/apache/flink/pull/25036 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] [FLINK-35822] Introduce DESCRIBE FUNCTION [flink]

2024-10-14 Thread via GitHub
nateab commented on code in PR #25115: URL: https://github.com/apache/flink/pull/25115#discussion_r1800082399 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/DescribeFunctionOperation.java: ## @@ -0,0 +1,125 @@ +/* + * Licensed to the Apache S

Re: [PR] [FLINK-35016] catalog changes for model resource [flink]

2024-10-14 Thread via GitHub
lihaosky commented on code in PR #25211: URL: https://github.com/apache/flink/pull/25211#discussion_r1800369200 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/catalog/CatalogModel.java: ## @@ -0,0 +1,84 @@ +/* + * Licensed to the Apache Software Foundatio

[jira] [Created] (FLINK-36533) An exception occurs when using the taskmanager.data.bind-port

2024-10-14 Thread five (Jira)
five created FLINK-36533: Summary: An exception occurs when using the taskmanager.data.bind-port Key: FLINK-36533 URL: https://issues.apache.org/jira/browse/FLINK-36533 Project: Flink Issue Type: Bu

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-10-14 Thread via GitHub
beryllw commented on code in PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639#discussion_r1797628800 ## flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon/src/main/java/org/apache/flink/cdc/connectors/paimon/sink/v2/PaimonCommitter.java:

Re: [PR] [FLINK-36510][runtime] Support partial lineage info collection [flink]

2024-10-14 Thread via GitHub
FangYongs commented on PR #25440: URL: https://github.com/apache/flink/pull/25440#issuecomment-2412784324 Thanks @HuangZhenQiu , LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-36510][runtime] Support partial lineage info collection [flink]

2024-10-14 Thread via GitHub
FangYongs merged PR #25440: URL: https://github.com/apache/flink/pull/25440 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apa

Re: [PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-14 Thread via GitHub
leonardBang commented on PR #757: URL: https://github.com/apache/flink-web/pull/757#issuecomment-2412946416 @AHeise Could you change the PR from DRAT to READY for review ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

Re: [PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-14 Thread via GitHub
leonardBang commented on PR #757: URL: https://github.com/apache/flink-web/pull/757#issuecomment-2412947976 I changed the status and thus we can start following review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36405: --- Labels: pull-request-available (was: ) > Fix startup issues on kerberos clusters >

Re: [PR] [FLINK-36405][runtime][security] Fix startup issues on kerberos clusters. [flink]

2024-10-14 Thread via GitHub
gaborgsomogyi commented on code in PR #25428: URL: https://github.com/apache/flink/pull/25428#discussion_r1800513124 ## flink-connectors/flink-connector-hive/src/main/resources/META-INF/services/org.apache.hadoop.security.token.TokenIdentifier: ## @@ -0,0 +1,16 @@ +# Licensed to

Re: [PR] [FLINK-36405][runtime][security] Fix startup issues on kerberos clusters. [flink]

2024-10-14 Thread via GitHub
zhengchenyu commented on code in PR #25428: URL: https://github.com/apache/flink/pull/25428#discussion_r1800525208 ## flink-connectors/flink-connector-hive/src/main/resources/META-INF/services/org.apache.hadoop.security.token.TokenIdentifier: ## @@ -0,0 +1,16 @@ +# Licensed to t

Re: [PR] [FLINK-36405][runtime][security] Fix startup issues on kerberos clusters. [flink]

2024-10-14 Thread via GitHub
zhengchenyu commented on code in PR #25428: URL: https://github.com/apache/flink/pull/25428#discussion_r1800525208 ## flink-connectors/flink-connector-hive/src/main/resources/META-INF/services/org.apache.hadoop.security.token.TokenIdentifier: ## @@ -0,0 +1,16 @@ +# Licensed to t

[jira] [Commented] (FLINK-36534) Upgrade Flink Kubernetes operator to flink-1.20

2024-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889464#comment-17889464 ] Gyula Fora commented on FLINK-36534: Let's do this once 1.20.1 is released > Upgrad

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-36405: - Affects Version/s: (was: 2.0-preview) > Fix startup issues on kerberos clusters > --

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-36405: - Affects Version/s: 2.0-preview > Fix startup issues on kerberos clusters > -

[jira] [Commented] (FLINK-36484) Remove deprecated method `StreamTableEnvironment#registerFunction`

2024-10-14 Thread Ammu Parvathy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889468#comment-17889468 ] Ammu Parvathy commented on FLINK-36484: --- I have started looking into this one. >

[jira] [Commented] (FLINK-36477) Remove deprecated method `BaseExpressions#cast` in table-api-java

2024-10-14 Thread corgy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889473#comment-17889473 ] corgy commented on FLINK-36477: --- I am taking action on this subtask, please assign it to m

[jira] [Commented] (FLINK-36478) Remove deprecated methods `EnvironmentSettings#fromConfiguration` and `EnvironmentSettings#toConfiguration`

2024-10-14 Thread corgy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889475#comment-17889475 ] corgy commented on FLINK-36478: --- I am taking action on this subtask, please assign it to m

[jira] [Commented] (FLINK-36534) Upgrade Flink Kubernetes operator to flink-1.20

2024-10-14 Thread Shailesh Gupta (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889476#comment-17889476 ] Shailesh Gupta commented on FLINK-36534: Sure. Thanks. > Upgrade Flink Kubernet

Re: [PR] [FLINK-36526][state/forst] Optimize the overhead of writing with direct buffer [flink]

2024-10-14 Thread via GitHub
Zakelly commented on PR #25508: URL: https://github.com/apache/flink/pull/25508#issuecomment-2413020131 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-36480) Remove all deprecated methods in `TableConfig`

2024-10-14 Thread corgy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889479#comment-17889479 ] corgy commented on FLINK-36480: --- I am taking action on this subtask, please assign it to m

[jira] [Commented] (FLINK-36483) Remove deprecated method `TableResult#getTableSchema`

2024-10-14 Thread corgy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889485#comment-17889485 ] corgy commented on FLINK-36483: --- I am taking action on this subtask, please assign it to m

Re: [PR] [FLINK-36517][cdc-connect][paimon] use filterAndCommit API for Avoid commit the same datafile duplicate [flink-cdc]

2024-10-14 Thread via GitHub
beryllw commented on PR #3639: URL: https://github.com/apache/flink-cdc/pull/3639#issuecomment-2412713852 Could you please assist in reviewing this PR? Thank you. @lvyanquan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Created] (FLINK-36534) Upgrade Flink Kubernetes operator to flink-1.20

2024-10-14 Thread Shailesh Gupta (Jira)
Shailesh Gupta created FLINK-36534: -- Summary: Upgrade Flink Kubernetes operator to flink-1.20 Key: FLINK-36534 URL: https://issues.apache.org/jira/browse/FLINK-36534 Project: Flink Issue Typ

[jira] [Assigned] (FLINK-36533) An exception occurs when using the taskmanager.data.bind-port

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reassigned FLINK-36533: Assignee: Ferenc Csaky > An exception occurs when using the taskmanager.data.bind-port >

Re: [PR] [FLINK-35822] Introduce DESCRIBE FUNCTION [flink]

2024-10-14 Thread via GitHub
nateab commented on code in PR #25115: URL: https://github.com/apache/flink/pull/25115#discussion_r1800019486 ## flink-table/flink-sql-client/src/test/resources/sql/function.q: ## @@ -346,3 +346,159 @@ show user functions; SHOW JARS; Empty set !ok + +# ===

[jira] [Commented] (FLINK-36531) AutoScaler needs to consider the lag from last checkpoint

2024-10-14 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889404#comment-17889404 ] yuanfenghu commented on FLINK-36531: [~dsaisharath] There is already an optimization

[jira] [Comment Edited] (FLINK-36531) AutoScaler needs to consider the lag from last checkpoint

2024-10-14 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889404#comment-17889404 ] yuanfenghu edited comment on FLINK-36531 at 10/15/24 2:22 AM:

[jira] [Updated] (FLINK-36518) Paimon Sink support per-table property configuration

2024-10-14 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-36518: -- Description: As title. (was: Solved by transform table-options.) > Paimon Sink support per-table prop

[jira] [Updated] (FLINK-36518) Paimon Sink support per-table property configuration

2024-10-14 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang updated FLINK-36518: -- Description: Solved by transform table-options. (was: As title.) > Paimon Sink support per-table prop

[jira] [Commented] (FLINK-36518) Paimon Sink support per-table property configuration

2024-10-14 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889392#comment-17889392 ] JunboWang commented on FLINK-36518: --- Solved by transform table-options. > Paimon Sink

[jira] (FLINK-36518) Paimon Sink support per-table property configuration

2024-10-14 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36518 ] JunboWang deleted comment on FLINK-36518: --- was (Author: JIRAUSER305453): Solved by transform table-options. > Paimon Sink support per-table property configuration > ---

[jira] [Closed] (FLINK-36518) Paimon Sink support per-table property configuration

2024-10-14 Thread JunboWang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JunboWang closed FLINK-36518. - Resolution: Not A Problem Solved by transform table-options. > Paimon Sink support per-table property c

Re: [PR] [FLINK-36528] [Kubernetes Operator] Update org.apache.avro from 1.8.2 to 1.12.0 [flink-kubernetes-operator]

2024-10-14 Thread via GitHub
kartik-3513 commented on PR #901: URL: https://github.com/apache/flink-kubernetes-operator/pull/901#issuecomment-2412922906 I have evaluated updating beam-dependency, we can proceed with that. -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] [FLINK-35016] catalog changes for model resource [flink]

2024-10-14 Thread via GitHub
lihaosky commented on code in PR #25211: URL: https://github.com/apache/flink/pull/25211#discussion_r1800214336 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/CatalogManager.java: ## @@ -1341,6 +1352,293 @@ private void dropTableInternal(

Re: [PR] Add insert-only change stream option [flink-cdc]

2024-10-14 Thread via GitHub
henneberger closed pull request #3562: Add insert-only change stream option URL: https://github.com/apache/flink-cdc/pull/3562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[jira] [Comment Edited] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889188#comment-17889188 ] Chenyu Zheng edited comment on FLINK-36405 at 10/15/24 3:51 AM: --

Re: [PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-10-14 Thread via GitHub
yuxiqian commented on code in PR #3642: URL: https://github.com/apache/flink-cdc/pull/3642#discussion_r1799076504 ## flink-cdc-cli/src/main/java/org/apache/flink/cdc/cli/parser/YamlPipelineDefinitionParser.java: ## @@ -43,7 +28,6 @@ import static org.apache.flink.cdc.common.ut

Re: [PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-10-14 Thread via GitHub
yuxiqian commented on code in PR #3642: URL: https://github.com/apache/flink-cdc/pull/3642#discussion_r1799126412 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/functions/SystemFunctionUtils.java: ## @@ -77,6 +80,53 @@ public static int currentDate(long epochTim

[jira] [Created] (FLINK-36528) Update org.apache.avro : avro dependency

2024-10-14 Thread Kartik Goyal (Jira)
Kartik Goyal created FLINK-36528: Summary: Update org.apache.avro : avro dependency Key: FLINK-36528 URL: https://issues.apache.org/jira/browse/FLINK-36528 Project: Flink Issue Type: Improvem

Re: [PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-10-14 Thread via GitHub
yuxiqian commented on code in PR #3642: URL: https://github.com/apache/flink-cdc/pull/3642#discussion_r1799217964 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/flink/translator/TransformTranslator.java: ## @@ -85,11 +80,45 @@ public DataStream translatePostTr

[jira] [Commented] (FLINK-36476) Remove all deprecated methods under public APIs in table modules

2024-10-14 Thread lajith (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889170#comment-17889170 ] lajith commented on FLINK-36476: Hi @[~xuyangzhong] Can I pick some of the task?. > Rem

Re: [PR] [hotfix] typo in property name httpclinent -> httpclient [flink-kubernetes-operator]

2024-10-14 Thread via GitHub
gyfora merged PR #899: URL: https://github.com/apache/flink-kubernetes-operator/pull/899 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

Re: [PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-10-14 Thread via GitHub
yuxiqian commented on code in PR #3642: URL: https://github.com/apache/flink-cdc/pull/3642#discussion_r1799190408 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/model/ModelUdf.java: ## @@ -0,0 +1,132 @@ +package org.apache.flink.cdc.runtime.operators.m

Re: [PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-10-14 Thread via GitHub
yuxiqian commented on code in PR #3642: URL: https://github.com/apache/flink-cdc/pull/3642#discussion_r1799190408 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/model/ModelUdf.java: ## @@ -0,0 +1,132 @@ +package org.apache.flink.cdc.runtime.operators.m

Re: [PR] [FLINK-36332] Exclude kubernetes-httpclient form API module. [flink-kubernetes-operator]

2024-10-14 Thread via GitHub
gyfora merged PR #900: URL: https://github.com/apache/flink-kubernetes-operator/pull/900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr

[jira] [Updated] (FLINK-36528) Update org.apache.avro : avro dependency

2024-10-14 Thread Kartik Goyal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kartik Goyal updated FLINK-36528: - Description: Update the org.apache.avro : avro package present in flink-beam-example to remedia

Re: [PR] [FLINK-36525] Support for AI Model Integration for Data Processing [flink-cdc]

2024-10-14 Thread via GitHub
yuxiqian commented on code in PR #3642: URL: https://github.com/apache/flink-cdc/pull/3642#discussion_r1799243324 ## flink-cdc-composer/src/main/java/org/apache/flink/cdc/composer/definition/ModelDef.java: ## @@ -0,0 +1,92 @@ +package org.apache.flink.cdc.composer.definition; +

[jira] [Updated] (FLINK-36528) Update org.apache.avro : avro dependency

2024-10-14 Thread Kartik Goyal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kartik Goyal updated FLINK-36528: - Labels: (was: pull-request-available) > Update org.apache.avro : avro dependency > ---

Re: [PR] [BP-1.18][FLINK-36421] [fs] [checkpoint] Sync outputStream before returning handle in FsCheckpointStreamFactory [flink]

2024-10-14 Thread via GitHub
Zakelly commented on PR #25479: URL: https://github.com/apache/flink/pull/25479#issuecomment-2410862308 I guess there is something wrong with CI infra for 1.18. Any thoughts? @JingGe I'd propose merge this since this is a small one. -- This is an automated message from the Apache Git

Re: [PR] [W.I.P] Disable parallel serial operator factory [flink]

2024-10-14 Thread via GitHub
JunRuiLee closed pull request #25506: [W.I.P] Disable parallel serial operator factory URL: https://github.com/apache/flink/pull/25506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[PR] [FLINK-36528] [Kubernetes Operator] Update org.apache.avro from 1.8.2 to 1.12.0 [flink-kubernetes-operator]

2024-10-14 Thread via GitHub
kartik-3513 opened a new pull request, #901: URL: https://github.com/apache/flink-kubernetes-operator/pull/901 ## What is the purpose of the change This PR updates the dependency "org.apache.avro:avro" version from 1.8.2 to 1.12.0 ## Brief change log The transitive d

[jira] [Updated] (FLINK-36528) Update org.apache.avro : avro dependency

2024-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36528: --- Labels: pull-request-available (was: ) > Update org.apache.avro : avro dependency > ---

Re: [PR] Lineage interfaces for kafka connector [flink-connector-kafka]

2024-10-14 Thread via GitHub
boring-cyborg[bot] commented on PR #130: URL: https://github.com/apache/flink-connector-kafka/pull/130#issuecomment-2410887979 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-36405: - Affects Version/s: 1.19.1 1.20.0 (was: 1.9.1)

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky updated FLINK-36405: - Fix Version/s: 2.0.0 1.19.2 1.20.1 > Fix startup issues on

[jira] [Assigned] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reassigned FLINK-36405: Assignee: Ferenc Csaky > Fix startup issues on kerberos clusters > --

Re: [PR] [FLINK-36526][state/forst] Optimize the overhead of writing with direct buffer [flink]

2024-10-14 Thread via GitHub
flinkbot commented on PR #25508: URL: https://github.com/apache/flink/pull/25508#issuecomment-2410366766 ## CI report: * 6e26d14c7081b78d3d21952760ff86ff3c65a896 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-36526][state/forst] Optimize the overhead of writing with direct buffer [flink]

2024-10-14 Thread via GitHub
Zakelly opened a new pull request, #25508: URL: https://github.com/apache/flink/pull/25508 ## What is the purpose of the change Currently, the ForSt gives a direct buffer to `ByteBufferWritableFSDataOutputStream`, where the data will be written one byte by byte. According our perf, t

[jira] [Updated] (FLINK-36526) Optimize the overhead of writing with direct buffer in ForSt

2024-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-36526: --- Labels: pull-request-available (was: ) > Optimize the overhead of writing with direct buffe

Re: [PR] [FLINK-35029][state/forst] Store timer in JVM heap when use async state backend [flink]

2024-10-14 Thread via GitHub
fredia commented on code in PR #25501: URL: https://github.com/apache/flink/pull/25501#discussion_r1798959007 ## flink-runtime/src/main/java/org/apache/flink/streaming/api/operators/StreamOperatorStateHandler.java: ## @@ -244,6 +244,11 @@ void snapshotState(

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated FLINK-36405: - External issue URL: https://github.com/apache/flink/pull/25428 > Fix startup issues on kerberos

Re: [PR] [FLINK-36065][runtime] Support submit stream graph. [flink]

2024-10-14 Thread via GitHub
JunRuiLee commented on PR #25472: URL: https://github.com/apache/flink/pull/25472#issuecomment-2410911107 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889182#comment-17889182 ] Chenyu Zheng commented on FLINK-36405: -- [~fcsaky] Hi, I have submit pr https://gith

[jira] [Updated] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Chenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chenyu Zheng updated FLINK-36405: - External issue URL: (was: https://github.com/apache/flink/pull/25428) > Fix startup issues on

Re: [PR] [FLINK-36523][Connectors/DynamoDB][BugFix] Fixing LATEST behaviour for DDB Connector [flink-connector-aws]

2024-10-14 Thread via GitHub
hlteoh37 commented on code in PR #177: URL: https://github.com/apache/flink-connector-aws/pull/177#discussion_r1799315333 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/enumerator/tracker/SplitTracker.java: ## @@ -89,13

Re: [PR] [FLINK-36523][Connectors/DynamoDB][BugFix] Fixing LATEST behaviour for DDB Connector [flink-connector-aws]

2024-10-14 Thread via GitHub
hlteoh37 commented on code in PR #177: URL: https://github.com/apache/flink-connector-aws/pull/177#discussion_r1799315333 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/enumerator/tracker/SplitTracker.java: ## @@ -89,13

[jira] [Assigned] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferenc Csaky reassigned FLINK-36405: Assignee: Chenyu Zheng (was: Ferenc Csaky) > Fix startup issues on kerberos clusters > -

[jira] [Commented] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889184#comment-17889184 ] Ferenc Csaky commented on FLINK-36405: -- Ah very nice, assigned it to you! Can you p

[jira] [Comment Edited] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889184#comment-17889184 ] Ferenc Csaky edited comment on FLINK-36405 at 10/14/24 11:32 AM: -

[jira] [Comment Edited] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889184#comment-17889184 ] Ferenc Csaky edited comment on FLINK-36405 at 10/14/24 11:33 AM: -

[jira] [Comment Edited] (FLINK-36405) Fix startup issues on kerberos clusters

2024-10-14 Thread Ferenc Csaky (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889184#comment-17889184 ] Ferenc Csaky edited comment on FLINK-36405 at 10/14/24 11:33 AM: -

[jira] [Commented] (FLINK-36476) Remove all deprecated methods under public APIs in table modules

2024-10-14 Thread corgy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889109#comment-17889109 ] corgy commented on FLINK-36476: --- Hi [~xuyangzhong] , can you assign me a few subtasks? I w

Re: [PR] [FLINK-33977][runtime] Adaptive scheduler may not minimize the number of TMs during downscaling [flink]

2024-10-14 Thread via GitHub
1996fanrui commented on PR #25218: URL: https://github.com/apache/flink/pull/25218#issuecomment-2410276176 > > May I know that only session mode needs to spreads the workload across as many workers as possible, right? > > Yes, in session mode. @ztison @XComp Thanks for the deta

Re: [PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-14 Thread via GitHub
dannycranmer commented on PR #757: URL: https://github.com/apache/flink-web/pull/757#issuecomment-2410603904 @AHeise we do not usually include the "rebuild website" commit in this PR, this is usually done as a follow up, without PR. Usually the date in the PR is a placeholder and it needs t

Re: [PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-14 Thread via GitHub
dannycranmer commented on PR #757: URL: https://github.com/apache/flink-web/pull/757#issuecomment-2410608441 You are missing a change in the release_archive, see here for example https://github.com/apache/flink-web/pull/737/files -- This is an automated message from the Apache Git Service

[jira] [Commented] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-14 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889156#comment-17889156 ] david radley commented on FLINK-36446: -- [~JunRuiLi] thanks for sharing the backgrou

[jira] [Resolved] (FLINK-36522) Bump mysql-connector-j version

2024-10-14 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-36522. - Resolution: Fixed Merged to main(1.10.0) via: 6c73673811e1207350bd7f589ff5998e2caf97b9 > Bump mysql-con

[jira] [Assigned] (FLINK-36522) Bump mysql-connector-j version

2024-10-14 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-36522: --- Assignee: Kartik Goyal > Bump mysql-connector-j version > -- > >

Re: [PR] [FLINK-36522] [Kubernetes-operator] Bump mysql-connector-java from 8.0.33 to mysql-connecto… [flink-kubernetes-operator]

2024-10-14 Thread via GitHub
1996fanrui merged PR #898: URL: https://github.com/apache/flink-kubernetes-operator/pull/898 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsu

Re: [PR] [FLINK-34467] bump flink version to 1.20.0 [flink-connector-kafka]

2024-10-14 Thread via GitHub
boring-cyborg[bot] commented on PR #111: URL: https://github.com/apache/flink-connector-kafka/pull/111#issuecomment-2410480510 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] [FLINK-34467] bump flink version to 1.20.0 [flink-connector-kafka]

2024-10-14 Thread via GitHub
AHeise merged PR #111: URL: https://github.com/apache/flink-connector-kafka/pull/111 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

Re: [PR] [FLINK-36523][Connectors/DynamoDB][BugFix] Fixing LATEST behaviour for DDB Connector [flink-connector-aws]

2024-10-14 Thread via GitHub
hlteoh37 commented on code in PR #177: URL: https://github.com/apache/flink-connector-aws/pull/177#discussion_r1799008421 ## flink-connector-aws/flink-connector-dynamodb/src/main/java/org/apache/flink/connector/dynamodb/source/enumerator/tracker/SplitTracker.java: ## @@ -89,13

[jira] [Commented] (FLINK-34467) Implement Lineage Interface in Jdbc Connector

2024-10-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889135#comment-17889135 ] Arvid Heise commented on FLINK-34467: - Merged version bump into main as 2dfdae6e8e44

Re: [PR] Upgrade Kafka connector to 3.3.0 [flink-web]

2024-10-14 Thread via GitHub
AHeise closed pull request #757: Upgrade Kafka connector to 3.3.0 URL: https://github.com/apache/flink-web/pull/757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [PR] [FLINK-36474] Support merging timestamp columns when routing [flink-cdc]

2024-10-14 Thread via GitHub
lvyanquan commented on code in PR #3636: URL: https://github.com/apache/flink-cdc/pull/3636#discussion_r1798837548 ## flink-cdc-runtime/src/main/java/org/apache/flink/cdc/runtime/operators/schema/coordinator/SchemaDerivation.java: ## @@ -343,23 +348,14 @@ private List handleCrea

Re: [PR] [FLINK-36466][runtime] Change default value of execution.runtime-mode from STREAMING to AUTOMATIC [flink]

2024-10-14 Thread via GitHub
reswqa closed pull request #25505: [FLINK-36466][runtime] Change default value of execution.runtime-mode from STREAMING to AUTOMATIC URL: https://github.com/apache/flink/pull/25505 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Created] (FLINK-36526) Optimize the overhead of writing with direct buffer in ForSt

2024-10-14 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-36526: --- Summary: Optimize the overhead of writing with direct buffer in ForSt Key: FLINK-36526 URL: https://issues.apache.org/jira/browse/FLINK-36526 Project: Flink

[jira] [Created] (FLINK-36527) Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy

2024-10-14 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-36527: -- Summary: Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy Key: FLINK-36527 URL: https://issues.apache.org/j

[jira] [Updated] (FLINK-36526) Optimize the overhead of writing with direct buffer in ForSt

2024-10-14 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-36526: Description: Currently, the ForSt gives a direct buffer to {{{}ByteBufferWritableFSDataOutputStre

[jira] [Commented] (FLINK-36377) Support the use of the LAST_VALUE aggregate function on ROW type data

2024-10-14 Thread Yang Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889120#comment-17889120 ] Yang Li commented on FLINK-36377: - I'm glad to hear that! Yes, other complex types like

Re: [PR] [FLINK-36526][state/forst] Optimize the overhead of writing with direct buffer [flink]

2024-10-14 Thread via GitHub
fredia commented on code in PR #25508: URL: https://github.com/apache/flink/pull/25508#discussion_r1798973369 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/ByteBufferWritableFSDataOutputStream.java: ## @@ -58,6 +69,22 @@ public vo

Re: [PR] [FLINK-36526][state/forst] Optimize the overhead of writing with direct buffer [flink]

2024-10-14 Thread via GitHub
fredia commented on code in PR #25508: URL: https://github.com/apache/flink/pull/25508#discussion_r1798978105 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/fs/ByteBufferWritableFSDataOutputStream.java: ## @@ -58,6 +69,22 @@ public vo

[jira] [Assigned] (FLINK-36527) Introduce a parameter to support the autoscaler to adopt a more aggressive strategy when Source or upstream shuffle is keyBy

2024-10-14 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-36527: --- Assignee: yuanfenghu > Introduce a parameter to support the autoscaler to adopt a more aggressive

  1   2   >