[GitHub] [flink] dianfu commented on a diff in pull request #19988: [FLINK-28092][table] Support ASCII and CHR built-in function in the Table API

2022-06-22 Thread GitBox
dianfu commented on code in PR #19988: URL: https://github.com/apache/flink/pull/19988#discussion_r904635241 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/BaseExpressions.java: ## @@ -1010,6 +1012,16 @@ public OutType toBase64() {

[GitHub] [flink] lsyldliu commented on pull request #20001: [FLINK-27659][table] Planner support to use jar which is registered by 'CREATE FUNTION USING JAR' syntax

2022-06-22 Thread GitBox
lsyldliu commented on PR #20001: URL: https://github.com/apache/flink/pull/20001#issuecomment-1164021562 Regarding the modification of runtime, I’ve broken it down into a separate PR: https://github.com/apache/flink/pull/20057 -- This is an automated message from the Apache Git Service. T

[GitHub] [flink] flinkbot commented on pull request #20057: [FLINK-28213][runtime] StreamExecutionEnvironment configure method support override pipeline.jars option

2022-06-22 Thread GitBox
flinkbot commented on PR #20057: URL: https://github.com/apache/flink/pull/20057#issuecomment-1164021474 ## CI report: * b6e78706f6f0dd219a518d28b1d99db0d4daad32 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #20056: [FLINK-28142][runtime] Enrich TaskManagerLocation with node information

2022-06-22 Thread GitBox
flinkbot commented on PR #20056: URL: https://github.com/apache/flink/pull/20056#issuecomment-1164020971 ## CI report: * 1a07fe650d5d0c75a6d651871c1ed92df10e1497 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-28213) StreamExecutionEnvironment configure method support override pipeline.jars option

2022-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28213: --- Labels: pull-request-available (was: ) > StreamExecutionEnvironment configure method suppor

[GitHub] [flink] lsyldliu opened a new pull request, #20057: [FLINK-28213][runtime] StreamExecutionEnvironment configure method support override pipeline.jars option

2022-06-22 Thread GitBox
lsyldliu opened a new pull request, #20057: URL: https://github.com/apache/flink/pull/20057 ## What is the purpose of the change StreamExecutionEnvironment configure method support override pipeline.jars option. The background is that table module introduce `create function using jar

[jira] [Updated] (FLINK-28142) Enrich TaskManagerLocation with node information

2022-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28142: --- Labels: pull-request-available (was: ) > Enrich TaskManagerLocation with node information >

[GitHub] [flink] wanglijie95 opened a new pull request, #20056: [FLINK-28142][runtime] Enrich TaskManagerLocation with node information

2022-06-22 Thread GitBox
wanglijie95 opened a new pull request, #20056: URL: https://github.com/apache/flink/pull/20056 ## What is the purpose of the change In order to support blocking nodes, it is necessary to know the node where the task is located. To do that, we need to add a node identifier into TaskManage

[jira] [Commented] (FLINK-28216) Hadoop S3FileSystemFactory does not honor fs.s3.impl

2022-06-22 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557845#comment-17557845 ] Martijn Visser commented on FLINK-28216: [~prabhujoseph] Can you elaborate a bit

[GitHub] [flink-ml] lindong28 merged pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
lindong28 merged PR #114: URL: https://github.com/apache/flink-ml/pull/114 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

[GitHub] [flink-ml] lindong28 commented on pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
lindong28 commented on PR #114: URL: https://github.com/apache/flink-ml/pull/114#issuecomment-1164011174 Thanks for the update. LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Comment Edited] (FLINK-28214) ArrayDataSerializer can not be reused to copy customized type of array data

2022-06-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557840#comment-17557840 ] Weijie Guo edited comment on FLINK-28214 at 6/23/22 6:13 AM: -

[jira] [Commented] (FLINK-28214) ArrayDataSerializer can not be reused to copy customized type of array data

2022-06-22 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557840#comment-17557840 ] Weijie Guo commented on FLINK-28214: Hi [~yittg], I'm not particularly sure why the

[jira] [Commented] (FLINK-28212) IndexOutOfBoundsException is thrown when project contains window which dosen't refer all fields of input when using Hive dialect

2022-06-22 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557839#comment-17557839 ] luoyuxia commented on FLINK-28212: -- To fix it. The idea is straghtforward, make sure th

[jira] [Comment Edited] (FLINK-28212) IndexOutOfBoundsException is thrown when project contains window which dosen't refer all fields of input when using Hive dialect

2022-06-22 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557839#comment-17557839 ] luoyuxia edited comment on FLINK-28212 at 6/23/22 6:09 AM: --- To

[jira] [Commented] (FLINK-28187) Duplicate job submission for FlinkSessionJob

2022-06-22 Thread Aitozi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557837#comment-17557837 ] Aitozi commented on FLINK-28187: OK, I will work on it in this way > Duplicate job subm

[jira] [Updated] (FLINK-28212) IndexOutOfBoundsException is thrown when project contains window which dosen't refer all fields of input when using Hive dialect

2022-06-22 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoyuxia updated FLINK-28212: - Description: Can be reproduced by following sql when using Hive dialect: {code:java} CREATE TABLE alltyp

[jira] [Commented] (FLINK-28216) Hadoop S3FileSystemFactory does not honor fs.s3.impl

2022-06-22 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557834#comment-17557834 ] Prabhu Joseph commented on FLINK-28216: --- [~martijnvisser] Could you please make me

[jira] [Commented] (FLINK-28187) Duplicate job submission for FlinkSessionJob

2022-06-22 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557833#comment-17557833 ] Gyula Fora commented on FLINK-28187: I think the resource UID would work for session

[jira] [Commented] (FLINK-28187) Duplicate job submission for FlinkSessionJob

2022-06-22 Thread Aitozi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557828#comment-17557828 ] Aitozi commented on FLINK-28187: I think it over again the generation will make check wh

[jira] [Created] (FLINK-28216) Hadoop S3FileSystemFactory does not honor fs.s3.impl

2022-06-22 Thread Prabhu Joseph (Jira)
Prabhu Joseph created FLINK-28216: - Summary: Hadoop S3FileSystemFactory does not honor fs.s3.impl Key: FLINK-28216 URL: https://issues.apache.org/jira/browse/FLINK-28216 Project: Flink Issue

[GitHub] [flink] flinkbot commented on pull request #20055: [FLINK-28215][Buildsystem] Update Maven Surefire plugin to 3.0.0-M7

2022-06-22 Thread GitBox
flinkbot commented on PR #20055: URL: https://github.com/apache/flink/pull/20055#issuecomment-1163981586 ## CI report: * b5d912bea15a3b990e6cd3cd5ab8cda1828e221b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-28209) KafkaSink with EXACTLY_ONCE produce reduplicate data(flink kafka connector1.14.4)

2022-06-22 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-28209: --- Component/s: Connectors / Kafka > KafkaSink with EXACTLY_ONCE produce reduplicate data(flin

[jira] [Updated] (FLINK-24666) Add job level "table.exec.state-stale.error-handling" option and apply to related stateful stream operators

2022-06-22 Thread lincoln lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lincoln lee updated FLINK-24666: Description: In stream processing, records will be deleted when exceed state ttl (if configured),

[jira] [Commented] (FLINK-27745) ClientUtilsTest.uploadAndSetUserArtifacts failed with NoClassDefFoundError

2022-06-22 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557825#comment-17557825 ] Martijn Visser commented on FLINK-27745: https://dev.azure.com/apache-flink/apac

[jira] [Updated] (FLINK-28215) Bump Maven Surefire plugin to 3.0.0-M7

2022-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28215: --- Labels: pull-request-available (was: ) > Bump Maven Surefire plugin to 3.0.0-M7 > -

[GitHub] [flink] MartijnVisser opened a new pull request, #20055: [FLINK-28215][Buildsystem] Update Maven Surefire plugin to 3.0.0-M7

2022-06-22 Thread GitBox
MartijnVisser opened a new pull request, #20055: URL: https://github.com/apache/flink/pull/20055 ## What is the purpose of the change * Update Maven Surefire plugin to latest version ## Brief change log * Bumped dependency in main `pom.xml` ## Verifying this change

[jira] [Created] (FLINK-28215) Bump Maven Surefire plugin to 3.0.0-M7

2022-06-22 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28215: -- Summary: Bump Maven Surefire plugin to 3.0.0-M7 Key: FLINK-28215 URL: https://issues.apache.org/jira/browse/FLINK-28215 Project: Flink Issue Type: Techni

[jira] [Commented] (FLINK-28187) Duplicate job submission for FlinkSessionJob

2022-06-22 Thread Aitozi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557824#comment-17557824 ] Aitozi commented on FLINK-28187: > For sessionjobs we need to cover both using the jobid

[jira] [Commented] (FLINK-28214) ArrayDataSerializer can not be reused to copy customized type of array data

2022-06-22 Thread Yi Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557819#comment-17557819 ] Yi Tang commented on FLINK-28214: - [~gyfora] Would you mind checking this issue? > Arra

[GitHub] [flink] fsk119 commented on a diff in pull request #19849: [FLINK-27767][sql-gateway] Introduce Endpoint API and utils

2022-06-22 Thread GitBox
fsk119 commented on code in PR #19849: URL: https://github.com/apache/flink/pull/19849#discussion_r904573975 ## flink-table/flink-sql-gateway/src/test/java/org/apache/flink/table/gateway/service/session/SessionManagerTest.java: ## @@ -0,0 +1,109 @@ +/* + * Licensed to the Apache

[jira] [Created] (FLINK-28214) ArrayDataSerializer can not be reused to copy customized type of array data

2022-06-22 Thread Yi Tang (Jira)
Yi Tang created FLINK-28214: --- Summary: ArrayDataSerializer can not be reused to copy customized type of array data Key: FLINK-28214 URL: https://issues.apache.org/jira/browse/FLINK-28214 Project: Flink

[jira] [Commented] (FLINK-28187) Duplicate job submission for FlinkSessionJob

2022-06-22 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557814#comment-17557814 ] Gyula Fora commented on FLINK-28187: Thanks for the comment. Identifying failed firs

[GitHub] [flink] dianfu commented on a diff in pull request #20029: [FLINK-27392][cep] CEP Pattern supports definition of the maximum time gap between events

2022-06-22 Thread GitBox
dianfu commented on code in PR #20029: URL: https://github.com/apache/flink/pull/20029#discussion_r904446329 ## flink-libraries/flink-cep/src/main/java/org/apache/flink/cep/pattern/Pattern.java: ## @@ -579,6 +662,16 @@ private void checkIfPreviousPatternGreedy() { }

[jira] [Commented] (FLINK-28210) FlinkSessionJob fails after FlinkDeployment is updated

2022-06-22 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557800#comment-17557800 ] Gyula Fora commented on FLINK-28210: This is expected if HA is not configured for th

[GitHub] [flink-ml] zhipeng93 commented on pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
zhipeng93 commented on PR #114: URL: https://github.com/apache/flink-ml/pull/114#issuecomment-1163919452 @lindong28 @yunfengzhou-hub Thanks for the comments. I have addressed the comments in the latest push -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
zhipeng93 commented on code in PR #114: URL: https://github.com/apache/flink-ml/pull/114#discussion_r904510367 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorassembler/VectorAssembler.java: ## @@ -80,24 +82,68 @@ public Table[] transform(Table... inputs) {

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
zhipeng93 commented on code in PR #114: URL: https://github.com/apache/flink-ml/pull/114#discussion_r904510188 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorassembler/VectorAssembler.java: ## @@ -80,24 +82,68 @@ public Table[] transform(Table... inputs) {

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
zhipeng93 commented on code in PR #114: URL: https://github.com/apache/flink-ml/pull/114#discussion_r904509535 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorassembler/VectorAssembler.java: ## @@ -80,24 +82,68 @@ public Table[] transform(Table... inputs) {

[jira] [Updated] (FLINK-28212) IndexOutOfBoundsException is thrown when project contains window which dosen't refer all fields of input when using Hive dialect

2022-06-22 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoyuxia updated FLINK-28212: - Description: Can be reproduced by following sql {code:java} CREATE TABLE alltypesorc(

[jira] [Created] (FLINK-28213) StreamExecutionEnvironment configure method support override pipeline.jars option

2022-06-22 Thread dalongliu (Jira)
dalongliu created FLINK-28213: - Summary: StreamExecutionEnvironment configure method support override pipeline.jars option Key: FLINK-28213 URL: https://issues.apache.org/jira/browse/FLINK-28213 Project:

[jira] [Created] (FLINK-28212) IndexOutOfBoundsException is thrown when project contains window which dosen't refer all fields of input when using Hive dialect

2022-06-22 Thread luoyuxia (Jira)
luoyuxia created FLINK-28212: Summary: IndexOutOfBoundsException is thrown when project contains window which dosen't refer all fields of input when using Hive dialect Key: FLINK-28212 URL: https://issues.apache.org/j

[jira] [Commented] (FLINK-27963) FlinkRuntimeException in KafkaSink causes a Flink job to hang

2022-06-22 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557795#comment-17557795 ] Qingsheng Ren commented on FLINK-27963: --- It will take some time to get this featur

[jira] [Closed] (FLINK-28211) Rename Schema to TableSchema

2022-06-22 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28211. Resolution: Fixed master: 5a34efce8fadf96fc05194b28f62f0680a5afa62 > Rename Schema to TableSchema

[GitHub] [flink-table-store] JingsongLi closed pull request #172: [FLINK-28211] Rename Schema to TableSchema

2022-06-22 Thread GitBox
JingsongLi closed pull request #172: [FLINK-28211] Rename Schema to TableSchema URL: https://github.com/apache/flink-table-store/pull/172 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (FLINK-28211) Rename Schema to TableSchema

2022-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28211: --- Labels: pull-request-available (was: ) > Rename Schema to TableSchema > ---

[GitHub] [flink-table-store] JingsongLi opened a new pull request, #172: [FLINK-28211] Rename Schema to TableSchema

2022-06-22 Thread GitBox
JingsongLi opened a new pull request, #172: URL: https://github.com/apache/flink-table-store/pull/172 There are some systems that use schema as a concept of database, so the Schema class will be very confuse in this case, it is better to rename it as TableSchema. -- This is an automated

[jira] [Assigned] (FLINK-28126) Iteration gets stuck when replayable datastream and its downstream operator have different parallelism

2022-06-22 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-28126: --- Assignee: Yun Gao > Iteration gets stuck when replayable datastream and its downstream operator >

[jira] [Created] (FLINK-28211) Rename Schema to TableSchema

2022-06-22 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28211: Summary: Rename Schema to TableSchema Key: FLINK-28211 URL: https://issues.apache.org/jira/browse/FLINK-28211 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-28126) Iteration gets stuck when replayable datastream and its downstream operator have different parallelism

2022-06-22 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557792#comment-17557792 ] Yun Gao commented on FLINK-28126: - Very thanks [~xuannan] for the investigation, I'll ha

[GitHub] [flink] flinkbot commented on pull request #20054: [FLINK-28135][runtime] Introduce SlowTaskDetector

2022-06-22 Thread GitBox
flinkbot commented on PR #20054: URL: https://github.com/apache/flink/pull/20054#issuecomment-1163888460 ## CI report: * 99cadbcf9a3e396ce05525feeb53f6fea17943cf UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-28135) Introduce SlowTaskDetector

2022-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28135: --- Labels: pull-request-available (was: ) > Introduce SlowTaskDetector > -

[GitHub] [flink] 6591812 opened a new pull request, #20054: [FLINK-28135][runtime] Introduce SlowTaskDetector

2022-06-22 Thread GitBox
6591812 opened a new pull request, #20054: URL: https://github.com/apache/flink/pull/20054 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on

[jira] [Created] (FLINK-28210) FlinkSessionJob fails after FlinkDeployment is updated

2022-06-22 Thread Daniel Crowe (Jira)
Daniel Crowe created FLINK-28210: Summary: FlinkSessionJob fails after FlinkDeployment is updated Key: FLINK-28210 URL: https://issues.apache.org/jira/browse/FLINK-28210 Project: Flink Issue

[jira] [Updated] (FLINK-28209) KafkaSink with EXACTLY_ONCE produce reduplicate data(flink kafka connector1.14.4)

2022-06-22 Thread tanyao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tanyao updated FLINK-28209: --- Description: I'm trying to read mysql binlog and transport it to kafka; here is what i'm using : *Flink: 1

[jira] [Updated] (FLINK-28209) KafkaSink with EXACTLY_ONCE produce reduplicate data(flink kafka connector1.14.4)

2022-06-22 Thread tanyao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tanyao updated FLINK-28209: --- Description: I'm trying to read mysql binlog and transport it to kafka; here is what i'm using : *Flink: 1

[jira] [Created] (FLINK-28209) KafkaSink with EXACTLY_ONCE produce reduplicate data(flink kafka connector1.14.4)

2022-06-22 Thread tanyao (Jira)
tanyao created FLINK-28209: -- Summary: KafkaSink with EXACTLY_ONCE produce reduplicate data(flink kafka connector1.14.4) Key: FLINK-28209 URL: https://issues.apache.org/jira/browse/FLINK-28209 Project: Flink

[GitHub] [flink] PatrickRen closed pull request #17804: [FLINK-24376][runtime] Use operator name for constructing OperatorCoordinatorProvider instead of chained name

2022-06-22 Thread GitBox
PatrickRen closed pull request #17804: [FLINK-24376][runtime] Use operator name for constructing OperatorCoordinatorProvider instead of chained name URL: https://github.com/apache/flink/pull/17804 -- This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [flink] PatrickRen merged pull request #19904: [FLINK-27865][docs] Add example for configuring SASL and SSL in Kafka DataStream and SQL connector

2022-06-22 Thread GitBox
PatrickRen merged PR #19904: URL: https://github.com/apache/flink/pull/19904 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.ap

[jira] [Commented] (FLINK-28187) Duplicate job submission for FlinkSessionJob

2022-06-22 Thread Aitozi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557782#comment-17557782 ] Aitozi commented on FLINK-28187: [~gyfora] I add one comment here: [https://github.com/

[jira] [Updated] (FLINK-28205) memory leak in the timing flush of the jdbc-connector

2022-06-22 Thread michaelxiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] michaelxiang updated FLINK-28205: - Summary: memory leak in the timing flush of the jdbc-connector (was: memory leak in the timing

[jira] [Reopened] (FLINK-28205) memory leak in the timing refresh of the jdbc-connector

2022-06-22 Thread michaelxiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] michaelxiang reopened FLINK-28205: -- I changed the language > memory leak in the timing refresh of the jdbc-connector > --

[GitHub] [flink-ml] lindong28 commented on a diff in pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
lindong28 commented on code in PR #114: URL: https://github.com/apache/flink-ml/pull/114#discussion_r904462286 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorassembler/VectorAssembler.java: ## @@ -80,24 +82,68 @@ public Table[] transform(Table... inputs) {

[jira] [Updated] (FLINK-28205) memory leak in the timing refresh of the jdbc-connector

2022-06-22 Thread michaelxiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] michaelxiang updated FLINK-28205: - Description: Bug position: org.apache.flink.connector.jdbc.internal.JdbcBatchingOutputFormat.sc

[jira] [Closed] (FLINK-28129) Add documentation for rewrite data layout after scaling bucket number

2022-06-22 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28129. Resolution: Fixed master: df78da0e428467af3153984199300f049c22878f > Add documentation for rewrit

[GitHub] [flink-table-store] JingsongLi merged pull request #167: [FLINK-28129] Add documentation for rescale bucket

2022-06-22 Thread GitBox
JingsongLi merged PR #167: URL: https://github.com/apache/flink-table-store/pull/167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@

[GitHub] [flink] Myasuka commented on pull request #20028: [hotfix][docs] Remove redundant "." from sample code

2022-06-22 Thread GitBox
Myasuka commented on PR #20028: URL: https://github.com/apache/flink/pull/20028#issuecomment-1163855718 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-25100) RMQSourceITCase failed on azure due to java.io.EOFException

2022-06-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557768#comment-17557768 ] Huang Xingbo commented on FLINK-25100: -- https://dev.azure.com/apache-flink/apache-f

[jira] [Commented] (FLINK-28173) Multiple Parquet format tests are failing with NoSuchMethodError

2022-06-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557764#comment-17557764 ] Huang Xingbo commented on FLINK-28173: -- https://dev.azure.com/apache-flink/apache-f

[jira] [Commented] (FLINK-28207) Disabling webhook should also disable mutator

2022-06-22 Thread Aitozi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557763#comment-17557763 ] Aitozi commented on FLINK-28207: The option is introduced to let user can choose to enab

[jira] [Commented] (FLINK-28206) EOFException on Checkpoint Recovery

2022-06-22 Thread Chenya Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557762#comment-17557762 ] Chenya Zhang commented on FLINK-28206: -- +1 that we are seeing similar exceptions to

[GitHub] [flink-web] HuangXingBo commented on a diff in pull request #554: Release flink 1.15.1

2022-06-22 Thread GitBox
HuangXingBo commented on code in PR #554: URL: https://github.com/apache/flink-web/pull/554#discussion_r904450779 ## _posts/2022-06-29-release-1.15.1.md: ## @@ -0,0 +1,187 @@ +--- +layout: post +title: "Apache Flink 1.15.1 Release Announcement" +date: 2022-06-29T08:00:00.000Z +

[jira] (FLINK-28198) CassandraConnectorITCase#testRaiseCassandraRequestsTimeouts fails with timeout

2022-06-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28198 ] Huang Xingbo deleted comment on FLINK-28198: -- was (Author: hxbks2ks): https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=37037&view=logs&j=4eda0b4a-bd0d-521a-0916-8285b9b

[jira] [Commented] (FLINK-28198) CassandraConnectorITCase#testRaiseCassandraRequestsTimeouts fails with timeout

2022-06-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557761#comment-17557761 ] Huang Xingbo commented on FLINK-28198: -- https://dev.azure.com/apache-flink/apache-f

[jira] [Updated] (FLINK-28198) CassandraConnectorITCase#testRaiseCassandraRequestsTimeouts fails with timeout

2022-06-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huang Xingbo updated FLINK-28198: - Priority: Critical (was: Major) > CassandraConnectorITCase#testRaiseCassandraRequestsTimeouts f

[jira] [Assigned] (FLINK-26891) Emit events for important Deployment / Job changes

2022-06-22 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise reassigned FLINK-26891: Assignee: Thomas Weise (was: Matyas Orhidi) > Emit events for important Deployment / Job

[jira] [Closed] (FLINK-27766) Introduce the framework of the SqlGatewayService

2022-06-22 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-27766. - Fix Version/s: 1.16.0 Resolution: Fixed > Introduce the framework of the SqlGatewayServic

[jira] [Commented] (FLINK-27766) Introduce the framework of the SqlGatewayService

2022-06-22 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557757#comment-17557757 ] Shengkai Fang commented on FLINK-27766: --- master:da08267c2cb29d98e626a867f8e07cb5b8

[GitHub] [flink] fsk119 merged pull request #19823: [FLINK-27766][sql-gateway] Introduce the framework of the SqlGatewayService

2022-06-22 Thread GitBox
fsk119 merged PR #19823: URL: https://github.com/apache/flink/pull/19823 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[jira] [Updated] (FLINK-28208) The method createBatchSink in class HiveTableSink should setParallelism for map operator

2022-06-22 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu updated FLINK-28208: Description: The problem is found when using Adaptive Batch Scheduler. In these, a simple SQL like "select * from

[jira] [Updated] (FLINK-28208) The method createBatchSink in class HiveTableSink should setParallelism for map operator

2022-06-22 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu updated FLINK-28208: Description: The problem is found when using Adaptive Batch Scheduler. In these, a simple SQL like "select * from

[jira] [Created] (FLINK-28208) The method createBatchSink in class HiveTableSink should setParallelism for map operator

2022-06-22 Thread Liu (Jira)
Liu created FLINK-28208: --- Summary: The method createBatchSink in class HiveTableSink should setParallelism for map operator Key: FLINK-28208 URL: https://issues.apache.org/jira/browse/FLINK-28208 Project: Flink

[jira] [Closed] (FLINK-28194) Remove workaround around avro sql jar

2022-06-22 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-28194. --- Resolution: Fixed Merged to master via 40efeb9314fe70bbc600a9131a7031ac193f246d > Remove workaround around

[GitHub] [flink] dianfu merged pull request #20045: [FLINK-28194][python] Remove avro sql jar workaround

2022-06-22 Thread GitBox
dianfu merged PR #20045: URL: https://github.com/apache/flink/pull/20045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[GitHub] [flink-ml] yunfengzhou-hub commented on a diff in pull request #114: [FLINK-27096] Optimize VectorAssembler performance

2022-06-22 Thread GitBox
yunfengzhou-hub commented on code in PR #114: URL: https://github.com/apache/flink-ml/pull/114#discussion_r904423389 ## flink-ml-lib/src/main/java/org/apache/flink/ml/feature/vectorassembler/VectorAssembler.java: ## @@ -80,24 +82,68 @@ public Table[] transform(Table... inputs) {

[GitHub] [flink-table-store] LadyForest closed pull request #167: [FLINK-28129] Add documentation for rescale bucket

2022-06-22 Thread GitBox
LadyForest closed pull request #167: [FLINK-28129] Add documentation for rescale bucket URL: https://github.com/apache/flink-table-store/pull/167 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (FLINK-27963) FlinkRuntimeException in KafkaSink causes a Flink job to hang

2022-06-22 Thread Dmytro (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557728#comment-17557728 ] Dmytro commented on FLINK-27963: [~renqs], do know by any change when you will be able t

[jira] [Commented] (FLINK-28207) Disabling webhook should also disable mutator

2022-06-22 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-28207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557677#comment-17557677 ] Márton Balassi commented on FLINK-28207: [~aitozi] do you have any concerns? >

[jira] [Created] (FLINK-28207) Disabling webhook should also disable mutator

2022-06-22 Thread Jira
Márton Balassi created FLINK-28207: -- Summary: Disabling webhook should also disable mutator Key: FLINK-28207 URL: https://issues.apache.org/jira/browse/FLINK-28207 Project: Flink Issue Type:

[jira] [Updated] (FLINK-28204) Deleting a FlinkDeployment results in an error on the pod

2022-06-22 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-28204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Márton Balassi updated FLINK-28204: --- Fix Version/s: kubernetes-operator-1.0.1 > Deleting a FlinkDeployment results in an error on

[jira] [Created] (FLINK-28206) EOFException on Checkpoint Recovery

2022-06-22 Thread uharaqo (Jira)
uharaqo created FLINK-28206: --- Summary: EOFException on Checkpoint Recovery Key: FLINK-28206 URL: https://issues.apache.org/jira/browse/FLINK-28206 Project: Flink Issue Type: Bug Component

[jira] [Commented] (FLINK-28199) Failures on YARNHighAvailabilityITCase.testClusterClientRetrieval and YARNHighAvailabilityITCase.testKillYarnSessionClusterEntrypoint

2022-06-22 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17557606#comment-17557606 ] Martijn Visser commented on FLINK-28199: It was indeed only once that this happe

[jira] [Closed] (FLINK-28196) Rename hadoop.version property

2022-06-22 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-28196. Resolution: Fixed master: 3b50f19ad27a49c5b804e8e811cbb2062dcff003 > Rename hadoop.versio

[GitHub] [flink] zentol merged pull request #20046: [FLINK-28196][build] Rename hadoop.version property

2022-06-22 Thread GitBox
zentol merged PR #20046: URL: https://github.com/apache/flink/pull/20046 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[GitHub] [flink] zentol commented on pull request #20046: [FLINK-28196][build] Rename hadoop.version property

2022-06-22 Thread GitBox
zentol commented on PR #20046: URL: https://github.com/apache/flink/pull/20046#issuecomment-1163349594 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [flink] flinkbot commented on pull request #20053: [FLINK-28201][ci] Generalize utils around dependency plugin

2022-06-22 Thread GitBox
flinkbot commented on PR #20053: URL: https://github.com/apache/flink/pull/20053#issuecomment-1163342659 ## CI report: * 50da2a67713f98edca34821b185a68254a41efb8 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] zentol commented on a diff in pull request #20053: [FLINK-28201][ci] Generalize utils around dependency plugin

2022-06-22 Thread GitBox
zentol commented on code in PR #20053: URL: https://github.com/apache/flink/pull/20053#discussion_r903987642 ## tools/ci/java-ci-tools/src/main/java/org/apache/flink/tools/ci/suffixcheck/ScalaSuffixChecker.java: ## @@ -96,40 +98,35 @@ private static ParseResult parseMavenOutput(

[jira] [Updated] (FLINK-28201) Generalize utils around dependency-plugin

2022-06-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28201: --- Labels: pull-request-available (was: ) > Generalize utils around dependency-plugin > --

[GitHub] [flink] zentol opened a new pull request, #20053: [FLINK-28201][ci] Generalize utils around dependency plugin

2022-06-22 Thread GitBox
zentol opened a new pull request, #20053: URL: https://github.com/apache/flink/pull/20053 This PR reworks the parsing of the output from the dependency-plugin to make it more generic and re-usable for other checks. The scala suffix checker, the only current user, was migrated as part of

[GitHub] [flink] rkhachatryan commented on pull request #19448: [FLINK-25872][state] Support restore from non-changelog checkpoint with changelog enabled in CLAIM mode

2022-06-22 Thread GitBox
rkhachatryan commented on PR #19448: URL: https://github.com/apache/flink/pull/19448#issuecomment-1163264334 I've compared performance results. The top regressions are: ``` org.apache.flink.benchmark.MultipleInputBenchmark.multiInputOneIdleMapSink 15.28% org.apache.flink.benchmark

  1   2   3   4   >