[GitHub] [flink] reswqa commented on pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on PR #19960: URL: https://github.com/apache/flink/pull/19960#issuecomment-1172004762 Hi @xintongsong, all comments have been resolved, please take a look~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [flink] xintongsong commented on a diff in pull request #20123: [FLINK-28310][rest] Introduce aggregating task metrics

2022-06-30 Thread GitBox
xintongsong commented on code in PR #20123: URL: https://github.com/apache/flink/pull/20123#discussion_r911663772 ## flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/AggregatedTaskDetailsInfo.java: ## @@ -0,0 +1,265 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] [flink] lsyldliu commented on pull request #19193: [FLINK-26813[SQL-API] Supports ADD/MODIFY column/watermark/constraint syntax parse for ALTER TABLE

2022-06-30 Thread GitBox
lsyldliu commented on PR #19193: URL: https://github.com/apache/flink/pull/19193#issuecomment-1172004165 @fsk119 Thanks for review, I've addressed your comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [flink-kubernetes-operator] gyfora commented on a diff in pull request #283: [FLINK-28228] Never skip generations when observing already upgraded deployment

2022-06-30 Thread GitBox
gyfora commented on code in PR #283: URL: https://github.com/apache/flink-kubernetes-operator/pull/283#discussion_r911668090 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/reconciler/deployment/AbstractFlinkResourceReconciler.java: ## @@ -99,15

[GitHub] [flink] lsyldliu commented on a diff in pull request #19193: [FLINK-26813[SQL-API] Supports ADD/MODIFY column/watermark/constraint syntax parse for ALTER TABLE

2022-06-30 Thread GitBox
lsyldliu commented on code in PR #19193: URL: https://github.com/apache/flink/pull/19193#discussion_r911668145 ## flink-table/flink-sql-parser/src/main/java/org/apache/flink/sql/parser/ddl/position/SqlTableColumnPosition.java: ## @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache

[jira] [Commented] (FLINK-28010) Use deleteRange to optimize the clear operation of RocksDBMapState.

2022-06-30 Thread ming li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561322#comment-17561322 ] ming li commented on FLINK-28010: - [~Yanfei Lei] thank you for your reply, I think this

[GitHub] [flink] flinkbot commented on pull request #20125: [FLINK-38340][python][ci] Support using system conda env for testing

2022-06-30 Thread GitBox
flinkbot commented on PR #20125: URL: https://github.com/apache/flink/pull/20125#issuecomment-1172000366 ## CI report: * c36edfe13d3cc4149394ecc013288734a4ffed8c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] diohabara commented on pull request #19950: [hotfix] [docs] Translate a Chinese comment into English

2022-06-30 Thread GitBox
diohabara commented on PR #19950: URL: https://github.com/apache/flink/pull/19950#issuecomment-1171999458 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Closed] (FLINK-28318) table idle state ttl configure does not have check when window size bigger than table state ttl

2022-06-30 Thread yutao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yutao closed FLINK-28318. - Resolution: Cannot Reproduce > table idle state ttl configure does not have check when window size bigger > t

[jira] [Comment Edited] (FLINK-28078) ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers runs into timeout

2022-06-30 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561315#comment-17561315 ] Matthias Pohl edited comment on FLINK-28078 at 7/1/22 6:44 AM: ---

[jira] [Commented] (FLINK-28078) ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers runs into timeout

2022-06-30 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561315#comment-17561315 ] Matthias Pohl commented on FLINK-28078: --- I created CURATOR-644 to cover the issue

[jira] [Comment Edited] (FLINK-28078) ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers runs into timeout

2022-06-30 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561315#comment-17561315 ] Matthias Pohl edited comment on FLINK-28078 at 7/1/22 6:43 AM: ---

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911660986 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataSpiller.java: ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911659434 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataSpiller.java: ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software

[GitHub] [flink] Vancior opened a new pull request, #20125: [FLINK-38340][python][ci] Support using system conda env for testing

2022-06-30 Thread GitBox
Vancior opened a new pull request, #20125: URL: https://github.com/apache/flink/pull/20125 ## What is the purpose of the change This PR enables users to use system conda env for testing rather than creating a dedicated one. ## Verifying this change This change is a trivi

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-30 Thread Sebastian Mattheis (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561314#comment-17561314 ] Sebastian Mattheis commented on FLINK-24932: [~yunta] I have a cherry-pick o

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911659104 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataSpiller.java: ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software

[jira] [Commented] (FLINK-28337) java.lang.IllegalArgumentException: Table identifier not set

2022-06-30 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561310#comment-17561310 ] Martijn Visser commented on FLINK-28337: [~migowei] The Flink project doesn't su

[GitHub] [flink] JesseAtSZ commented on a diff in pull request #20091: [FLINK-27570][runtime] Fix initialize base locations for checkpoint

2022-06-30 Thread GitBox
JesseAtSZ commented on code in PR #20091: URL: https://github.com/apache/flink/pull/20091#discussion_r911656784 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsCheckpointStorageAccess.java: ## @@ -113,8 +113,12 @@ public boolean supportsHighlyAvailable

[jira] [Created] (FLINK-28340) Support using system conda env for PyFlink tests

2022-06-30 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28340: - Summary: Support using system conda env for PyFlink tests Key: FLINK-28340 URL: https://issues.apache.org/jira/browse/FLINK-28340 Project: Flink Issue Type: Improv

[jira] [Commented] (FLINK-28338) org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParseException: Invalid numeric value: Leading zeroes not allowed

2022-06-30 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561309#comment-17561309 ] Martijn Visser commented on FLINK-28338: Last but not least: please verify this

[jira] [Commented] (FLINK-28338) org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParseException: Invalid numeric value: Leading zeroes not allowed

2022-06-30 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561308#comment-17561308 ] Martijn Visser commented on FLINK-28338: [~igniz] Please make sure that the info

[GitHub] [flink] MartijnVisser commented on pull request #20114: [FLINK-28329][Tests] Output the top 15 directories in terms of used disk space

2022-06-30 Thread GitBox
MartijnVisser commented on PR #20114: URL: https://github.com/apache/flink/pull/20114#issuecomment-1171989236 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911655012 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/BufferWithInfo.java: ## @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #184: [FLINK-28327] Make table store src codes compiled with Flink 1.14

2022-06-30 Thread GitBox
JingsongLi commented on code in PR #184: URL: https://github.com/apache/flink-table-store/pull/184#discussion_r911648416 ## flink-table-store-codegen-loader/src/main/java/org/apache/flink/table/store/codegen/CodeGenLoader.java: ## @@ -58,18 +63,6 @@ public class CodeGenLoader {

[GitHub] [flink-kubernetes-operator] morhidi commented on pull request #285: [FLINK-26955] Add CRD compatibility check to maven build

2022-06-30 Thread GitBox
morhidi commented on PR #285: URL: https://github.com/apache/flink-kubernetes-operator/pull/285#issuecomment-1171970081 Thanks @gyfora for the PR. Having such a tool overall is a great idea, it'll force us to think twice before introducing any changes to the CRD. I second @tweise's suggest

[GitHub] [flink] dianfu commented on a diff in pull request #20120: [FLINK-27964][python] Support Cassandra connector in Python DataStream API

2022-06-30 Thread GitBox
dianfu commented on code in PR #20120: URL: https://github.com/apache/flink/pull/20120#discussion_r911637191 ## flink-python/pyflink/datastream/connectors/cassandra.py: ## @@ -126,6 +127,149 @@ def if_not_exists(self, enabled: bool) -> 'MapperOptions': return self +

[jira] [Updated] (FLINK-28140) Improve the documentation by adding Python examples

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-28140: Description: There are still quite a few documentations only having Java/Scala examples. The aim of this

[jira] [Commented] (FLINK-28140) Improve the documentation by adding Python examples

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561290#comment-17561290 ] Dian Fu commented on FLINK-28140: - Updated page:  [https://nightlies.apache.org/flink/fl

[jira] [Updated] (FLINK-28140) Improve the documentation by adding Python examples

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-28140: Description: There are still quite a few documentations only having Java/Scala examples. The aim of this

[GitHub] [flink] dianfu closed pull request #20121: [FLINK-28140][python][docs] Improve the documentation by adding Python examples

2022-06-30 Thread GitBox
dianfu closed pull request #20121: [FLINK-28140][python][docs] Improve the documentation by adding Python examples URL: https://github.com/apache/flink/pull/20121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [flink-kubernetes-operator] morhidi commented on a diff in pull request #288: [FLINK-27975] Remove unnecessary RBAC rules from operator

2022-06-30 Thread GitBox
morhidi commented on code in PR #288: URL: https://github.com/apache/flink-kubernetes-operator/pull/288#discussion_r911623792 ## helm/flink-kubernetes-operator/templates/rbac.yaml: ## @@ -21,23 +21,14 @@ RBAC rules used to create the operator (cluster)role based on the scope

[GitHub] [flink-kubernetes-operator] morhidi commented on a diff in pull request #288: [FLINK-27975] Remove unnecessary RBAC rules from operator

2022-06-30 Thread GitBox
morhidi commented on code in PR #288: URL: https://github.com/apache/flink-kubernetes-operator/pull/288#discussion_r911624111 ## helm/flink-kubernetes-operator/templates/rbac.yaml: ## @@ -21,23 +21,14 @@ RBAC rules used to create the operator (cluster)role based on the scope

[GitHub] [flink] zhuzhurk commented on pull request #20087: [FLINK-28271][runtime] Add config options for speculative scheduler

2022-06-30 Thread GitBox
zhuzhurk commented on PR #20087: URL: https://github.com/apache/flink/pull/20087#issuecomment-1171949278 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [flink-kubernetes-operator] morhidi commented on a diff in pull request #288: [FLINK-27975] Remove unnecessary RBAC rules from operator

2022-06-30 Thread GitBox
morhidi commented on code in PR #288: URL: https://github.com/apache/flink-kubernetes-operator/pull/288#discussion_r911623792 ## helm/flink-kubernetes-operator/templates/rbac.yaml: ## @@ -21,23 +21,14 @@ RBAC rules used to create the operator (cluster)role based on the scope

[GitHub] [flink-kubernetes-operator] morhidi commented on a diff in pull request #288: [FLINK-27975] Remove unnecessary RBAC rules from operator

2022-06-30 Thread GitBox
morhidi commented on code in PR #288: URL: https://github.com/apache/flink-kubernetes-operator/pull/288#discussion_r911621447 ## helm/flink-kubernetes-operator/templates/rbac.yaml: ## @@ -21,23 +21,14 @@ RBAC rules used to create the operator (cluster)role based on the scope

[jira] [Closed] (FLINK-28288) Support decode and encode built-in function in the Table API

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-28288. --- Assignee: LuNing Wang Resolution: Fixed Merged to master via 2f4f46219d09f261539a0aa47f915ee74c4721db

[jira] [Updated] (FLINK-28288) Support decode and encode built-in function in the Table API

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-28288: Affects Version/s: (was: 1.15.0) > Support decode and encode built-in function in the Table API >

[GitHub] [flink-kubernetes-operator] morhidi commented on a diff in pull request #288: [FLINK-27975] Remove unnecessary RBAC rules from operator

2022-06-30 Thread GitBox
morhidi commented on code in PR #288: URL: https://github.com/apache/flink-kubernetes-operator/pull/288#discussion_r911620631 ## helm/flink-kubernetes-operator/templates/rbac.yaml: ## @@ -21,23 +21,14 @@ RBAC rules used to create the operator (cluster)role based on the scope

[GitHub] [flink] dianfu merged pull request #20098: [FLINK-28288][table][python] Support decode and encode in Table API

2022-06-30 Thread GitBox
dianfu merged PR #20098: URL: https://github.com/apache/flink/pull/20098 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache

[GitHub] [flink] dianfu commented on pull request #20098: [FLINK-28288][table][python] Support decode and encode in Table API

2022-06-30 Thread GitBox
dianfu commented on PR #20098: URL: https://github.com/apache/flink/pull/20098#issuecomment-1171945071 @alpinegizmo @MartijnVisser Thanks for the review. LGTM as well. Merging... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (FLINK-28323) Support using new KafkaSource in PyFlink

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-28323: Affects Version/s: (was: 1.15.0) > Support using new KafkaSource in PyFlink >

[jira] [Closed] (FLINK-28323) Support using new KafkaSource in PyFlink

2022-06-30 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-28323. --- Assignee: Juntao Hu Resolution: Fixed Merged to master via ea0368e7ee0c56e0c9ad45233cb1e12ce458be1b >

[GitHub] [flink] dianfu closed pull request #20113: [FLINK-28323][python][connector] Support using new KafkaSource in PyFlink

2022-06-30 Thread GitBox
dianfu closed pull request #20113: [FLINK-28323][python][connector] Support using new KafkaSource in PyFlink URL: https://github.com/apache/flink/pull/20113 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] fredia commented on a diff in pull request #20091: [FLINK-27570][runtime] Fix initialize base locations for checkpoint

2022-06-30 Thread GitBox
fredia commented on code in PR #20091: URL: https://github.com/apache/flink/pull/20091#discussion_r911611532 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsCheckpointStorageAccess.java: ## @@ -113,8 +113,12 @@ public boolean supportsHighlyAvailableSto

[GitHub] [flink] fredia commented on pull request #20091: [FLINK-27570][runtime] Fix initialize base locations for checkpoint

2022-06-30 Thread GitBox
fredia commented on PR #20091: URL: https://github.com/apache/flink/pull/20091#issuecomment-1171930223 @JesseAtSZ Thanks for your explanation, `fileSystem.mkdirs()` not only returns `false` when the directory exists, but also returns `false` when there is no permission to write. This PR ma

[jira] [Closed] (FLINK-28062) Flink SQL Upsert-Kafka can not support Flink1.14.x With Sink Buffer

2022-06-30 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren closed FLINK-28062. - Resolution: Duplicate Mark as duplicating FLINK-28037 > Flink SQL Upsert-Kafka can not support

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911601331 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReader.java: ## @@ -0,0 +1,379 @@ +/* + * Licensed to the Apache Sof

[jira] [Assigned] (FLINK-28037) Flink SQL Upsert-Kafka can not support Flink1.14.x

2022-06-30 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren reassigned FLINK-28037: - Assignee: Qingsheng Ren > Flink SQL Upsert-Kafka can not support Flink1.14.x >

[jira] [Commented] (FLINK-28037) Flink SQL Upsert-Kafka can not support Flink1.14.x

2022-06-30 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561261#comment-17561261 ] Qingsheng Ren commented on FLINK-28037: --- Thanks for reporting this issue [~Jiangfe

[GitHub] [flink] flinkbot commented on pull request #20124: [FLINK-28336][python][format] Support parquet-avro format DataStream API

2022-06-30 Thread GitBox
flinkbot commented on PR #20124: URL: https://github.com/apache/flink/pull/20124#issuecomment-1171906046 ## CI report: * 54d29e93242f5488b28382e0bd1a91976456ea81 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] JesseAtSZ commented on pull request #20091: [FLINK-27570][runtime] Fix initialize base locations for checkpoint

2022-06-30 Thread GitBox
JesseAtSZ commented on PR #20091: URL: https://github.com/apache/flink/pull/20091#issuecomment-1171905414 @fredia In my example, I specify the path of checkpoint in CentOS as /D/, fileSystem.mkdirs() will return false, and the file creation fails, so the checkpoint initialize fails. In addi

[jira] [Created] (FLINK-28339) Introduce SparkCatalog in table store

2022-06-30 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-28339: Summary: Introduce SparkCatalog in table store Key: FLINK-28339 URL: https://issues.apache.org/jira/browse/FLINK-28339 Project: Flink Issue Type: New Feature

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #182: [FLINK-27708] Add background compaction task for append-only table when ingesting

2022-06-30 Thread GitBox
LadyForest commented on code in PR #182: URL: https://github.com/apache/flink-table-store/pull/182#discussion_r911595201 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/compact/CompactManager.java: ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Soft

[GitHub] [flink-table-store] LadyForest commented on a diff in pull request #182: [FLINK-27708] Add background compaction task for append-only table when ingesting

2022-06-30 Thread GitBox
LadyForest commented on code in PR #182: URL: https://github.com/apache/flink-table-store/pull/182#discussion_r911595201 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/compact/CompactManager.java: ## @@ -0,0 +1,79 @@ +/* + * Licensed to the Apache Soft

[jira] [Updated] (FLINK-28336) Support parquet-avro format in PyFlink DataStream

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28336: --- Labels: pull-request-available (was: ) > Support parquet-avro format in PyFlink DataStream

[GitHub] [flink] Vancior opened a new pull request, #20124: [FLINK-28336][python][format] Support parquet-avro format DataStream API

2022-06-30 Thread GitBox
Vancior opened a new pull request, #20124: URL: https://github.com/apache/flink/pull/20124 ## What is the purpose of the change This PR supports parquet-avro format for FileSource in PyFlink DataStream API. ## Brief change log - shade optional dependency parquet-avro

[jira] [Closed] (FLINK-28142) Enrich TaskManagerLocation with node information

2022-06-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-28142. --- Fix Version/s: 1.16.0 Resolution: Done Done via: 51c139b601806cc4f4272fb678f4d1bed4cf06ab eab0a1faf5e

[GitHub] [flink] zhuzhurk closed pull request #20056: [FLINK-28142][runtime] Enrich TaskManagerLocation and TaskExecutorRegistration with node information

2022-06-30 Thread GitBox
zhuzhurk closed pull request #20056: [FLINK-28142][runtime] Enrich TaskManagerLocation and TaskExecutorRegistration with node information URL: https://github.com/apache/flink/pull/20056 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [flink] flinkbot commented on pull request #20122: [FLINK-27607][tests] Migrate module flink-connector-files to JUnit5

2022-06-30 Thread GitBox
flinkbot commented on PR #20122: URL: https://github.com/apache/flink/pull/20122#issuecomment-1171902675 ## CI report: * ef0b6dcaf0217682fd86671c0a90951dfa5adedb UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-28310) Introduce aggregating task metrics

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28310: --- Labels: pull-request-available (was: ) > Introduce aggregating task metrics > -

[GitHub] [flink] zhuzhurk commented on pull request #20056: [FLINK-28142][runtime] Enrich TaskManagerLocation and TaskExecutorRegistration with node information

2022-06-30 Thread GitBox
zhuzhurk commented on PR #20056: URL: https://github.com/apache/flink/pull/20056#issuecomment-1171902128 Merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[GitHub] [flink] KarmaGYZ opened a new pull request, #20123: [FLINK-28310][rest] Introduce aggregating task metrics

2022-06-30 Thread GitBox
KarmaGYZ opened a new pull request, #20123: URL: https://github.com/apache/flink/pull/20123 We add AggregatedTaskDetailsInfo to JobVertexTaskManagersHandler and JobVertexDetailsHandler ## What is the purpose of the change *(For example: This pull request makes task depl

[jira] [Closed] (FLINK-28136) Implement ExecutionTimeBasedSlowTaskDetector

2022-06-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-28136. --- Resolution: Done Done via ef07590403ad7448a523ef5da78da0306cccdae7 > Implement ExecutionTimeBasedSlowTaskDe

[jira] [Closed] (FLINK-28135) Introduce SlowTaskDetector

2022-06-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-28135. --- Resolution: Done Done via a0e8818d6967e5b0d14367d2095c91a05cadfe1f > Introduce SlowTaskDetector > -

[GitHub] [flink] zhuzhurk closed pull request #20072: [FLINK-28136][runtime] Implement ExecutionTimeBasedSlowTaskDetector

2022-06-30 Thread GitBox
zhuzhurk closed pull request #20072: [FLINK-28136][runtime] Implement ExecutionTimeBasedSlowTaskDetector URL: https://github.com/apache/flink/pull/20072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] zhuzhurk closed pull request #20054: [FLINK-28135][runtime] Introduce SlowTaskDetector

2022-06-30 Thread GitBox
zhuzhurk closed pull request #20054: [FLINK-28135][runtime] Introduce SlowTaskDetector URL: https://github.com/apache/flink/pull/20054 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [flink] GOODBOY008 opened a new pull request, #20122: [FLINK-27607][tests] Migrate module flink-connector-files to JUnit5

2022-06-30 Thread GitBox
GOODBOY008 opened a new pull request, #20122: URL: https://github.com/apache/flink/pull/20122 ## What is the purpose of the change Update the flink-connector-files module to AssertJ and JUnit 5 following the [JUnit 5 Migration Guide](https://docs.google.com/document/d/1514Wa_

[GitHub] [flink] fredia commented on pull request #20091: [FLINK-27570][runtime] Fix initialize base locations for checkpoint

2022-06-30 Thread GitBox
fredia commented on PR #20091: URL: https://github.com/apache/flink/pull/20091#issuecomment-1171898497 Thanks for creating this PR @JesseAtSZ. IIUC, you expect an IOException when the checkpoint directory exists(`fileSystem.mkdir()` return `false`)? I think it's a little wired, could yo

[GitHub] [flink] flinkbot commented on pull request #20121: [FLINK-28140][python][docs] Improve the documentation by adding Python examples

2022-06-30 Thread GitBox
flinkbot commented on PR #20121: URL: https://github.com/apache/flink/pull/20121#issuecomment-1171897135 ## CI report: * f6495314d656a8bf5b7a06745f145985f095a94d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] zhuzhurk commented on pull request #20072: [FLINK-28136][runtime] Implement ExecutionTimeBasedSlowTaskDetector

2022-06-30 Thread GitBox
zhuzhurk commented on PR #20072: URL: https://github.com/apache/flink/pull/20072#issuecomment-1171897066 Merging. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[jira] [Closed] (FLINK-28309) Introduce metrics of the duration that a task stays in each status

2022-06-30 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yangze Guo closed FLINK-28309. -- Resolution: Fixed > Introduce metrics of the duration that a task stays in each status > -

[jira] [Commented] (FLINK-28309) Introduce metrics of the duration that a task stays in each status

2022-06-30 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561252#comment-17561252 ] Yangze Guo commented on FLINK-28309: master: bb8e1d14f05aca186ec874437eba3d44fbb3bd9

[jira] [Closed] (FLINK-28308) Introduce accumulated time metrics that a running task is busy / idle / back-pressured

2022-06-30 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yangze Guo closed FLINK-28308. -- Resolution: Fixed > Introduce accumulated time metrics that a running task is busy / idle / > back-pr

[jira] [Commented] (FLINK-28308) Introduce accumulated time metrics that a running task is busy / idle / back-pressured

2022-06-30 Thread Yangze Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561251#comment-17561251 ] Yangze Guo commented on FLINK-28308: master: 6b8230cf83fd33c4fdd3d7cc99e6a90d9839a35

[jira] [Commented] (FLINK-28338) org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParseException: Invalid numeric value: Leading zeroes not allowed

2022-06-30 Thread wangkang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561250#comment-17561250 ] wangkang commented on FLINK-28338: -- 解决方法是添加一个类似 spring.jackson.parser.allow-numeric-lea

[GitHub] [flink] KarmaGYZ closed pull request #20110: [FLINK-28308] Introduce metrics of the accumulated time that a running task is busy / idle / back-pressured

2022-06-30 Thread GitBox
KarmaGYZ closed pull request #20110: [FLINK-28308] Introduce metrics of the accumulated time that a running task is busy / idle / back-pressured URL: https://github.com/apache/flink/pull/20110 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [flink] KarmaGYZ closed pull request #20111: [FLINK-28309][rest] Introduce metrics of the duration that a task sta…

2022-06-30 Thread GitBox
KarmaGYZ closed pull request #20111: [FLINK-28309][rest] Introduce metrics of the duration that a task sta… URL: https://github.com/apache/flink/pull/20111 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (FLINK-28140) Improve the documentation by adding Python examples

2022-06-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28140: --- Labels: pull-request-available (was: ) > Improve the documentation by adding Python example

[jira] [Created] (FLINK-28338) org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParseException: Invalid numeric value: Leading zeroes not allowed

2022-06-30 Thread wangkang (Jira)
wangkang created FLINK-28338: Summary: org.apache.flink.shaded.jackson2.com.fasterxml.jackson.core.JsonParseException: Invalid numeric value: Leading zeroes not allowed Key: FLINK-28338 URL: https://issues.apache.org

[GitHub] [flink] pengmide opened a new pull request, #20121: [FLINK-28140][python][docs] Improve the documentation by adding Python examples

2022-06-30 Thread GitBox
pengmide opened a new pull request, #20121: URL: https://github.com/apache/flink/pull/20121 ## What is the purpose of the change Improve the documentation by adding Python examples. ## Brief change log - Improve the data stream api documentation by adding Python exampl

[jira] [Created] (FLINK-28337) java.lang.IllegalArgumentException: Table identifier not set

2022-06-30 Thread wei (Jira)
wei created FLINK-28337: --- Summary: java.lang.IllegalArgumentException: Table identifier not set Key: FLINK-28337 URL: https://issues.apache.org/jira/browse/FLINK-28337 Project: Flink Issue Type: Bug

[GitHub] [flink] luoyuxia commented on pull request #18975: [FLINK-26474][hive] Fold exprNode to fix the issue of failing to call some hive udf required constant parameters with implicit constant pass

2022-06-30 Thread GitBox
luoyuxia commented on PR #18975: URL: https://github.com/apache/flink/pull/18975#issuecomment-1171885691 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [flink] flinkbot commented on pull request #20120: [FLINK-27964][python] Support Cassandra connector in Python DataStream API

2022-06-30 Thread GitBox
flinkbot commented on PR #20120: URL: https://github.com/apache/flink/pull/20120#issuecomment-1171884235 ## CI report: * 5ce536787b928c5434d228219b25f47f475e48f7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] 6591812 commented on pull request #20082: [FLINK-28134][runtime] Introduce SpeculativeExecutionVertex

2022-06-30 Thread GitBox
6591812 commented on PR #20082: URL: https://github.com/apache/flink/pull/20082#issuecomment-1171884006 After @zhuzhurk 's good job I have no other questions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [flink] pengmide opened a new pull request, #20120: [FLINK-27964][python] Support Cassandra connector in Python DataStream API

2022-06-30 Thread GitBox
pengmide opened a new pull request, #20120: URL: https://github.com/apache/flink/pull/20120 ## What is the purpose of the change Support Cassandra connector in Python DataStream API. ## Brief change log - Introduces policy methods in `ClusterBuilder`. ## Verifyin

[jira] [Resolved] (FLINK-28276) org.apache.flink.connectors.hive.FlinkHiveException: Unable to instantiate the hadoop input format

2022-06-30 Thread wei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wei resolved FLINK-28276. - Resolution: Fixed > org.apache.flink.connectors.hive.FlinkHiveException: Unable to instantiate > the hadoop inp

[jira] [Commented] (FLINK-28276) org.apache.flink.connectors.hive.FlinkHiveException: Unable to instantiate the hadoop input format

2022-06-30 Thread wei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561241#comment-17561241 ] wei commented on FLINK-28276: - I add  `table.updateProperties().set("engine.hive.enabled", "

[jira] [Updated] (FLINK-28276) org.apache.flink.connectors.hive.FlinkHiveException: Unable to instantiate the hadoop input format

2022-06-30 Thread wei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wei updated FLINK-28276: Attachment: image-2022-07-01-11-05-01-238.png > org.apache.flink.connectors.hive.FlinkHiveException: Unable to ins

[GitHub] [flink] zhuyufeng0809 closed pull request #19991: [FLINK-28065][Runtime/Configuration] Fix a never reached code in ProcessMemoryUtils Class

2022-06-30 Thread GitBox
zhuyufeng0809 closed pull request #19991: [FLINK-28065][Runtime/Configuration] Fix a never reached code in ProcessMemoryUtils Class URL: https://github.com/apache/flink/pull/19991 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [flink] zhuyufeng0809 closed pull request #19992: [hotfix][Runtime/Configuration] Fix typo in ProcessMemoryUtils Class

2022-06-30 Thread GitBox
zhuyufeng0809 closed pull request #19992: [hotfix][Runtime/Configuration] Fix typo in ProcessMemoryUtils Class URL: https://github.com/apache/flink/pull/19992 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Created] (FLINK-28336) Support parquet-avro format in PyFlink DataStream

2022-06-30 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28336: - Summary: Support parquet-avro format in PyFlink DataStream Key: FLINK-28336 URL: https://issues.apache.org/jira/browse/FLINK-28336 Project: Flink Issue Type: New F

[GitHub] [flink-kubernetes-operator] Aitozi commented on a diff in pull request #283: [FLINK-28228] Never skip generations when observing already upgraded deployment

2022-06-30 Thread GitBox
Aitozi commented on code in PR #283: URL: https://github.com/apache/flink-kubernetes-operator/pull/283#discussion_r911568620 ## flink-kubernetes-operator/src/main/java/org/apache/flink/kubernetes/operator/reconciler/deployment/AbstractFlinkResourceReconciler.java: ## @@ -99,15

[GitHub] [flink] gaoyunhaii commented on pull request #20108: [FLINK-28240][network] Fix the bug that NetworkBufferPool#getRequestedSegmentsUsage may throw ArithmeticException.

2022-06-30 Thread GitBox
gaoyunhaii commented on PR #20108: URL: https://github.com/apache/flink/pull/20108#issuecomment-1171870337 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Commented] (FLINK-28265) Inconsistency in Kubernetes HA service: broken state handle

2022-06-30 Thread MAU CHEE YEN (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561240#comment-17561240 ] MAU CHEE YEN commented on FLINK-28265: -- [~martijnvisser] We had another incident wh

[GitHub] [flink] zhuzhurk commented on pull request #20082: [FLINK-28134][runtime] Introduce SpeculativeExecutionVertex

2022-06-30 Thread GitBox
zhuzhurk commented on PR #20082: URL: https://github.com/apache/flink/pull/20082#issuecomment-1171864156 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-28324) JUnit5 Migration] Module: flink-sql-client

2022-06-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561237#comment-17561237 ] Zhu Zhu commented on FLINK-28324: - Thanks for volunteering to take it. [~Leo Zhou] I hav

[jira] [Assigned] (FLINK-28324) JUnit5 Migration] Module: flink-sql-client

2022-06-30 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-28324: --- Assignee: zl > JUnit5 Migration] Module: flink-sql-client > ---

[GitHub] [flink] zhuzhurk commented on pull request #20072: [FLINK-28136][runtime] Implement ExecutionTimeBasedSlowTaskDetector

2022-06-30 Thread GitBox
zhuzhurk commented on PR #20072: URL: https://github.com/apache/flink/pull/20072#issuecomment-1171861384 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Closed] (FLINK-26361) "Unexpected correlate variable $cor0" when using hive dialect to write a subquery

2022-06-30 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang closed FLINK-26361. - Resolution: Fixed > "Unexpected correlate variable $cor0" when using hive dialect to write a >

  1   2   3   4   >