[GitHub] [flink] yuzelin opened a new pull request, #20401: List schemas

2022-07-31 Thread GitBox
yuzelin opened a new pull request, #20401: URL: https://github.com/apache/flink/pull/20401 ## What is the purpose of the change Implement getSchemas in the HiveServer2 Endpoint. ## Brief change log - Implement listDatabases in the SqlGatewayService. - I

[GitHub] [flink] yangjunhan commented on pull request #20380: [FLINK-28589][runtime-web] enhance web UI for speculative execution

2022-07-31 Thread GitBox
yangjunhan commented on PR #20380: URL: https://github.com/apache/flink/pull/20380#issuecomment-1200789930 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[jira] [Updated] (FLINK-28665) flink-table-store-benchmark-jar-with-dependencies.jar NOTICE file is wrong

2022-07-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28665: --- Labels: pull-request-available (was: ) > flink-table-store-benchmark-jar-with-dependencies.

[GitHub] [flink-table-store] tsreaper opened a new pull request, #258: [FLINK-28665] Disable deployment of table store benchmark module

2022-07-31 Thread GitBox
tsreaper opened a new pull request, #258: URL: https://github.com/apache/flink-table-store/pull/258 Currently the benchmark module does not have a correct NOTICE file. However this module does not need to be released, so we can just skip its deployment. -- This is an automated message fro

[GitHub] [flink] masteryhx commented on a diff in pull request #20313: [FLINK-28597][state] Discard initial checkpoints without a delay in common cases

2022-07-31 Thread GitBox
masteryhx commented on code in PR #20313: URL: https://github.com/apache/flink/pull/20313#discussion_r934182431 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/SharedStateRegistryImpl.java: ## @@ -365,4 +401,19 @@ public String toString() { return "Emp

[jira] [Updated] (FLINK-28760) Hive table store support can't be fully enabled by ADD JAR statement

2022-07-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28760: --- Labels: pull-request-available (was: ) > Hive table store support can't be fully enabled by

[GitHub] [flink-table-store] tsreaper opened a new pull request, #257: [FLINK-28760] Enable table store support in Hive by creating auxlib directory

2022-07-31 Thread GitBox
tsreaper opened a new pull request, #257: URL: https://github.com/apache/flink-table-store/pull/257 Current table store Hive document states that, to enable support in Hive, we should use ADD JAR statement to add hive connector jar. However some types of queries, for example join stat

[GitHub] [flink] lincoln-lil commented on a diff in pull request #20363: [FLINK-28492][table-planner] Support "ANALYZE TABLE" execution

2022-07-31 Thread GitBox
lincoln-lil commented on code in PR #20363: URL: https://github.com/apache/flink/pull/20363#discussion_r934082373 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/internal/TableEnvironmentImpl.java: ## @@ -1356,6 +1379,15 @@ public TableResultInternal

[jira] [Commented] (FLINK-28759) Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests

2022-07-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573568#comment-17573568 ] Zhu Zhu commented on FLINK-28759: - [~JunRuiLi] I have assign you the ticket. Go a head t

[jira] [Assigned] (FLINK-28759) Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests

2022-07-31 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu reassigned FLINK-28759: --- Assignee: JUNRUILi > Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests >

[jira] [Comment Edited] (FLINK-28759) Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests

2022-07-31 Thread JUNRUILi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573566#comment-17573566 ] JUNRUILi edited comment on FLINK-28759 at 8/1/22 6:27 AM: -- [~zh

[GitHub] [flink] masteryhx commented on a diff in pull request #20313: [FLINK-28597][state] Discard initial checkpoints without a delay in common cases

2022-07-31 Thread GitBox
masteryhx commented on code in PR #20313: URL: https://github.com/apache/flink/pull/20313#discussion_r934176373 ## flink-runtime/src/test/java/org/apache/flink/runtime/state/SharedStateRegistryTest.java: ## @@ -182,20 +194,113 @@ public void testRegisterChangelogStateBackendHand

[jira] [Commented] (FLINK-28759) Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests

2022-07-31 Thread JUNRUILi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573566#comment-17573566 ] JUNRUILi commented on FLINK-28759: -- [~zhuzh] I will take a look at it > Enable specula

[jira] [Created] (FLINK-28760) Hive table store support can't be fully enabled by ADD JAR statement

2022-07-31 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-28760: --- Summary: Hive table store support can't be fully enabled by ADD JAR statement Key: FLINK-28760 URL: https://issues.apache.org/jira/browse/FLINK-28760 Project: Flink

[jira] [Created] (FLINK-28759) Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests

2022-07-31 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-28759: --- Summary: Enable speculative execution for in AdaptiveBatchScheduler TPC-DS e2e tests Key: FLINK-28759 URL: https://issues.apache.org/jira/browse/FLINK-28759 Project: Flink

[jira] [Closed] (FLINK-28096) Hive dialect support set variable

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-28096. --- Resolution: Fixed Fixed in master: a6a7063cfafd8cd5c1b04169839b92373bf96fde > Hive dialect support set vari

[GitHub] [flink] wuchong merged pull request #20000: [FLINK-28096][hive] Hive dialect support set variables

2022-07-31 Thread GitBox
wuchong merged PR #2: URL: https://github.com/apache/flink/pull/2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[GitHub] [flink] reswqa commented on pull request #20216: [FLINK-28382] Introduce more compression algorithm based on aircompression

2022-07-31 Thread GitBox
reswqa commented on PR #20216: URL: https://github.com/apache/flink/pull/20216#issuecomment-1200755216 @wsry Thanks for the review, I have address all of your comments, please take a look again. -- This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (FLINK-20969) Update Scala 2.12 version to 2.12.15

2022-07-31 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-20969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573559#comment-17573559 ] Maciej Bryński commented on FLINK-20969: [~martijnvisser] Maybe 2.12.16 ? https:

[jira] [Updated] (FLINK-28758) Failed to stop with savepoint

2022-07-31 Thread hjw (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hjw updated FLINK-28758: Description: I post a save with savepoint request to Flink Job throught rest api. A Error happened in Kafka connec

[jira] [Updated] (FLINK-28758) Failed to stop with savepoint

2022-07-31 Thread hjw (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hjw updated FLINK-28758: Description: I post a save with savepoint request to Flink Job throught rest api. A Error happened in Kafka connec

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #132: [FLINK-28571] Add AlgoOperator for Chi-squared test

2022-07-31 Thread GitBox
zhipeng93 commented on code in PR #132: URL: https://github.com/apache/flink-ml/pull/132#discussion_r934161874 ## flink-ml-lib/src/main/java/org/apache/flink/ml/stats/chisqtest/ChiSqTestParams.java: ## @@ -0,0 +1,11 @@ +package org.apache.flink.ml.stats.chisqtest; Review Commen

[jira] [Created] (FLINK-28758) Failed to stop with savepoint

2022-07-31 Thread hjw (Jira)
hjw created FLINK-28758: --- Summary: Failed to stop with savepoint Key: FLINK-28758 URL: https://issues.apache.org/jira/browse/FLINK-28758 Project: Flink Issue Type: Bug Components: Connectors

[GitHub] [flink] pltbkd commented on pull request #20296: [FLINK-28588] Enhance REST API for Speculative Execution

2022-07-31 Thread GitBox
pltbkd commented on PR #20296: URL: https://github.com/apache/flink/pull/20296#issuecomment-1200741155 Thanks you for all the comments! I've squashed all fixups and rebased on to the latest master. The PR should be ready for merging once the CI is passed. -- This is an automated me

[GitHub] [flink] flinkbot commented on pull request #20400: [FLINK-24787][docs] Add more details of state latency tracking documentation

2022-07-31 Thread GitBox
flinkbot commented on PR #20400: URL: https://github.com/apache/flink/pull/20400#issuecomment-1200735191 ## CI report: * b3d03228a45419a8e0bdcf59f80d5e38e2b24b52 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] masteryhx opened a new pull request, #20400: [FLINK-24787][docs] Add more details of state latency tracking documentation

2022-07-31 Thread GitBox
masteryhx opened a new pull request, #20400: URL: https://github.com/apache/flink/pull/20400 ## What is the purpose of the change This pull request adding more details about state latency tracking in the metric documentation. ## Brief change log - Added "Sta

[jira] [Updated] (FLINK-24787) Add more details of state latency tracking documentation

2022-07-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-24787: --- Labels: pull-request-available (was: ) > Add more details of state latency tracking documen

[GitHub] [flink-connector-redis] sazzad16 commented on pull request #3: [FLINK-15571] Add Redis sink

2022-07-31 Thread GitBox
sazzad16 commented on PR #3: URL: https://github.com/apache/flink-connector-redis/pull/3#issuecomment-1200710378 @eskabetxe Let's discuss. Would Slack be a good place for this? Or must we use mailing list? @MartijnVisser -- This is an automated message from the Apache Git S

[GitHub] [flink] HuangZhenQiu commented on pull request #20176: [FLINK-27660][table] add table api for registering function with resource

2022-07-31 Thread GitBox
HuangZhenQiu commented on PR #20176: URL: https://github.com/apache/flink/pull/20176#issuecomment-1200702958 @lsyldliu Thanks for the review. Revised the code accordingly Would you please take a look again? -- This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Closed] (FLINK-28664) Support AvroWriters in PyFlink

2022-07-31 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-28664. --- Assignee: Juntao Hu Resolution: Fixed Merged to master via f8f2ebb34f18540f4bfdf2b5db591539199b65e7 >

[GitHub] [flink] dianfu closed pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
dianfu closed pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters URL: https://github.com/apache/flink/pull/20383 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [flink-ml] zhipeng93 commented on a diff in pull request #132: [FLINK-28571] Add AlgoOperator for Chi-squared test

2022-07-31 Thread GitBox
zhipeng93 commented on code in PR #132: URL: https://github.com/apache/flink-ml/pull/132#discussion_r934122580 ## flink-ml-lib/src/main/java/org/apache/flink/ml/stats/chisqtest/ChiSqTest.java: ## @@ -0,0 +1,654 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under on

[GitHub] [flink] lincoln-lil commented on a diff in pull request #20196: [FLINK-28417][table] Add interfaces for LookupCache and default implementation

2022-07-31 Thread GitBox
lincoln-lil commented on code in PR #20196: URL: https://github.com/apache/flink/pull/20196#discussion_r934122365 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/connector/source/lookup/cache/DefaultLookupCache.java: ## @@ -0,0 +1,270 @@ +/* + * Licensed t

[jira] [Assigned] (FLINK-28151) Allow to cancel the Operation for the HiveServer2 Endpoint

2022-07-31 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-28151: - Assignee: WeiNan Zhao (was: Shengkai Fang) > Allow to cancel the Operation for the Hiv

[GitHub] [flink-ml] zhipeng93 merged pull request #133: [FLINK-28601] Add Transformer for FeatureHasher

2022-07-31 Thread GitBox
zhipeng93 merged PR #133: URL: https://github.com/apache/flink-ml/pull/133 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apac

[GitHub] [flink-ml] zhipeng93 commented on pull request #133: [FLINK-28601] Add Transformer for FeatureHasher

2022-07-31 Thread GitBox
zhipeng93 commented on PR #133: URL: https://github.com/apache/flink-ml/pull/133#issuecomment-1200665229 Thanks for the update @weibozhao. LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [flink] wuchong commented on a diff in pull request #19017: [FLINK-26542][hive] Hive dialect supports queries with multiple same columns in select

2022-07-31 Thread GitBox
wuchong commented on code in PR #19017: URL: https://github.com/apache/flink/pull/19017#discussion_r934110184 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/planner/delegation/hive/copy/HiveParserRowResolver.java: ## @@ -170,6 +206,12 @@ public boo

[GitHub] [flink] yunfengzhou-hub commented on pull request #20275: [FLINK-28606][Runtime/Checkpointing] Preserve consistency of OperatorEvent from OperatorCoordinator to subtasks

2022-07-31 Thread GitBox
yunfengzhou-hub commented on PR #20275: URL: https://github.com/apache/flink/pull/20275#issuecomment-1200660902 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[jira] [Commented] (FLINK-28757) Increase precision of TIME fields in JSON Format

2022-07-31 Thread Weike Dong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573526#comment-17573526 ] Weike Dong commented on FLINK-28757: Related to FLINK-17525 and FLINK-19872, but sti

[GitHub] [flink] dianfu commented on a diff in pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
dianfu commented on code in PR #20383: URL: https://github.com/apache/flink/pull/20383#discussion_r934112786 ## flink-python/pyflink/datastream/connectors/file_system.py: ## @@ -535,6 +568,51 @@ def for_row_format(base_path: str, encoder: Encoder) -> 'FileSink.RowFormatBuild

[jira] [Created] (FLINK-28757) Increase precision of TIME fields in JSON Format

2022-07-31 Thread Weike Dong (Jira)
Weike Dong created FLINK-28757: -- Summary: Increase precision of TIME fields in JSON Format Key: FLINK-28757 URL: https://issues.apache.org/jira/browse/FLINK-28757 Project: Flink Issue Type: Impr

[GitHub] [flink] wsry commented on a diff in pull request #20216: [FLINK-28382] Introduce more compression algorithm based on aircompression

2022-07-31 Thread GitBox
wsry commented on code in PR #20216: URL: https://github.com/apache/flink/pull/20216#discussion_r934106967 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/buffer/BufferCompressor.java: ## @@ -107,15 +107,28 @@ private int compress(Buffer buffer) {

[GitHub] [flink] wsry commented on a diff in pull request #20216: [FLINK-28382] Introduce more compression algorithm based on aircompression

2022-07-31 Thread GitBox
wsry commented on code in PR #20216: URL: https://github.com/apache/flink/pull/20216#discussion_r934105686 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/compression/AirCompressor.java: ## @@ -0,0 +1,117 @@ +/* + * Licensed to the Apache Software Foundation (ASF) und

[GitHub] [flink] Aitozi commented on pull request #20397: [FLINK-28751][Table SQL/Runtime] Optimize the performance of the json…

2022-07-31 Thread GitBox
Aitozi commented on PR #20397: URL: https://github.com/apache/flink/pull/20397#issuecomment-1200636421 I have not written a benchmark test for it now, I only run a production test which seen 2~4 times improved. Do you mean add an extra test for it in the flink-benchmark project? -- This

[GitHub] [flink] wuchong commented on pull request #20397: [FLINK-28751][Table SQL/Runtime] Optimize the performance of the json…

2022-07-31 Thread GitBox
wuchong commented on PR #20397: URL: https://github.com/apache/flink/pull/20397#issuecomment-1200634296 Do you have any benchmark between the two implementations? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [flink] WencongLiu commented on pull request #20236: [FLINK-27769][sql-gateway]Introduce the REST endpoint framework

2022-07-31 Thread GitBox
WencongLiu commented on PR #20236: URL: https://github.com/apache/flink/pull/20236#issuecomment-1200631190 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [flink] Vancior commented on a diff in pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
Vancior commented on code in PR #20383: URL: https://github.com/apache/flink/pull/20383#discussion_r934082090 ## flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/avro/AvroParquetReaders.java: ## @@ -51,15 +51,7 @@ public class AvroParquetReaders {

[GitHub] [flink] Vancior commented on a diff in pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
Vancior commented on code in PR #20383: URL: https://github.com/apache/flink/pull/20383#discussion_r934093658 ## flink-python/pyflink/datastream/connectors/file_system.py: ## @@ -535,6 +568,51 @@ def for_row_format(base_path: str, encoder: Encoder) -> 'FileSink.RowFormatBuild

[jira] [Updated] (FLINK-26412) Hive dialect supports "CREATE FUNCTION USING xxx.jar"

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-26412: Component/s: Connectors / Hive > Hive dialect supports "CREATE FUNCTION USING xxx.jar" > -

[jira] [Updated] (FLINK-26366) Support "insert directory"

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-26366: Component/s: Connectors / Hive > Support "insert directory" > -- > >

[jira] [Closed] (FLINK-26366) Support "insert directory"

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-26366. --- Fix Version/s: 1.16.0 Resolution: Fixed Fixed in master: a42c0041fc37595d07010c2077b2f806b2b34ef9 >

[jira] [Closed] (FLINK-26412) Hive dialect supports "CREATE FUNCTION USING xxx.jar"

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-26412. --- Fix Version/s: 1.16.0 Resolution: Fixed Fixed in master: b0d2b2aeb28329d48ee0b89259dbb067175c545a >

[GitHub] [flink] wuchong closed pull request #19520: [FLINK-26366][hive] support insert overwrite directory

2022-07-31 Thread GitBox
wuchong closed pull request #19520: [FLINK-26366][hive] support insert overwrite directory URL: https://github.com/apache/flink/pull/19520 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [flink] wuchong closed pull request #20251: [FLINK-26412][hive] Hive dialect supports "create function using jar"

2022-07-31 Thread GitBox
wuchong closed pull request #20251: [FLINK-26412][hive] Hive dialect supports "create function using jar" URL: https://github.com/apache/flink/pull/20251 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Commented] (FLINK-28678) Support SQL hint for Filter, SetOp, Sort, Window, Values

2022-07-31 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573515#comment-17573515 ] xuyang commented on FLINK-28678: [~martijnvisser] I copied these steps to FLINK-28744 >

[GitHub] [flink] yangjunhan commented on pull request #20380: [FLINK-28589][runtime-web] enhance web UI for speculative execution

2022-07-31 Thread GitBox
yangjunhan commented on PR #20380: URL: https://github.com/apache/flink/pull/20380#issuecomment-1200602489 @simplejason Thanks for the advice. All mentioned above have been taken care of. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Commented] (FLINK-28744) Upgrade Calcite version to 1.31

2022-07-31 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17573514#comment-17573514 ] xuyang commented on FLINK-28744: Just for reminding, the following files should be remov

[jira] [Updated] (FLINK-28678) Support SQL hint for Filter, SetOp, Sort, Window, Values

2022-07-31 Thread xuyang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuyang updated FLINK-28678: --- Description: Ref CALCITE-5107 . Mainly cherry pick it. The following files should be removed from the Flink

[GitHub] [flink] leozhangsr commented on pull request #20387: [FLINK-28475] [Connector/kafka] stopping offset can be 0.

2022-07-31 Thread GitBox
leozhangsr commented on PR #20387: URL: https://github.com/apache/flink/pull/20387#issuecomment-1200599164 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [flink] Vancior commented on a diff in pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
Vancior commented on code in PR #20383: URL: https://github.com/apache/flink/pull/20383#discussion_r934082463 ## flink-python/pyflink/datastream/formats/avro.py: ## @@ -63,6 +70,9 @@ class GenericRecordAvroTypeInfo(TypeInformation): A :class:`TypeInformation` of Avro's Gene

[GitHub] [flink] Vancior commented on a diff in pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
Vancior commented on code in PR #20383: URL: https://github.com/apache/flink/pull/20383#discussion_r934082286 ## flink-python/pyflink/datastream/formats/csv.py: ## @@ -131,7 +131,7 @@ def add_columns_from(self, schema: 'CsvSchema') -> 'CsvSchemaBuilder': :param schema:

[GitHub] [flink] Vancior commented on a diff in pull request #20383: [FLINK-28664][python][format] FileSink supports AvroWriters

2022-07-31 Thread GitBox
Vancior commented on code in PR #20383: URL: https://github.com/apache/flink/pull/20383#discussion_r934082090 ## flink-formats/flink-parquet/src/main/java/org/apache/flink/formats/parquet/avro/AvroParquetReaders.java: ## @@ -51,15 +51,7 @@ public class AvroParquetReaders {

[GitHub] [flink-ml] yunfengzhou-hub commented on a diff in pull request #135: [FLINK-28611] Add Transformer for ElementwiseProduct

2022-07-31 Thread GitBox
yunfengzhou-hub commented on code in PR #135: URL: https://github.com/apache/flink-ml/pull/135#discussion_r934072380 ## flink-ml-python/pyflink/ml/lib/feature/elementwiseproduct.py: ## @@ -0,0 +1,73 @@ +

[jira] [Updated] (FLINK-25686) Support Pulsar Schema evolution in Pulsar Source Connector

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-25686: --- Labels: Pulsar pull-request-available stale-assigned (was: Pulsar pull-request-available)

[jira] [Updated] (FLINK-23944) PulsarSourceITCase.testTaskManagerFailure is instable

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-23944: --- Labels: pull-request-available stale-assigned test-stability (was: pull-request-available t

[jira] [Updated] (FLINK-28078) ZooKeeperMultipleComponentLeaderElectionDriverTest.testLeaderElectionWithMultipleDrivers runs into timeout

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28078: --- Labels: stale-assigned test-stability (was: test-stability) I am the [Flink Jira Bot|https:

[jira] [Updated] (FLINK-25764) Docker sets JobManager's rpc address to same host by default

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-25764: --- Labels: auto-deprioritized-minor usability (was: stale-minor usability) Priority: Not

[jira] [Updated] (FLINK-27750) The configuration of JobManagerOption.TOTAL_PROCESS_MEMORY(jobmanager.memory.process.size) not work

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-27750: --- Labels: TOTAL_PROCESS_MEMORY auto-deprioritized-major jobmanager.memory.process.size (was

[jira] [Updated] (FLINK-28347) Update testcontainers dependency to v1.17.3

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28347: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the [Flink

[jira] [Updated] (FLINK-28082) Support end to end encryption on Pulsar connector.

2022-07-31 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-28082: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the [Flink

[GitHub] [flink] JesseAtSZ commented on pull request #20091: [FLINK-27570][runtime] Fix checkFailureCounter in CheckpointFailureManager for finalize failure

2022-07-31 Thread GitBox
JesseAtSZ commented on PR #20091: URL: https://github.com/apache/flink/pull/20091#issuecomment-1200444798 How can I construct `FINALIZE_CHECKPOINT_FAILURE`? I tried to implement a `CheckpointStorage`, but I found that there are too many methods to implement. `@Test(timeout = 20_00

[jira] (FLINK-26270) Flink SQL write data to kafka by CSV format , decimal type was converted to scientific notation

2022-07-31 Thread Jiankun Feng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26270 ] Jiankun Feng deleted comment on FLINK-26270: -- was (Author: JIRAUSER284851): hi [~martijnvisser] , I submitted a PR but so far no results , Can you take a look ? thanks > Flink SQL write da

[GitHub] [flink] sunshineJK commented on a diff in pull request #20127: [FLINK-26270] Flink SQL write data to kafka by CSV format , whether d…

2022-07-31 Thread GitBox
sunshineJK commented on code in PR #20127: URL: https://github.com/apache/flink/pull/20127#discussion_r916412976 ## flink-formats/flink-csv/src/main/java/org/apache/flink/formats/csv/CsvFormatOptions.java: ## @@ -87,5 +87,12 @@ public class CsvFormatOptions {

[jira] [Created] (FLINK-28756) Can't write nested object to parquet flink 1.15.1

2022-07-31 Thread Jonathan diamant (Jira)
Jonathan diamant created FLINK-28756: Summary: Can't write nested object to parquet flink 1.15.1 Key: FLINK-28756 URL: https://issues.apache.org/jira/browse/FLINK-28756 Project: Flink Iss

[jira] [Closed] (FLINK-26410) support hive transform

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-26410. --- Fix Version/s: 1.16.0 Resolution: Fixed Fixed in master: faf37ebb2bbf385fbb9b6163bbf7a09353a0e39d >

[jira] [Updated] (FLINK-26410) support hive transform using syntax

2022-07-31 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-26410: Summary: support hive transform using syntax (was: support hive transform) > support hive transform using

[GitHub] [flink] wuchong merged pull request #19818: [FLINK-26410][hive] Hive dialect supports "transform using 'script'"

2022-07-31 Thread GitBox
wuchong merged PR #19818: URL: https://github.com/apache/flink/pull/19818 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apach

[GitHub] [flink-connector-redis] eskabetxe commented on pull request #3: [FLINK-15571] Add Redis sink

2022-07-31 Thread GitBox
eskabetxe commented on PR #3: URL: https://github.com/apache/flink-connector-redis/pull/3#issuecomment-1200411096 Hi @sazzad16, Im not an expert on Redis Streams, but I think bot ways must be implemented.. For my knowledge, Redis Streams is used like (sorry for the analogy) if you are

[GitHub] [flink-connector-redis] sazzad16 commented on pull request #3: [FLINK-15571] Add Redis sink

2022-07-31 Thread GitBox
sazzad16 commented on PR #3: URL: https://github.com/apache/flink-connector-redis/pull/3#issuecomment-1200398428 @MartijnVisser The FLIP is great! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink-connector-redis] sazzad16 commented on pull request #3: [FLINK-15571] Add Redis sink

2022-07-31 Thread GitBox
sazzad16 commented on PR #3: URL: https://github.com/apache/flink-connector-redis/pull/3#issuecomment-1200398367 Hi @eskabetxe, nice to meet you. I see that the user would have to set (and so know and understand) exact Redis command which I feel not very intuitive from user's perspec

[GitHub] [flink] HuangXingBo commented on pull request #20396: [FLINK-28745][python] Support DataStream PythonCoProcessOperator and PythonKeyedCoProcessOperator in Thread Mode

2022-07-31 Thread GitBox
HuangXingBo commented on PR #20396: URL: https://github.com/apache/flink/pull/20396#issuecomment-1200393131 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [flink] HuangXingBo commented on pull request #20396: [FLINK-28745][python] Support DataStream PythonCoProcessOperator and PythonKeyedCoProcessOperator in Thread Mode

2022-07-31 Thread GitBox
HuangXingBo commented on PR #20396: URL: https://github.com/apache/flink/pull/20396#issuecomment-1200393104 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [flink] flinkbot commented on pull request #20399: [FLINK-28699][StateBackend] Native rocksdb full snapshot in non-incremental checkpointing

2022-07-31 Thread GitBox
flinkbot commented on PR #20399: URL: https://github.com/apache/flink/pull/20399#issuecomment-1200390146 ## CI report: * 956d62bec9fd45c3cbb04a535c4d270ad3d10d42 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] take-it-out commented on pull request #20399: [FLINK-28699][StateBackend] Native rocksdb full snapshot in non-incremental checkpointing

2022-07-31 Thread GitBox
take-it-out commented on PR #20399: URL: https://github.com/apache/flink/pull/20399#issuecomment-1200389179 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[jira] [Updated] (FLINK-28699) Native rocksdb full snapshot in non-incremental checkpointing

2022-07-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28699: --- Labels: pull-request-available (was: ) > Native rocksdb full snapshot in non-incremental ch

[GitHub] [flink] take-it-out opened a new pull request, #20399: [FLINK-28699][StateBackend] Native rocksdb full snapshot in non-incremental checkpointing

2022-07-31 Thread GitBox
take-it-out opened a new pull request, #20399: URL: https://github.com/apache/flink/pull/20399 ## What is the purpose of the change When rocksdb statebackend is used and state.backend.incremental enabled, flink will figure out newly created sst files generated by rocksdb during c

[jira] [Created] (FLINK-28755) Error when switching from stateless to savepoint upgrade mode

2022-07-31 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28755: -- Summary: Error when switching from stateless to savepoint upgrade mode Key: FLINK-28755 URL: https://issues.apache.org/jira/browse/FLINK-28755 Project: Flink Is

[GitHub] [flink] lincoln-lil commented on a diff in pull request #20359: [FLINK-28682][table-planner] support join hint in batch rules

2022-07-31 Thread GitBox
lincoln-lil commented on code in PR #20359: URL: https://github.com/apache/flink/pull/20359#discussion_r933950487 ## flink-table/flink-table-planner/src/main/java/org/apache/calcite/rel/logical/LogicalTableScan.java: ## @@ -103,7 +105,9 @@ public RelNode copy(RelTraitSet traitSe

[jira] [Assigned] (FLINK-28625) Guard against changing target session deployment for sessionjob

2022-07-31 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-28625: -- Assignee: Aitozi > Guard against changing target session deployment for sessionjob >