[NOTICE] StateFun docs have been migrated to new ASF Buildbot at ci2.apache.org

2021-08-16 Thread Tzu-Li (Gordon) Tai
Hi all, Just a quick announcement that we've officially migrated the StateFun docs to ASF's new buildbot at https://ci2.apache.org/. There are a few other notable changes that took part in this migration: - The buildbot configuration file now using Git, and lives at https://github.com/apache/inf

[jira] [Created] (FLINK-23798) Avoid using reflection to get filter when partition filter is enabled

2021-08-16 Thread Yun Tang (Jira)
Yun Tang created FLINK-23798: Summary: Avoid using reflection to get filter when partition filter is enabled Key: FLINK-23798 URL: https://issues.apache.org/jira/browse/FLINK-23798 Project: Flink

[jira] [Created] (FLINK-23799) application mode not support pyflink

2021-08-16 Thread zhou (Jira)
zhou created FLINK-23799: Summary: application mode not support pyflink Key: FLINK-23799 URL: https://issues.apache.org/jira/browse/FLINK-23799 Project: Flink Issue Type: Improvement Affects Vers

Re: [NOTICE] StateFun docs have been migrated to new ASF Buildbot at ci2.apache.org

2021-08-16 Thread Chesnay Schepler
Do you plan to migrate the Flink builders accordingly? On 16/08/2021 08:59, Tzu-Li (Gordon) Tai wrote: Hi all, Just a quick announcement that we've officially migrated the StateFun docs to ASF's new buildbot at https://ci2.apache.org/. There are a few other notable changes that took part in th

[jira] [Created] (FLINK-23800) Expose newly added RocksDB native metrics

2021-08-16 Thread Yun Tang (Jira)
Yun Tang created FLINK-23800: Summary: Expose newly added RocksDB native metrics Key: FLINK-23800 URL: https://issues.apache.org/jira/browse/FLINK-23800 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-23801) Add FLIP-33 metrics to KafkaSource

2021-08-16 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-23801: - Summary: Add FLIP-33 metrics to KafkaSource Key: FLINK-23801 URL: https://issues.apache.org/jira/browse/FLINK-23801 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-23802) [kinesis][efo] Reduce ReadTimeoutExceptions for Kinesis Consumer

2021-08-16 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-23802: - Summary: [kinesis][efo] Reduce ReadTimeoutExceptions for Kinesis Consumer Key: FLINK-23802 URL: https://issues.apache.org/jira/browse/FLINK-23802 Project: Flink

[jira] [Created] (FLINK-23803) Improve instantiation of InMemoryReporter

2021-08-16 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-23803: --- Summary: Improve instantiation of InMemoryReporter Key: FLINK-23803 URL: https://issues.apache.org/jira/browse/FLINK-23803 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-23804) Restructure documentation of built-in functions

2021-08-16 Thread Jira
Ingo Bürk created FLINK-23804: - Summary: Restructure documentation of built-in functions Key: FLINK-23804 URL: https://issues.apache.org/jira/browse/FLINK-23804 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-23805) Refer to flink-packages.org from documentation

2021-08-16 Thread Jira
Ingo Bürk created FLINK-23805: - Summary: Refer to flink-packages.org from documentation Key: FLINK-23805 URL: https://issues.apache.org/jira/browse/FLINK-23805 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-23806) StackOverflowException can happen if a large scale job failed to acquire enough slots in time

2021-08-16 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-23806: --- Summary: StackOverflowException can happen if a large scale job failed to acquire enough slots in time Key: FLINK-23806 URL: https://issues.apache.org/jira/browse/FLINK-23806 P

[jira] [Created] (FLINK-23807) Use metrics to detect restarts in MiniClusterTestEnvironment#triggerTaskManagerFailover

2021-08-16 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-23807: --- Summary: Use metrics to detect restarts in MiniClusterTestEnvironment#triggerTaskManagerFailover Key: FLINK-23807 URL: https://issues.apache.org/jira/browse/FLINK-23807

[jira] [Created] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23808: --- Summary: Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks Key: FLINK-23808 URL: https://issues.apache.org/jira/browse/FLINK-23808 Project: Fli

[jira] [Created] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23809: --- Summary: Respect the finished flag when extracting operator states due to skip in-flight data Key: FLINK-23809 URL: https://issues.apache.org/jira/browse/FLINK-23809 Project: F

[jira] [Created] (FLINK-23810) Print sql when parse failed , which is convenient to find error

2021-08-16 Thread hehuiyuan (Jira)
hehuiyuan created FLINK-23810: - Summary: Print sql when parse failed , which is convenient to find error Key: FLINK-23810 URL: https://issues.apache.org/jira/browse/FLINK-23810 Project: Flink

[DISCUSS] Stateful Functions 3.1.0 release?

2021-08-16 Thread Igal Shilman
Hi everyone! We would like to kick off a new StateFun release (3.1.0), this release will have some major features that users would benefit from, such as: * [FLINK-21308] Support delayed message cancellation. * [FLINK-23296] Support pluggable transports for remote functions invocation. * [FLINK-23

[jira] [Created] (FLINK-23811) Handle FINISHED subtasks in CommonTestUtils.waitForAllTaskRunning

2021-08-16 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-23811: - Summary: Handle FINISHED subtasks in CommonTestUtils.waitForAllTaskRunning Key: FLINK-23811 URL: https://issues.apache.org/jira/browse/FLINK-23811 Project:

[jira] [Created] (FLINK-23812) Support configuration of the RocksDB logging via configuration

2021-08-16 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-23812: --- Summary: Support configuration of the RocksDB logging via configuration Key: FLINK-23812 URL: https://issues.apache.org/jira/browse/FLINK-23812 Project: Flink

[jira] [Created] (FLINK-23813) DeleteExecutor NPE

2021-08-16 Thread Junning Liang (Jira)
Junning Liang created FLINK-23813: - Summary: DeleteExecutor NPE Key: FLINK-23813 URL: https://issues.apache.org/jira/browse/FLINK-23813 Project: Flink Issue Type: Bug Components: Co

Re: [DISCUSS] Stateful Functions 3.1.0 release?

2021-08-16 Thread 戴資力
Hi Igal, Thanks a lot for starting this discussion! The list of features sounds like this will be a great release. As the list is already quite packed with major features, +1 to feature freeze on August 20 so we can move towards 3.1.0. Thanks, Gordon On Mon, Aug 16, 2021, 18:57 Igal Shilman wr

Re: [DISCUSS] Stateful Functions 3.1.0 release?

2021-08-16 Thread Tzu-Li (Gordon) Tai
Hi Igal, Thanks a lot for starting this discussion! The list of features sounds like this will be a great release. As the list is already quite packed with major features, +1 to feature freeze on August 20 so we can move towards 3.1.0. Thanks, Gordon On Mon, Aug 16, 2021, 18:57 Igal Shilman wr

Re: [DISCUSS] Stateful Functions 3.1.0 release?

2021-08-16 Thread Seth Wiesman
+1 for the release On Mon, Aug 16, 2021 at 8:25 AM Gordon Tai (戴資力) wrote: > Hi Igal, > > Thanks a lot for starting this discussion! > > The list of features sounds like this will be a great release. As the list > is already quite packed with major features, +1 to feature freeze on August > 20

[jira] [Created] (FLINK-23814) Test FLIP-143 KafkaSink

2021-08-16 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-23814: --- Summary: Test FLIP-143 KafkaSink Key: FLINK-23814 URL: https://issues.apache.org/jira/browse/FLINK-23814 Project: Flink Issue Type: Sub-task Componen

[DISCUSS] Backport HybridSource to 1.13.x

2021-08-16 Thread Thomas Weise
Hi, HybridSource [1] [2] was recently merged to the main branch. I would like to propose to backport it to release-1.13. Although it is a new feature, it is also strictly additive and does not affect any existing code. The benefit is that we will have a released runtime version that the feature ca

[jira] [Created] (FLINK-23815) Follow-up code improvement regarding final checkpoint.

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23815: --- Summary: Follow-up code improvement regarding final checkpoint. Key: FLINK-23815 URL: https://issues.apache.org/jira/browse/FLINK-23815 Project: Flink Issue Type: Sub-

Re: [DISCUSS] Backport HybridSource to 1.13.x

2021-08-16 Thread Arvid Heise
Hi Thomas, since the change didn't modify any existing classes, I'm weakly in favor of backporting. My reluctance mainly stems from possible disappointments from 1.13 users that use an earlier bugfix level. So we need to make documentation clear. In general, I'm seeing connectors as something ext

Re: [DISCUSS] Backport HybridSource to 1.13.x

2021-08-16 Thread Thomas Weise
Hi Arvid, Thank you for the reply. Can you please explain a bit more your concern regarding an earlier bugfix level? I should have maybe made clear that the HybridSource can be used by updating flink-connector-base in the application jar. It does not require any addition to the runtime and theref

[jira] [Created] (FLINK-23816) Test new (Kafka) metrics in cluster

2021-08-16 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-23816: --- Summary: Test new (Kafka) metrics in cluster Key: FLINK-23816 URL: https://issues.apache.org/jira/browse/FLINK-23816 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Backport HybridSource to 1.13.x

2021-08-16 Thread Arvid Heise
Hi Thomas, that's neat. I forgot for a moment that connector-base is not part of flink-dist. I guess in theory, we could also omit the backport and simply refer users to 1.14 version. I'm assuming you want to have it in 1.13 since 1.14 still takes a bit. Am I correct? On Mon, Aug 16, 2021 at 7:4

[jira] [Created] (FLINK-23817) Write documentation for standardized operator metrics

2021-08-16 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-23817: --- Summary: Write documentation for standardized operator metrics Key: FLINK-23817 URL: https://issues.apache.org/jira/browse/FLINK-23817 Project: Flink Issue Typ

Re: [DISCUSS] Backport HybridSource to 1.13.x

2021-08-16 Thread Thomas Weise
Hi Arvid, I would not recommend to mix minor Flink versions: 1. As you said, 1.14 isn't released yet and most users would prefer to not depend on snapshots 2. There could be unrelated changes between 1.13 and 1.14 that make the use of 1.14 artifact with 1.13 impossible or lead to unforeseen side

[ANNOUNCE] Flink 1.14 Feature Freeze

2021-08-16 Thread Xintong Song
Hi all, The deadline for merging new features for Flink 1.14 has passed. *From now on, only bug-fixes and documentation fixes / improvements are allowed to be merged into the master branch.* New features merged after this point can be reverted. If you need an exception to this rule, please open a

[jira] [Created] (FLINK-23818) Add documentation about tgz files support for python archives

2021-08-16 Thread Dian Fu (Jira)
Dian Fu created FLINK-23818: --- Summary: Add documentation about tgz files support for python archives Key: FLINK-23818 URL: https://issues.apache.org/jira/browse/FLINK-23818 Project: Flink Issue Ty

[jira] [Created] (FLINK-23819) Testing tgz file for python archives

2021-08-16 Thread Dian Fu (Jira)
Dian Fu created FLINK-23819: --- Summary: Testing tgz file for python archives Key: FLINK-23819 URL: https://issues.apache.org/jira/browse/FLINK-23819 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-23820) Test profiling for Python user-defined functions

2021-08-16 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-23820: Summary: Test profiling for Python user-defined functions Key: FLINK-23820 URL: https://issues.apache.org/jira/browse/FLINK-23820 Project: Flink Issue Type:

[jira] [Created] (FLINK-23821) Test loopback mode to allow Python UDF worker and client reuse the same Python VM

2021-08-16 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-23821: Summary: Test loopback mode to allow Python UDF worker and client reuse the same Python VM Key: FLINK-23821 URL: https://issues.apache.org/jira/browse/FLINK-23821 Pro

[jira] [Created] (FLINK-23822) Test config state ttl in Python DataStream API

2021-08-16 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-23822: Summary: Test config state ttl in Python DataStream API Key: FLINK-23822 URL: https://issues.apache.org/jira/browse/FLINK-23822 Project: Flink Issue Type: Im

[jira] [Created] (FLINK-23823) Test specifying python client interpreter used to compile jobs

2021-08-16 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-23823: Summary: Test specifying python client interpreter used to compile jobs Key: FLINK-23823 URL: https://issues.apache.org/jira/browse/FLINK-23823 Project: Flink

[jira] [Created] (FLINK-23824) Test interoperability between DataStream and Table API in PyFlink Table API

2021-08-16 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-23824: Summary: Test interoperability between DataStream and Table API in PyFlink Table API Key: FLINK-23824 URL: https://issues.apache.org/jira/browse/FLINK-23824 Project:

[jira] [Created] (FLINK-23825) Test SQL Client manually

2021-08-16 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-23825: - Summary: Test SQL Client manually Key: FLINK-23825 URL: https://issues.apache.org/jira/browse/FLINK-23825 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-23826) Verify optimized scheduler performance for large-scale jobs

2021-08-16 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-23826: --- Summary: Verify optimized scheduler performance for large-scale jobs Key: FLINK-23826 URL: https://issues.apache.org/jira/browse/FLINK-23826 Project: Flink Issue Type

[jira] [Created] (FLINK-23827) Fix ModifiedMonotonicity inference for some node

2021-08-16 Thread Shuo Cheng (Jira)
Shuo Cheng created FLINK-23827: -- Summary: Fix ModifiedMonotonicity inference for some node Key: FLINK-23827 URL: https://issues.apache.org/jira/browse/FLINK-23827 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-23828) KafkaSourceITCase.testIdleReader fails on azure

2021-08-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-23828: Summary: KafkaSourceITCase.testIdleReader fails on azure Key: FLINK-23828 URL: https://issues.apache.org/jira/browse/FLINK-23828 Project: Flink Issue Type: B

[jira] [Created] (FLINK-23829) SavepointITCase JVM crash on azure

2021-08-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-23829: Summary: SavepointITCase JVM crash on azure Key: FLINK-23829 URL: https://issues.apache.org/jira/browse/FLINK-23829 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-23830) FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on azure

2021-08-16 Thread Xintong Song (Jira)
Xintong Song created FLINK-23830: Summary: FlinkKafkaProducerMigrationOperatorTest.testRestoreProducer fails on azure Key: FLINK-23830 URL: https://issues.apache.org/jira/browse/FLINK-23830 Project: F

[jira] [Created] (FLINK-23831) Verify the final checkpoint and stop-with-savepoint --drain

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23831: --- Summary: Verify the final checkpoint and stop-with-savepoint --drain Key: FLINK-23831 URL: https://issues.apache.org/jira/browse/FLINK-23831 Project: Flink Issue Type

[jira] [Created] (FLINK-23832) Add documentation for batch mode in StreamTableEnvironment

2021-08-16 Thread Timo Walther (Jira)
Timo Walther created FLINK-23832: Summary: Add documentation for batch mode in StreamTableEnvironment Key: FLINK-23832 URL: https://issues.apache.org/jira/browse/FLINK-23832 Project: Flink Is