[jira] [Created] (FLINK-28422) Fall back to lastest supported HiveShim when user use a higher hive version

2022-07-05 Thread luoyuxia (Jira)
luoyuxia created FLINK-28422: Summary: Fall back to lastest supported HiveShim when user use a higher hive version Key: FLINK-28422 URL: https://issues.apache.org/jira/browse/FLINK-28422 Project: Flink

[jira] [Created] (FLINK-28421) Support full caching in lookup table source

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28421: - Summary: Support full caching in lookup table source Key: FLINK-28421 URL: https://issues.apache.org/jira/browse/FLINK-28421 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-28420) Support partial lookup caching in lookup join runners

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28420: - Summary: Support partial lookup caching in lookup join runners Key: FLINK-28420 URL: https://issues.apache.org/jira/browse/FLINK-28420 Project: Flink Issue

[jira] [Created] (FLINK-28419) Add runtime provider interface for full caching lookup

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28419: - Summary: Add runtime provider interface for full caching lookup Key: FLINK-28419 URL: https://issues.apache.org/jira/browse/FLINK-28419 Project: Flink Issu

[jira] [Created] (FLINK-28418) Add runtime provider interface for partial caching lookup

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28418: - Summary: Add runtime provider interface for partial caching lookup Key: FLINK-28418 URL: https://issues.apache.org/jira/browse/FLINK-28418 Project: Flink I

[jira] [Created] (FLINK-28417) Add interface and default implementation for cache in lookup table

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28417: - Summary: Add interface and default implementation for cache in lookup table Key: FLINK-28417 URL: https://issues.apache.org/jira/browse/FLINK-28417 Project: Flink

[jira] [Created] (FLINK-28416) Add the new LookupFunction interface for Lookup table source

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28416: - Summary: Add the new LookupFunction interface for Lookup table source Key: FLINK-28416 URL: https://issues.apache.org/jira/browse/FLINK-28416 Project: Flink

[jira] [Created] (FLINK-28415) FLIP-221: Support Partial and Full Caching in Lookup Table Source

2022-07-05 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28415: - Summary: FLIP-221: Support Partial and Full Caching in Lookup Table Source Key: FLINK-28415 URL: https://issues.apache.org/jira/browse/FLINK-28415 Project: Flink

[jira] [Created] (FLINK-28414) Using flink to query the hive table, an exception occurred, SQL validation failed. Failed to get table schema from deserializer

2022-07-05 Thread xcrossed (Jira)
xcrossed created FLINK-28414: Summary: Using flink to query the hive table, an exception occurred, SQL validation failed. Failed to get table schema from deserializer Key: FLINK-28414 URL: https://issues.apache.org/j

[jira] [Created] (FLINK-28413) Support ParquetColumnarRowInputFormat in PyFlink

2022-07-05 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28413: - Summary: Support ParquetColumnarRowInputFormat in PyFlink Key: FLINK-28413 URL: https://issues.apache.org/jira/browse/FLINK-28413 Project: Flink Issue Type: New Fe

Re: Python Job Support for the Kubernetes Operator

2022-07-05 Thread Dian Fu
Thanks for the confirmation Matyas! On Tue, Jul 5, 2022 at 3:00 PM Őrhidi Mátyás wrote: > Yes, this is the plan Dian. Appreciate your assistance! > > Best, > Matyas > > On Tue, Jul 5, 2022 at 8:55 AM Dian Fu wrote: > >> Hi Matyas, >> >> According to the release schedule defined in [1], it seems

Re: [VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-05 Thread Zhu Zhu
+1 (binding) Thanks, Zhu Guowei Ma 于2022年7月5日周二 17:38写道: > > +1 (binding) > Best, > Guowei > > > On Tue, Jul 5, 2022 at 12:38 PM Jiangang Liu > wrote: > > > +1 for the feature. > > > > Jing Zhang 于2022年7月5日周二 11:43写道: > > > > > Hi all, > > > > > > I'd like to start a vote for FLIP-245: Source

[jira] [Created] (FLINK-28412) kubernetes-client doesn't infer kubeconfig encryption algorithm and failed on k3s

2022-07-05 Thread wangqi (Jira)
wangqi created FLINK-28412: -- Summary: kubernetes-client doesn't infer kubeconfig encryption algorithm and failed on k3s Key: FLINK-28412 URL: https://issues.apache.org/jira/browse/FLINK-28412 Project: Flink

Re: [DISCUSS] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-05 Thread Becket Qin
Hi Alex, Personally I prefer the latter option, i.e. just add the currentParallelism() method. It is easy to add more stuff to the SourceReaderContext in the future, and it is likely that most of the stuff in the RuntimeContext is not required by the SourceReader implementations. For the purpose o

[jira] [Created] (FLINK-28411) OperatorCoordinator exception may fail Session Cluster

2022-07-05 Thread Daren Wong (Jira)
Daren Wong created FLINK-28411: -- Summary: OperatorCoordinator exception may fail Session Cluster Key: FLINK-28411 URL: https://issues.apache.org/jira/browse/FLINK-28411 Project: Flink Issue Type

[jira] [Created] (FLINK-28410) Add Elasticsearch E2E test cases to the external repository

2022-07-05 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-28410: - Summary: Add Elasticsearch E2E test cases to the external repository Key: FLINK-28410 URL: https://issues.apache.org/jira/browse/FLINK-28410 Project: Flink

[jira] [Created] (FLINK-28409) Move FlinkContainerTestEnvironment and its dependencied into flink-connector-test-utils

2022-07-05 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-28409: - Summary: Move FlinkContainerTestEnvironment and its dependencied into flink-connector-test-utils Key: FLINK-28409 URL: https://issues.apache.org/jira/browse/FLINK-28409

Re: [DISCUSS] Creating benchmark channel in Apache Flink slack

2022-07-05 Thread Martijn Visser
Hi Anton, I recalled that it was brought up before and it was indeed (when the announcement email was sent [1]). +1 for doing this. Best regards, Martijn [1] https://lists.apache.org/thread/kqjtrlnw33h1mybyx3gg4ff4390y5wbz Op di 5 jul. 2022 om 16:12 schreef Piotr Nowojski : > Hi Anton, > > T

Re: [DISCUSS] Creating benchmark channel in Apache Flink slack

2022-07-05 Thread Piotr Nowojski
Hi Anton, Thanks for the proposal. +1 for this. The higher visibility in the community of the benchmarks, benchmarking process and it's result the better. Best, Piotrek wt., 5 lip 2022 o 16:10 Anton Kalashnikov napisał(a): > Hi everyone, > > > As you know, we have Flink benchmarks[1], and all

[DISCUSS] Creating benchmark channel in Apache Flink slack

2022-07-05 Thread Anton Kalashnikov
Hi everyone, As you know, we have Flink benchmarks[1], and all of these benchmarks constantly running several times per day. The result of this can be found in Codespeed panel[2]. The problem is that only several people follow the result of these benchmarks since it is not possible to ask e

[RESULT][VOTE] Release 1.15.1, release candidate #1

2022-07-05 Thread David Anderson
I am pleased to announce that we have approved this release candidate. There are 7 approving votes, 4 of which are binding: - Chesnay Schepler (+1 binding) - Xingbo Huang (+1 non-binding) - Qingsheng Ren (+1 non-binding) - Robert Metzger (+1 binding) - Konstantin Knauf (+1 binding) - Jingsong Li (

[jira] [Created] (FLINK-28408) FAQ / best practices page for Kubernetes Operator

2022-07-05 Thread Jira
Márton Balassi created FLINK-28408: -- Summary: FAQ / best practices page for Kubernetes Operator Key: FLINK-28408 URL: https://issues.apache.org/jira/browse/FLINK-28408 Project: Flink Issue T

[jira] [Created] (FLINK-28407) Make Jenkins benchmark script more autonomous

2022-07-05 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-28407: - Summary: Make Jenkins benchmark script more autonomous Key: FLINK-28407 URL: https://issues.apache.org/jira/browse/FLINK-28407 Project: Flink Issue

[jira] [Created] (FLINK-28406) Build fails on retrieving org.pentaho:pentaho-aggdesigner-algorithm

2022-07-05 Thread Prabhu Joseph (Jira)
Prabhu Joseph created FLINK-28406: - Summary: Build fails on retrieving org.pentaho:pentaho-aggdesigner-algorithm Key: FLINK-28406 URL: https://issues.apache.org/jira/browse/FLINK-28406 Project: Flink

Re: [DISCUSS] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-05 Thread Alexander Fedulov
Hi Becket, I agree with you. We could introduce a *ReadOnlyRuntimeContext* that would act as a holder for the *RuntimeContext* data. This would also require read-only wrappers for the exposed fields, such as *ExecutionConfig*. Alternatively, we just add the *currentParallelism()* method for now an

[jira] [Created] (FLINK-28405) Update used Confluent Platform images to v7.12

2022-07-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28405: -- Summary: Update used Confluent Platform images to v7.12 Key: FLINK-28405 URL: https://issues.apache.org/jira/browse/FLINK-28405 Project: Flink Issue Type

[jira] [Created] (FLINK-28404) Annotation @InjectClusterClient do not work correctly

2022-07-05 Thread zl (Jira)
zl created FLINK-28404: -- Summary: Annotation @InjectClusterClient do not work correctly Key: FLINK-28404 URL: https://issues.apache.org/jira/browse/FLINK-28404 Project: Flink Issue Type: Bug C

[jira] [Created] (FLINK-28403) SqlParserPos value for SqlCall is ambiguous

2022-07-05 Thread suheng.cloud (Jira)
suheng.cloud created FLINK-28403: Summary: SqlParserPos value for SqlCall is ambiguous Key: FLINK-28403 URL: https://issues.apache.org/jira/browse/FLINK-28403 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28402) Create FailureHandlingResultSnapshot with the truly failed execution

2022-07-05 Thread Zhu Zhu (Jira)
Zhu Zhu created FLINK-28402: --- Summary: Create FailureHandlingResultSnapshot with the truly failed execution Key: FLINK-28402 URL: https://issues.apache.org/jira/browse/FLINK-28402 Project: Flink I

Re: [VOTE] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-05 Thread Guowei Ma
+1 (binding) Best, Guowei On Tue, Jul 5, 2022 at 12:38 PM Jiangang Liu wrote: > +1 for the feature. > > Jing Zhang 于2022年7月5日周二 11:43写道: > > > Hi all, > > > > I'd like to start a vote for FLIP-245: Source Supports Speculative > > Execution For Batch Job[1] on the discussion thread [2]. > > > >

[ACTION REQUESTED] Flink 1.16 Release Sync update

2022-07-05 Thread Martijn Visser
Hi everyone, We've just finished our 1.16 release sync update and would like to update you on the current status and request for your help: 1. The Flink 1.16 release branch is expected to be cut in 3 weeks, which means that we will cut the release branch and start with the release testing. New fe

[jira] [Created] (FLINK-28401) Remove snapshot repo from quickstarts for released versions

2022-07-05 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-28401: Summary: Remove snapshot repo from quickstarts for released versions Key: FLINK-28401 URL: https://issues.apache.org/jira/browse/FLINK-28401 Project: Flink

[jira] [Created] (FLINK-28400) Customize table source. After inheriting Richparallelsourcefunction class, data disorder under Multiple Parallelism

2022-07-05 Thread thecai (Jira)
thecai created FLINK-28400: -- Summary: Customize table source. After inheriting Richparallelsourcefunction class, data disorder under Multiple Parallelism Key: FLINK-28400 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-28399) Refactor CheckedThread to accept runnable via constructor

2022-07-05 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-28399: Summary: Refactor CheckedThread to accept runnable via constructor Key: FLINK-28399 URL: https://issues.apache.org/jira/browse/FLINK-28399 Project: Flink

[jira] [Created] (FLINK-28398) CheckpointCoordinatorTriggeringTest.discardingTriggeringCheckpointWillExecuteNextCheckpointRequest( gets stuck

2022-07-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28398: -- Summary: CheckpointCoordinatorTriggeringTest.discardingTriggeringCheckpointWillExecuteNextCheckpointRequest( gets stuck Key: FLINK-28398 URL: https://issues.apache.org/jira/b

[jira] [Created] (FLINK-28397) Source Supports Speculative Execution For Batch Job

2022-07-05 Thread Jing Zhang (Jira)
Jing Zhang created FLINK-28397: -- Summary: Source Supports Speculative Execution For Batch Job Key: FLINK-28397 URL: https://issues.apache.org/jira/browse/FLINK-28397 Project: Flink Issue Type: S

[jira] [Created] (FLINK-28396) Add doc versions to k8s operator docs

2022-07-05 Thread Jira
Márton Balassi created FLINK-28396: -- Summary: Add doc versions to k8s operator docs Key: FLINK-28396 URL: https://issues.apache.org/jira/browse/FLINK-28396 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-28395) Elasticsearch6DynamicSinkITCase.testWritingDocumentsFromTableApi fails with Elasticsearch exception [type=index_not_found_exception, reason=no such index]

2022-07-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28395: -- Summary: Elasticsearch6DynamicSinkITCase.testWritingDocumentsFromTableApi fails with Elasticsearch exception [type=index_not_found_exception, reason=no such index] Key: FLINK-28395

[jira] [Created] (FLINK-28394) Python py36-cython: InvocationError for command install_command.sh fails with exit code 1

2022-07-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28394: -- Summary: Python py36-cython: InvocationError for command install_command.sh fails with exit code 1 Key: FLINK-28394 URL: https://issues.apache.org/jira/browse/FLINK-28394

[jira] [Created] (FLINK-28393) Support AvroInputFormat in PyFlink

2022-07-05 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28393: - Summary: Support AvroInputFormat in PyFlink Key: FLINK-28393 URL: https://issues.apache.org/jira/browse/FLINK-28393 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-28392) org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategyTest fails with exit code 239

2022-07-05 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28392: -- Summary: org.apache.flink.runtime.executiongraph.failover.flip1.RestartPipelinedRegionFailoverStrategyTest fails with exit code 239 Key: FLINK-28392 URL: https://issues.apach

Re: [VOTE] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-07-05 Thread Jark Wu
+1 (binding) Best, Jark On Tue, 5 Jul 2022 at 14:18, Mang Zhang wrote: > Hi everyone, > > > > > Thanks for all the feedback so far. Based on the discussion [1], we seem > to have consensus. So, I would like to re-start a vote on FLIP-218 [2]. > > > > > The vote will last for at least 72 hours

Re: [VOTE] Apache Flink ML Release 2.1.0, release candidate #2

2022-07-05 Thread Yun Gao
+1 (binding) - Verified the checksum and signatures. - Build from sources without exceptions. - Checked the artifacts uploading to the mvn repo is completed. - Reviewed the release PR and LGTM. Best, Yun Gao -- From:Dian Fu Send

[jira] [Created] (FLINK-28391) DefaultBlocklistHandlerTest unstable

2022-07-05 Thread Paul Lin (Jira)
Paul Lin created FLINK-28391: Summary: DefaultBlocklistHandlerTest unstable Key: FLINK-28391 URL: https://issues.apache.org/jira/browse/FLINK-28391 Project: Flink Issue Type: Bug Compon

[jira] [Created] (FLINK-28390) Allows RocksDB to configure FIFO Compaction to reduce CPU overhead.

2022-07-05 Thread ming li (Jira)
ming li created FLINK-28390: --- Summary: Allows RocksDB to configure FIFO Compaction to reduce CPU overhead. Key: FLINK-28390 URL: https://issues.apache.org/jira/browse/FLINK-28390 Project: Flink Is

[jira] [Created] (FLINK-28389) Correct spec and status updates in FlinkDeploymentControllerTest

2022-07-05 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-28389: - Summary: Correct spec and status updates in FlinkDeploymentControllerTest Key: FLINK-28389 URL: https://issues.apache.org/jira/browse/FLINK-28389 Project: Flink

[jira] [Created] (FLINK-28388) Python doc build breaking nightly docs

2022-07-05 Thread Jira
Márton Balassi created FLINK-28388: -- Summary: Python doc build breaking nightly docs Key: FLINK-28388 URL: https://issues.apache.org/jira/browse/FLINK-28388 Project: Flink Issue Type: Bug

[DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-05 Thread Gen Luo
Hi everyone, The speculative execution for batch jobs has been proposed and accepted in FLIP-168[1], as well as the related blocklist mechanism in FLIP-224[2]. As a follow-up step, the Flink Web UI needs to be enhanced to display the related information if the speculative execution mechanism is en

Re: Python Job Support for the Kubernetes Operator

2022-07-05 Thread Őrhidi Mátyás
Yes, this is the plan Dian. Appreciate your assistance! Best, Matyas On Tue, Jul 5, 2022 at 8:55 AM Dian Fu wrote: > Hi Matyas, > > According to the release schedule defined in [1], it seems that the > feature freeze of v1.2 may occur at the beginning of September, is this > correct? If this is