[jira] [Created] (FLINK-28341) Fix comment in BytesKeyNormalizationUtil.java

2022-07-01 Thread shen (Jira)
shen created FLINK-28341: Summary: Fix comment in BytesKeyNormalizationUtil.java Key: FLINK-28341 URL: https://issues.apache.org/jira/browse/FLINK-28341 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-28342) Flink batch support for Hive StorageHandlers

2022-07-01 Thread tartarus (Jira)
tartarus created FLINK-28342: Summary: Flink batch support for Hive StorageHandlers Key: FLINK-28342 URL: https://issues.apache.org/jira/browse/FLINK-28342 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-28343) Hive dialect fails using union map type

2022-07-01 Thread tartarus (Jira)
tartarus created FLINK-28343: Summary: Hive dialect fails using union map type Key: FLINK-28343 URL: https://issues.apache.org/jira/browse/FLINK-28343 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-244: Support IterativeCondition with Accumulator in CEP Pattern

2022-07-01 Thread Martijn Visser
Hi Mingde Peng, Thanks for creating the FLIP. I have no strong opinion on this topic, but I am curious if there are others who would like to chip-in to move this FLIP forward. Best regards, Martijn Op wo 22 jun. 2022 om 09:24 schreef md peng : > Hi everyone, > > IterativeCondition defines a us

Re: Re: Re: [DISCUSS] FLIP-239: Port JDBC Connector Source to FLIP-27

2022-07-01 Thread Dong Weike
Hi, Thank you for bringing this up, and I am +1 for this feature. IMO, one important thing that I would like to mention is that an improperly-designed FLIP-27 connector could impose very severe memory pressure on the JobManager, especially when there are enormous number of splits for the sourc

[jira] [Created] (FLINK-28344) How to connect flink and elasticsearch in pyflink 1.15.0?

2022-07-01 Thread ela demir (Jira)
ela demir created FLINK-28344: - Summary: How to connect flink and elasticsearch in pyflink 1.15.0? Key: FLINK-28344 URL: https://issues.apache.org/jira/browse/FLINK-28344 Project: Flink Issue Typ

Re: [DISCUSS] Support partition pruning for streaming reading

2022-07-01 Thread Martijn Visser
Hi zoucao, I think this topic deserves a proper FLIP and a vote. This approach is focussed only on Hive, but I would also like to understand the implications for FileSource. Can you create one? Best regards, Martijn Op wo 22 jun. 2022 om 18:50 schreef cao zou : > Hi devs, I want to start a dis

[jira] [Created] (FLINK-28345) Flink Jdbc connector should check batch count before flush

2022-07-01 Thread Feng Jin (Jira)
Feng Jin created FLINK-28345: Summary: Flink Jdbc connector should check batch count before flush Key: FLINK-28345 URL: https://issues.apache.org/jira/browse/FLINK-28345 Project: Flink Issue Type

[jira] [Created] (FLINK-28346) Wrong plan when selects metadata in a different order against ddl

2022-07-01 Thread lincoln lee (Jira)
lincoln lee created FLINK-28346: --- Summary: Wrong plan when selects metadata in a different order against ddl Key: FLINK-28346 URL: https://issues.apache.org/jira/browse/FLINK-28346 Project: Flink

[jira] [Created] (FLINK-28347) Update testcontainers dependency to v1.17.3

2022-07-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28347: -- Summary: Update testcontainers dependency to v1.17.3 Key: FLINK-28347 URL: https://issues.apache.org/jira/browse/FLINK-28347 Project: Flink Issue Type: T

Re: [DISCUSS] FLIP-238: Introduce FLIP-27-based Data Generator Source

2022-07-01 Thread Becket Qin
Hi Alex, In FLIP-27 source, the SourceReader can get a SourceReaderContext. This is passed in by the TM in Source#createReader(). And supposedly the Source should pass this to the SourceReader if needed. In the SourceReaderContext, currently only the index of the current subtask is available, but

[jira] [Created] (FLINK-28348) Add configurable flag to disable last-state fallback for savepoint upgrade

2022-07-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28348: -- Summary: Add configurable flag to disable last-state fallback for savepoint upgrade Key: FLINK-28348 URL: https://issues.apache.org/jira/browse/FLINK-28348 Project: Flink

[jira] [Created] (FLINK-28349) Consider using resource uid as fixed jobid for operator deployed jobs

2022-07-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28349: -- Summary: Consider using resource uid as fixed jobid for operator deployed jobs Key: FLINK-28349 URL: https://issues.apache.org/jira/browse/FLINK-28349 Project: Flink

[jira] [Created] (FLINK-28350) Test last-state upgrades across Flink minor versions

2022-07-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28350: -- Summary: Test last-state upgrades across Flink minor versions Key: FLINK-28350 URL: https://issues.apache.org/jira/browse/FLINK-28350 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-01 Thread Jing Zhang
Hi Guowei, Thanks a lot for your feedback. Your advices are really helpful. I've updated the FLIP-245[1] to includes these parts. > First of all, please complete the fault-tolerant processing flow in the FLIP. After an execution is created and a source operator becomes ready to receive events, s

Re: [DISCUSS] FLIP-245: Source Supports Speculative Execution For Batch Job

2022-07-01 Thread Jing Zhang
Hi all, After an offline discussion with Jiangjie (Becket) Qin, Guowei, Zhuzhu, I've updated the FLIP-245[1] to including: 1. Complete the fault-tolerant processing flow. 2. Support for SourceEvent because it's useful for some user-defined sources which have a custom event protocol between reader a

[jira] [Created] (FLINK-28351) Pulsar Sink should support dynamic generated topic from record

2022-07-01 Thread Yufan Sheng (Jira)
Yufan Sheng created FLINK-28351: --- Summary: Pulsar Sink should support dynamic generated topic from record Key: FLINK-28351 URL: https://issues.apache.org/jira/browse/FLINK-28351 Project: Flink

[jira] [Created] (FLINK-28352) [Umbrella] Make Pulsar connector stable

2022-07-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28352: -- Summary: [Umbrella] Make Pulsar connector stable Key: FLINK-28352 URL: https://issues.apache.org/jira/browse/FLINK-28352 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-28353) Exclude unschedulable nodes using IP addresses of kubernetes nodes

2022-07-01 Thread Suxing Lee (Jira)
Suxing Lee created FLINK-28353: -- Summary: Exclude unschedulable nodes using IP addresses of kubernetes nodes Key: FLINK-28353 URL: https://issues.apache.org/jira/browse/FLINK-28353 Project: Flink

[jira] [Created] (FLINK-28354) Support instr and locate bulit-in function in Table API

2022-07-01 Thread LuNing Wang (Jira)
LuNing Wang created FLINK-28354: --- Summary: Support instr and locate bulit-in function in Table API Key: FLINK-28354 URL: https://issues.apache.org/jira/browse/FLINK-28354 Project: Flink Issue T

[jira] [Created] (FLINK-28355) Python Bash e2e tests don't clean-up after they've ran, causing disk space issues

2022-07-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-28355: -- Summary: Python Bash e2e tests don't clean-up after they've ran, causing disk space issues Key: FLINK-28355 URL: https://issues.apache.org/jira/browse/FLINK-28355

[jira] [Created] (FLINK-28356) Move operator metric recording logic into statusrecorder

2022-07-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28356: -- Summary: Move operator metric recording logic into statusrecorder Key: FLINK-28356 URL: https://issues.apache.org/jira/browse/FLINK-28356 Project: Flink Issue T

[jira] [Created] (FLINK-28357) Watermark issue when recovering Finished sources

2022-07-01 Thread James (Jira)
James created FLINK-28357: - Summary: Watermark issue when recovering Finished sources Key: FLINK-28357 URL: https://issues.apache.org/jira/browse/FLINK-28357 Project: Flink Issue Type: Bug

Re: [VOTE] Release 1.15.1, release candidate #1

2022-07-01 Thread Konstantin Knauf
Hi everyone, I would like to raise the question if we should abort this release candidate at the current stage because of newly found bugs? * The minimal voting period had already passed and with one addition binding vote (e.g. mine), we could release this immediately and ship all the other fixes

[jira] [Created] (FLINK-28358) when debug in local ,throw out "The system time period specification expects Timestamp type but is 'TIMESTAMP_WITH_LOCAL_TIME_ZONE' " exception

2022-07-01 Thread PengfeiChang (Jira)
PengfeiChang created FLINK-28358: Summary: when debug in local ,throw out "The system time period specification expects Timestamp type but is 'TIMESTAMP_WITH_LOCAL_TIME_ZONE' " exception Key: FLINK-28358 URL: htt

RE: Re: Re: Re: [DISCUSS] FLIP-239: Port JDBC Connector Source to FLIP-27

2022-07-01 Thread Roc Marshal
Hi, Weike. Thank you for your reply As you said, too many splits stored in SourceEnumerator will increase the load of JM. What do you think if we introduce a capacity of splits in SourceEnumerator to limit the total number, and introduce a reject or callback mechanism with too many splits in th