[jira] [Created] (FLINK-28484) UniqueKey inference should respect the semantics of null as well as consider the possibility of precision loss from implicit conversions

2022-07-11 Thread lincoln lee (Jira)
lincoln lee created FLINK-28484: --- Summary: UniqueKey inference should respect the semantics of null as well as consider the possibility of precision loss from implicit conversions Key: FLINK-28484 URL: https://issue

[jira] [Created] (FLINK-28485) Structure examples better and add README/doc

2022-07-11 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28485: -- Summary: Structure examples better and add README/doc Key: FLINK-28485 URL: https://issues.apache.org/jira/browse/FLINK-28485 Project: Flink Issue Type: New Feat

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Yuan Mei
+1 (binding) & thanks for the efforts! Best Yuan On Mon, Jul 11, 2022 at 2:08 PM Yun Gao wrote: > +1 (binding) > > Thanks Anton for driving this! > > > Best, > Yun Gao > > > -- > From:Anton Kalashnikov > Send Time:2022 Jul. 8 (F

[jira] [Created] (FLINK-28486) [Flink][doc] Flink FileSystem SQL Connector Doc is not right

2022-07-11 Thread DingGeGe (Jira)
DingGeGe created FLINK-28486: Summary: [Flink][doc] Flink FileSystem SQL Connector Doc is not right Key: FLINK-28486 URL: https://issues.apache.org/jira/browse/FLINK-28486 Project: Flink Issue T

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread godfrey he
+1, Thanks for driving this! Best, Godfrey Yuan Mei 于2022年7月11日周一 16:13写道: > > +1 (binding) & thanks for the efforts! > > Best > Yuan > > > > On Mon, Jul 11, 2022 at 2:08 PM Yun Gao > wrote: > > > +1 (binding) > > > > Thanks Anton for driving this! > > > > > > Best, > > Yun Gao > > > > > >

[jira] [Created] (FLINK-28487) Introduce configurable RateLimitingStrategy for Async Sink

2022-07-11 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-28487: --- Summary: Introduce configurable RateLimitingStrategy for Async Sink Key: FLINK-28487 URL: https://issues.apache.org/jira/browse/FLINK-28487 Project: Flink

[jira] [Created] (FLINK-28488) KafkaMetricWrapper does incorrect cast

2022-07-11 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-28488: Summary: KafkaMetricWrapper does incorrect cast Key: FLINK-28488 URL: https://issues.apache.org/jira/browse/FLINK-28488 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-28489) FLIP-240: Introduce "ANALYZE TABLE" Syntax

2022-07-11 Thread godfrey he (Jira)
godfrey he created FLINK-28489: -- Summary: FLIP-240: Introduce "ANALYZE TABLE" Syntax Key: FLINK-28489 URL: https://issues.apache.org/jira/browse/FLINK-28489 Project: Flink Issue Type: New Featur

[jira] [Created] (FLINK-28490) Introduce "ANALYZE TABLE" Syntax in sql parser

2022-07-11 Thread godfrey he (Jira)
godfrey he created FLINK-28490: -- Summary: Introduce "ANALYZE TABLE" Syntax in sql parser Key: FLINK-28490 URL: https://issues.apache.org/jira/browse/FLINK-28490 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-28491) Introduce APPROX_COUNT_DISTINCT aggregate function for batch sql

2022-07-11 Thread godfrey he (Jira)
godfrey he created FLINK-28491: -- Summary: Introduce APPROX_COUNT_DISTINCT aggregate function for batch sql Key: FLINK-28491 URL: https://issues.apache.org/jira/browse/FLINK-28491 Project: Flink

[jira] [Created] (FLINK-28492) Support "ANALYZE TABLE" execution

2022-07-11 Thread godfrey he (Jira)
godfrey he created FLINK-28492: -- Summary: Support "ANALYZE TABLE" execution Key: FLINK-28492 URL: https://issues.apache.org/jira/browse/FLINK-28492 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-28493) Add document to describe "ANALYZE TABLE" syntax

2022-07-11 Thread godfrey he (Jira)
godfrey he created FLINK-28493: -- Summary: Add document to describe "ANALYZE TABLE" syntax Key: FLINK-28493 URL: https://issues.apache.org/jira/browse/FLINK-28493 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-28494) Add new job status states to CRD

2022-07-11 Thread Daren Wong (Jira)
Daren Wong created FLINK-28494: -- Summary: Add new job status states to CRD Key: FLINK-28494 URL: https://issues.apache.org/jira/browse/FLINK-28494 Project: Flink Issue Type: Improvement

[DISCUSS] Add new JobStatus fields to Flink Kubernetes Operator CRD

2022-07-11 Thread WONG, DAREN
Hi everyone, I am Daren from AWS Kinesis Data Analytics (KDA) team. I had a quick chat with Gyula as I propose to include a few additional fields in the jobStatus CRD for Flink Kubernetes Operator such as: - endTime - duration - jobPlan Further details of each states can be found here

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Márton Balassi
+1 (binding). Thanks! I can help you with the Slack admin steps if needed. On Mon, Jul 11, 2022 at 10:55 AM godfrey he wrote: > +1, Thanks for driving this! > > Best, > Godfrey > > Yuan Mei 于2022年7月11日周一 16:13写道: > > > > +1 (binding) & thanks for the efforts! > > > > Best > > Yuan > > > > > >

Re: [DISCUSS] Add new JobStatus fields to Flink Kubernetes Operator CRD

2022-07-11 Thread Őrhidi Mátyás
Hi Daren, At the moment the Operator fetches the job state via https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_api/#jobs-overview which contains the 'end-time' and 'duration' fields already. I feel calling the https://nightlies.apache.org/flink/flink-docs-master/docs/ops/rest_ap

Re: [DISCUSS] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-11 Thread Gen Luo
Hi, everyone. Thanks for your feedback. If there are no more concerns or comments, I will start the vote tomorrow. Gen Luo 于 2022年7月11日周一 11:12写道: > Hi Lijie and Zhu, > > Thanks for the suggestion. I agree that the name "Blocked Free Slots" is > more clear to users. > I'll take the suggestion a

Re: [ACTION REQUESTED] Flink 1.16 Release Sync update

2022-07-11 Thread Martijn Visser
Hi Xingbo, I'm a bit torn between that: we can definitely extend the feature freeze by two weeks, but I'm worried that extending the deadline now means that everyone will just start pushing their PRs even later. From my perspective, we should only extend the feature freeze if we have CI problems o

[jira] [Created] (FLINK-28495) Fix typos or mistakes of Flink CEP Document in the official website

2022-07-11 Thread Biao Geng (Jira)
Biao Geng created FLINK-28495: - Summary: Fix typos or mistakes of Flink CEP Document in the official website Key: FLINK-28495 URL: https://issues.apache.org/jira/browse/FLINK-28495 Project: Flink

Re: [RESULT][VOTE] FLIP-242: Introduce configurable RateLimitingStrategy for Async Sink

2022-07-11 Thread Piotr Nowojski
Thanks for driving this effort! Best, Piotrek sob., 2 lip 2022 o 09:03 Teoh, Hong napisał(a): > Hi Flink community! > > FLIP-242 [1] has been accepted. > > There are 3 binding votes [2] > > * Piotrek Nowojski (binding) > * Martijn Visser (binding) > * Danny Cranmer (binding) > > Non

[jira] [Created] (FLINK-28496) Expose label selector support in k8s operator

2022-07-11 Thread Jira
Márton Balassi created FLINK-28496: -- Summary: Expose label selector support in k8s operator Key: FLINK-28496 URL: https://issues.apache.org/jira/browse/FLINK-28496 Project: Flink Issue Type:

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Alexander Fedulov
+1. Thanks, Anton. Best, Alexander Fedulov On Mon, Jul 11, 2022 at 3:17 PM Márton Balassi wrote: > +1 (binding). Thanks! > > I can help you with the Slack admin steps if needed. > > On Mon, Jul 11, 2022 at 10:55 AM godfrey he wrote: > > > +1, Thanks for driving this! > > > > Best, > > Godfre

Not able to run a simple table API file streaming sink

2022-07-11 Thread Jaya Ananthram
Hello There, I am trying to write a simple table API S3 streaming sink using flink 1.15.1 and I am facing the following exception, Caused by: org.apache.flink.util.SerializedThrowable: S3RecoverableFsDataOutputStream cannot sync state to S3. Use persist() to create a persistent recoverable interm

Re: [DISCUSS] FLIP-248: Introduce dynamic partition pruning

2022-07-11 Thread Jingsong Li
Thanks Godfrey for driving. I like this FLIP. We can restrict this capability to more than just partitions. Here are some inputs from Lake Storage. The format of the splits generated by Lake Storage is roughly as follows: Split { Path filePath; Statistics[] fieldStats; } Stats contain the

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Yun Tang
+ 1 (binding, I think this voting acts as voting a FLIP). Best, Yun Tang From: Alexander Fedulov Sent: Tuesday, July 12, 2022 5:27 To: dev Subject: Re: [VOTE] Creating benchmark channel in Apache Flink slack +1. Thanks, Anton. Best, Alexander Fedulov On Mo

[jira] [Created] (FLINK-28497) resource leak when job failed with unknown status In Application Mode

2022-07-11 Thread lihe ma (Jira)
lihe ma created FLINK-28497: --- Summary: resource leak when job failed with unknown status In Application Mode Key: FLINK-28497 URL: https://issues.apache.org/jira/browse/FLINK-28497 Project: Flink

[jira] [Created] (FLINK-28498) resource leak when job failed with unknown status In Application Mode

2022-07-11 Thread lihe ma (Jira)
lihe ma created FLINK-28498: --- Summary: resource leak when job failed with unknown status In Application Mode Key: FLINK-28498 URL: https://issues.apache.org/jira/browse/FLINK-28498 Project: Flink

[jira] [Created] (FLINK-28499) resource leak when job failed with unknown status In Application Mode

2022-07-11 Thread lihe ma (Jira)
lihe ma created FLINK-28499: --- Summary: resource leak when job failed with unknown status In Application Mode Key: FLINK-28499 URL: https://issues.apache.org/jira/browse/FLINK-28499 Project: Flink

[jira] [Created] (FLINK-28500) Add Transformer for Tokenizer

2022-07-11 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-28500: - Summary: Add Transformer for Tokenizer Key: FLINK-28500 URL: https://issues.apache.org/jira/browse/FLINK-28500 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-28501) Add Transformer and Estimator for VectorIndexer

2022-07-11 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-28501: - Summary: Add Transformer and Estimator for VectorIndexer Key: FLINK-28501 URL: https://issues.apache.org/jira/browse/FLINK-28501 Project: Flink Issue Type:

[jira] [Created] (FLINK-28502) Add Transformer for RegexTokenizer

2022-07-11 Thread Zhipeng Zhang (Jira)
Zhipeng Zhang created FLINK-28502: - Summary: Add Transformer for RegexTokenizer Key: FLINK-28502 URL: https://issues.apache.org/jira/browse/FLINK-28502 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Add new JobStatus fields to Flink Kubernetes Operator CRD

2022-07-11 Thread Yang Wang
I share mytyas's concern if we list the jobs first and then followed by some get-job-detail requests. It is a bit expensive and I do not see the benefit to store jobPlan in the CR status. Best, Yang Őrhidi Mátyás 于2022年7月11日周一 21:43写道: > Hi Daren, > > At the moment the Operator fetches the job

Re: [DISCUSS] FLIP-250: Support Customized Kubernetes Schedulers Proposal

2022-07-11 Thread Kelu Tao
+1 for this proposal. Volcano has show its strength in some specified cases, such as ML. And its schedule ability will be enhancement for kubernetes default scheduler. Look forward to see the integration between Volcano and Flink. Thanks. On 2022/07/08 00:25:45 bo zhaobo wrote: > Thanks Yang

Re: [VOTE] Creating benchmark channel in Apache Flink slack

2022-07-11 Thread Jing Zhang
+ 1 (binding), Thanks for driving this. Best, Jing Zhang Yun Tang 于2022年7月12日周二 11:19写道: > + 1 (binding, I think this voting acts as voting a FLIP). > > > > Best, > Yun Tang > > From: Alexander Fedulov > Sent: Tuesday, July 12, 2022 5:27 > To: dev > Subject: R

Re: [DISCUSS] FLIP-248: Introduce dynamic partition pruning

2022-07-11 Thread Jark Wu
I agree with Jingsong. DPP is a particular case of Dynamic Filter Pushdown that the join key contains partition fields. Extending this FLIP to general filter pushdown can benefit more optimizations, and they can share the same interface. For example, Trino Hive Connector leverages dynamic filteri

A common question on how to release resource in Flink job

2022-07-11 Thread Bruce Zu
Hi Fink team, Excuse me, I have a common question about how to release the resource held by some object in Flink Job. Thank you in advance!. I am a new user of Flink. I search a lot but did not find related documents. But I am sure there is a standard way to resolve it. In our case, we need acces

Re: [DISCUSS] FLIP-250: Support Customized Kubernetes Schedulers Proposal

2022-07-11 Thread Shqiprim Bunjaku
+1 (non binding) On Tue, Jul 12, 2022 at 6:50 AM Kelu Tao wrote: > +1 for this proposal. > > Volcano has show its strength in some specified cases, such as ML. And its > schedule ability will be enhancement for kubernetes default scheduler. > > Look forward to see the integration between Volcano

[VOTE] FLIP-249: Flink Web UI Enhancement for Speculative Execution

2022-07-11 Thread Gen Luo
Hi everyone, Thanks for all the feedback so far. Based on the discussion [1], we seem to have consensus. So, I would like to start a vote on FLIP-249 [2]. The vote will last for at least 72 hours unless there is an objection or insufficient votes. [1] https://lists.apache.org/thread/832tk3zvy

[jira] [Created] (FLINK-28503) Fix invalid link in Python FAQ Document

2022-07-11 Thread Biao Geng (Jira)
Biao Geng created FLINK-28503: - Summary: Fix invalid link in Python FAQ Document Key: FLINK-28503 URL: https://issues.apache.org/jira/browse/FLINK-28503 Project: Flink Issue Type: Improvement