Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Samrat Deb
Thanks for the proposal , +1 for adding deprecated identifier [Thought] Can we have seperate section / page for deprecated configs ? Wdut ? Bests, Samrat On Tue, 31 Oct 2023 at 3:44 PM, Alexander Fedulov < alexander.fedu...@gmail.com> wrote: > Hi Zhanghao, > > Thanks for the proposition. > In

[jira] [Created] (FLINK-33425) Flink SQL doesn't support a inline field in struct type as primary key

2023-11-01 Thread Elakiya (Jira)
Elakiya created FLINK-33425: --- Summary: Flink SQL doesn't support a inline field in struct type as primary key Key: FLINK-33425 URL: https://issues.apache.org/jira/browse/FLINK-33425 Project: Flink

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Hang Ruan
Thanks for the proposal. +1 from my side and +1 for putting them to a separate section. Best, Hang Samrat Deb 于2023年11月1日周三 15:32写道: > Thanks for the proposal , > +1 for adding deprecated identifier > > [Thought] Can we have seperate section / page for deprecated configs ? Wdut > ? > > > Bests

[jira] [Created] (FLINK-33426) If the directory does not have the read permission, an exception cannot be thrown, when read this path.

2023-11-01 Thread wenhao.yu (Jira)
wenhao.yu created FLINK-33426: - Summary: If the directory does not have the read permission, an exception cannot be thrown, when read this path. Key: FLINK-33426 URL: https://issues.apache.org/jira/browse/FLINK-33426

Re: [DISCUSS] FLIP-379: Dynamic source parallelism inference for batch jobs

2023-11-01 Thread Xia Sun
Thanks Lijie for the comments! 1. For Hive source, dynamic parallelism inference in batch scenarios is a superset of static parallelism inference. As a follow-up task, we can consider changing the default value of 'table.exec.hive.infer-source-parallelism' to false. 2. I think that both dynamic pa

[jira] [Created] (FLINK-33427) Mark new relocated autoscaler configs IGNORE in the operator

2023-11-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-33427: -- Summary: Mark new relocated autoscaler configs IGNORE in the operator Key: FLINK-33427 URL: https://issues.apache.org/jira/browse/FLINK-33427 Project: Flink Iss

Re: [DISCUSS] FLIP-376: Add DISTRIBUTED BY clause

2023-11-01 Thread Jing Ge
Hi Timo, Gotcha, let's use passive verbs. I am actually thinking about "BUCKETED BY 6" or "BUCKETED INTO 6". Not really used in SQL, but afaiu Spark uses the concept[1]. [1] https://spark.apache.org/docs/3.1.1/api/python/reference/api/pyspark.sql.DataFrameWriter.bucketBy.html Best regards, Jin

[jira] [Created] (FLINK-33428) Flink sql cep support 'followed','notNext' and 'notFollowedBy' semantics

2023-11-01 Thread xiaoran (Jira)
xiaoran created FLINK-33428: --- Summary: Flink sql cep support 'followed','notNext' and 'notFollowedBy' semantics Key: FLINK-33428 URL: https://issues.apache.org/jira/browse/FLINK-33428 Project: Flink

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Zhanghao Chen
Hi Alexander, I haven't done a complete analysis yet. But through simple code search, roughly 35 options would be added with this change. Also note that some old options defined in a ConfigConstant class won's be added here as flink-doc won't discover these constant-based options. Best, Zhangh

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Zhanghao Chen
Hi Samrat and Ruan, Thanks for the suggestion. I'm actually in favor of adding the deprecated options in the same section as the non-deprecated ones. This would make user search for descriptions of the replacement options more easily. It would be a different story for options deprecated because

[jira] [Created] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-01 Thread Maximilian Michels (Jira)
Maximilian Michels created FLINK-33429: -- Summary: Metric collection during stabilization phase may error due to missing metrics Key: FLINK-33429 URL: https://issues.apache.org/jira/browse/FLINK-33429

Re: [DISCUSS] Kubernetes Operator 1.7.0 release planning

2023-11-01 Thread Maximilian Michels
+1 for targeting the release as soon as possible. Given the effort that Rui has undergone to decouple the autoscaling implementation, it makes sense to also include an alternative implementation with the release. In the long run, I wonder whether the standalone implementation should even be part of

Re: [DISCUSS][FLINK-33240] Document deprecated options as well

2023-11-01 Thread Junrui Lee
Hi Zhanghao, Thank you for the proposal. +1 from my side. It would be more user-friendly to have the deprecated options in the same section as the non-deprecated ones. Therefore, adding them in the same section sounds good to me. Best regards, Junrui Zhanghao Chen 于2023年11月1日周三 21:10写道: > Hi

Re: [DISCUSS] FLIP-378: Support Avro timestamp with local timezone

2023-11-01 Thread Peter Huang
Thanks @Leonard Xu . Two minor versions are definitely needed for flip the configs. On Mon, Oct 30, 2023 at 8:55 PM Leonard Xu wrote: > Thanks @Peter for driving this FLIP > > +1 from my side, the timestamp semantics mapping looks good to me. > > > In the end, the legacy behavior will be droppe

RE: [DISCUSS] Confluent Avro support without Schema Registry access

2023-11-01 Thread Dale Lane
Thanks for the pointer to FLINK-33045 - I hadn’t spotted that. That sounds like it’d address one possible issue (where someone using Flink shouldn’t be, or perhaps doesn’t have access/permission to, register new schemas). I should be clear that I absolutely agree that using a schema registry is

[DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-01 Thread Junrui Lee
Hi devs, I would like to start a discussion on FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects[1]. Currently, the job configuration in FLINK is spread out across different components, which leads to inconsistencies and confusion. To address this issue, it is

Re: [DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-01 Thread Rui Fan
Thanks Junrui for driving this proposal! ConfigOption is easy to use for flink users, easy to manage options for flink platform maintainers, and easy to maintain for flink developers and flink community. So big +1 for this proposal! Best, Rui On Thu, Nov 2, 2023 at 10:10 AM Junrui Lee wrote:

[jira] [Created] (FLINK-33430) Fix Test Failures

2023-11-01 Thread Yang Chen (Jira)
Yang Chen created FLINK-33430: - Summary: Fix Test Failures Key: FLINK-33430 URL: https://issues.apache.org/jira/browse/FLINK-33430 Project: Flink Issue Type: Bug Reporter: Yang Chen