[jira] [Created] (FLINK-31965) Fix ClassNotFoundException in benchmarks

2023-04-27 Thread Paul Lin (Jira)
Paul Lin created FLINK-31965: Summary: Fix ClassNotFoundException in benchmarks Key: FLINK-31965 URL: https://issues.apache.org/jira/browse/FLINK-31965 Project: Flink Issue Type: Bug Co

Re: [DISCUSS] Planning Flink 2.0

2023-04-27 Thread Saichandrasekar TM
Hi All, Awesome...I see this as a great opportunity for newcomers like me to contribute. Is this discussion happening in a slack or discord forum too? If so, pls include me. Thanks, Sai On Fri, Apr 28, 2023 at 2:55 AM Martijn Visser wrote: > Hi all, > > I think the proposal is a good starting

Re: [DISCUSS] FLIP-288:Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-27 Thread Hongshun Wang
Hi,Raman Verma*:* Generally, Kafka responds quickly. However, as an asynchronous operation, we cannot guarantee that there will be no abnormal operations, such as temporary network issues. The two cases I mentioned are special situations to better understand the concept. Best Hongshun On Fri,

[jira] [Created] (FLINK-31964) Improve the document of Autoscaler as 1.17.0 is released

2023-04-27 Thread Biao Geng (Jira)
Biao Geng created FLINK-31964: - Summary: Improve the document of Autoscaler as 1.17.0 is released Key: FLINK-31964 URL: https://issues.apache.org/jira/browse/FLINK-31964 Project: Flink Issue Type

[jira] [Created] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scale down via autoscaler

2023-04-27 Thread Tan Kim (Jira)
Tan Kim created FLINK-31963: --- Summary: java.lang.ArrayIndexOutOfBoundsException when scale down via autoscaler Key: FLINK-31963 URL: https://issues.apache.org/jira/browse/FLINK-31963 Project: Flink

RE: [DISCUSS] FLIP-288:Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-27 Thread Raman Verma
Hello Hongshun Wang, You have mentioned that the first partition discovery can be very slow (section: Why do we need initialDiscoveryFinished?) Do you mean that Kafka can be slow to respond. If so, any idea under what conditions Kafka would be slow. Or, is it just a matter of bad timing, where

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-27 Thread Thomas Weise
Is the intention to bump the Flink major version and only support Java 17+? If so, can Scala not be upgraded at the same time? Thanks, Thomas On Thu, Apr 27, 2023 at 4:53 PM Martijn Visser wrote: > Scala 2.12.7 doesn't compile on Java 17, see > https://issues.apache.org/jira/browse/FLINK-25000

Re: [DISCUSS] Planning Flink 2.0

2023-04-27 Thread Martijn Visser
Hi all, I think the proposal is a good starting point. We should aim to make Flink a unified data processing, cloud friendly / cloud native technology, with proper low-level and high-level interfaces (DataStream API, Table API, SQL). I think it would make a lot of sense that we write down a vision

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-27 Thread Martijn Visser
Scala 2.12.7 doesn't compile on Java 17, see https://issues.apache.org/jira/browse/FLINK-25000. On Thu, Apr 27, 2023 at 3:11 PM Jing Ge wrote: > Thanks Tamir for the information. According to the latest comment of the > task FLINK-24998, this bug should be gone while using the latest JDK 17. I >

[jira] [Created] (FLINK-31962) libssl not found when running CI

2023-04-27 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-31962: -- Summary: libssl not found when running CI Key: FLINK-31962 URL: https://issues.apache.org/jira/browse/FLINK-31962 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31961) Implement ExpandedQuery and OriginalQuery methods for glue in catalog

2023-04-27 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-31961: -- Summary: Implement ExpandedQuery and OriginalQuery methods for glue in catalog Key: FLINK-31961 URL: https://issues.apache.org/jira/browse/FLINK-31961 Project: Flink

[jira] [Created] (FLINK-31960) SQL OverBy. Error on a code that does not exist

2023-04-27 Thread padavan (Jira)
padavan created FLINK-31960: --- Summary: SQL OverBy. Error on a code that does not exist Key: FLINK-31960 URL: https://issues.apache.org/jira/browse/FLINK-31960 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Zakelly Lan
Hi all, Thanks for all the feedback so far. The discussion has been going on for some time, and all the comments and suggestions are addressed. So I would like to start a vote on this FLIP, which begins a week later (May. 5th at 10:00 AM GMT). If you have any concerns, please don't hesitate to f

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Zakelly Lan
Hi Yuan, Thanks for sharing your thoughts. Like you said, the code changes and complexities are shaded in the newly introduced file management in TM, while the old file management remains the same. It is safe for us to take a small step towards decentralized file management in this way. I put the

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-27 Thread Feng Jin
Hi Jing > There are still some NIT issues in the FLIP Thank you very much for the careful review. I have already made the relevant changes. > Speaking of the conflict issues in the multi-instance scenarios, I am not sure if this is the intended behaviour Currently, there are conflicts in mul

Re: [Discussion] - Release major Flink version to support JDK 17 (LTS)

2023-04-27 Thread Jing Ge
Thanks Tamir for the information. According to the latest comment of the task FLINK-24998, this bug should be gone while using the latest JDK 17. I was wondering whether it means that there are no more issues to stop us releasing a major Flink version to support Java 17? Did I miss something? Best

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-27 Thread Jing Ge
Hi Feng, Thanks for working on the FLIP. There are still some NIT issues in the FLIP like: 1. Optional catalogStore has been used as CatalogStore instead of Optional in the code example. It should be fine to use it as pseudo code for now and update it after you submit the PR. 2. addCatalog(...) i

Re: [DISCUSS] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-04-27 Thread Yuan Mei
Hey all, Thanks @Zakelly for driving this effort and thanks everyone for the warm discussion. Sorry for the late response. As I and Zakelly have already discussed and reviewed the design carefully when drafting this FLIP, I do not have additional inputs here. But I want to highlight several point

[jira] [Created] (FLINK-31959) Correct the unaligned checkpoint type at checkpoint level

2023-04-27 Thread Rui Fan (Jira)
Rui Fan created FLINK-31959: --- Summary: Correct the unaligned checkpoint type at checkpoint level Key: FLINK-31959 URL: https://issues.apache.org/jira/browse/FLINK-31959 Project: Flink Issue Type: B

[jira] [Created] (FLINK-31958) Table to DataStream allow partial fields

2023-04-27 Thread padavan (Jira)
padavan created FLINK-31958: --- Summary: Table to DataStream allow partial fields Key: FLINK-31958 URL: https://issues.apache.org/jira/browse/FLINK-31958 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31957) Add documentation for the user story

2023-04-27 Thread Jane Chan (Jira)
Jane Chan created FLINK-31957: - Summary: Add documentation for the user story Key: FLINK-31957 URL: https://issues.apache.org/jira/browse/FLINK-31957 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31956) Extend the CompiledPlan to read from/write to Flink's FileSystem

2023-04-27 Thread Jane Chan (Jira)
Jane Chan created FLINK-31956: - Summary: Extend the CompiledPlan to read from/write to Flink's FileSystem Key: FLINK-31956 URL: https://issues.apache.org/jira/browse/FLINK-31956 Project: Flink I

Re: [DISCUSS] Preventing Mockito usage for the new code with Checkstyle

2023-04-27 Thread David Morávek
Thanks, everyone, for participating. There seems to be a broad consensus, so I'll move forward. I've created [1] and [2] to track this. [1] https://issues.apache.org/jira/browse/FLINK-31954 [2] https://issues.apache.org/jira/browse/FLINK-31955 Best, D. On Thu, Apr 27, 2023 at 9:25 AM weijie guo

[jira] [Created] (FLINK-31955) Prevent JUnit 4 usage for the new code with Checkstyle

2023-04-27 Thread Jira
David Morávek created FLINK-31955: - Summary: Prevent JUnit 4 usage for the new code with Checkstyle Key: FLINK-31955 URL: https://issues.apache.org/jira/browse/FLINK-31955 Project: Flink Issu

[jira] [Created] (FLINK-31954) Prevent Mockito for the new code with Checkstyle

2023-04-27 Thread Jira
David Morávek created FLINK-31954: - Summary: Prevent Mockito for the new code with Checkstyle Key: FLINK-31954 URL: https://issues.apache.org/jira/browse/FLINK-31954 Project: Flink Issue Type

[jira] [Created] (FLINK-31953) FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source

2023-04-27 Thread Hongshun Wang (Jira)
Hongshun Wang created FLINK-31953: - Summary: FLIP-288: Enable Dynamic Partition Discovery by Default in Kafka Source Key: FLINK-31953 URL: https://issues.apache.org/jira/browse/FLINK-31953 Project: Fl

Re: [DISCUSS] Planning Flink 2.0

2023-04-27 Thread David Morávek
Hi, Great to see this topic moving forward; I agree it's long overdue. I keep thinking about 2.0 as a chance to eliminate things that didn't work, make the feature set denser, and fix rough edges and APIs that hold us back. Some items in the doc (Key Features section) don't tick these boxes for

[jira] [Created] (FLINK-31952) Support 'EXPLAIN' statement for CompiledPlan

2023-04-27 Thread Jane Chan (Jira)
Jane Chan created FLINK-31952: - Summary: Support 'EXPLAIN' statement for CompiledPlan Key: FLINK-31952 URL: https://issues.apache.org/jira/browse/FLINK-31952 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Preventing Mockito usage for the new code with Checkstyle

2023-04-27 Thread weijie guo
+1 for introducing this rule for junit4 and mockito. Best regards, Weijie Alexander Fedulov 于2023年4月26日周三 23:50写道: > +1 for the proposal, > > Best, > Alex > > On Wed, 26 Apr 2023 at 15:50, Chesnay Schepler wrote: > > > * adds a note to not include "import " in the regex" * > > > > On 26/04/2