[jira] [Created] (FLINK-31208) KafkaSourceReader overrides meaninglessly a method(pauseOrResumeSplits)

Hongshun Wang created FLINK-31208: - Summary: KafkaSourceReader overrides meaninglessly a method(pauseOrResumeSplits) Key: FLINK-31208 URL: https://issues.apache.org/jira/browse/FLINK-31208 Project: Fl

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

Thanks for the update. The change looks good to me. So +1 from my side. Dong Lin 于2023年2月24日周五 13:56写道： > > As we are working on FLIP-289 PR, we realized that we need to make > one minor change to the ModelServable#setModelData() API. > > More specifically, we would like to update the ModelServa

Re: [VOTE] FLIP-289: Support online inference (Flink ML)

As we are working on FLIP-289 PR, we realized that we need to make one minor change to the ModelServable#setModelData() API. More specifically, we would like to update the ModelServable#setModelData to use the following signature. It additionally throws IOException and allows users to provide mult

Re: [VOTE] Release 1.15.4, release candidate #1

Thanks Danny. +1(non-binding) Tested the following: - Download the artifacts and build image - Ran WordCount on Kubernetes(session mode and application mode) Best, Weihua On Fri, Feb 24, 2023 at 12:29 PM Yanfei Lei wrote: > Thanks Danny. > +1 (non-binding) > > - Downloaded artifacts & built

[jira] [Created] (FLINK-31207) supports high order function like other engine

jackylau created FLINK-31207: Summary: supports high order function like other engine Key: FLINK-31207 URL: https://issues.apache.org/jira/browse/FLINK-31207 Project: Flink Issue Type: Sub-task

Re: [VOTE] Release 1.15.4, release candidate #1

Thanks Danny. +1 (non-binding) - Downloaded artifacts & built Flink from sources - Verified GPG signatures of bin and source. - Verified version in poms - Ran WordCount example in streaming and batch mode(standalone cluster) - Went over flink-web PR, looks good except for Sergey's remark. Danny C

[jira] [Created] (FLINK-31206) Broken links on flink.apache.org

Zili Chen created FLINK-31206: - Summary: Broken links on flink.apache.org Key: FLINK-31206 URL: https://issues.apache.org/jira/browse/FLINK-31206 Project: Flink Issue Type: Bug Report

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

Hi all, I have updated the flip according to the discussion, and we will extend the watermark-related features with both table options and 'OPTIONS' hint, like this: ``` -- configure in table options CREATE TABLE user_actions ( ... user_action_time TIMESTAMP(3), WATERMARK FOR user_action_ti

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Congrats! Thanks for your effort Best, Weihua On Fri, Feb 24, 2023 at 10:47 AM Junrui Lee wrote: > Thanks Martijn for your great work. > > Best regards, > Junrui > > Jane Chan 于2023年2月24日周五 10:37写道： > > > Thanks Martijn for your great work. > > > > Best regards, > > Jane > > > > On Fri, Fe

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

Hi Jing, > we'd better reduce the dependency chain and follow the Law of Demeter(LoD, clean code). > Adding a new method in TableEnvironment is therefore better than calling an API chain I think I don't fully agree that LoD is a good practice. Actually, I would prefer to keep the API clean and co

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks Martijn for your great work. Best regards, Junrui Jane Chan 于2023年2月24日周五 10:37写道： > Thanks Martijn for your great work. > > Best regards, > Jane > > On Fri, Feb 24, 2023 at 10:24 AM weijie guo > wrote: > > > Thanks Martijn for your great work. > > > > Best regards, > > > > Weijie > > >

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

Hi, Thanks for the nice proposal, Ran. Regarding this api usage, I have some discussion with @twalthr before as here Personally, I think leaking the Catalog to the user side is not suitable, since there are some read/write

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks Martijn for your great work. Best regards, Jane On Fri, Feb 24, 2023 at 10:24 AM weijie guo wrote: > Thanks Martijn for your great work. > > Best regards, > > Weijie > > > Jingsong Li 于2023年2月24日周五 09:49写道： > > > Thanks Martijn! > > > > On Fri, Feb 24, 2023 at 9:46 AM yuxia > wrote: >

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks Martijn for your great work. Best regards, Weijie Jingsong Li 于2023年2月24日周五 09:49写道： > Thanks Martijn! > > On Fri, Feb 24, 2023 at 9:46 AM yuxia wrote: > > > > Thanks Martijn for your work. > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "Jing Ge" > > 收件人: "dev" >

[jira] [Created] (FLINK-31205) do optimize for multi sink in a single relNode tree

Aitozi created FLINK-31205: -- Summary: do optimize for multi sink in a single relNode tree Key: FLINK-31205 URL: https://issues.apache.org/jira/browse/FLINK-31205 Project: Flink Issue Type: Improvem

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks Martijn! On Fri, Feb 24, 2023 at 9:46 AM yuxia wrote: > > Thanks Martijn for your work. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Jing Ge" > 收件人: "dev" > 发送时间: 星期五, 2023年 2 月 24日 上午 5:20:30 > 主题: Re: [ANNOUNCE] Flink project website is now powered by Hugo > > Congrats Martij

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks Martijn for your work. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期五, 2023年 2 月 24日 上午 5:20:30 主题: Re: [ANNOUNCE] Flink project website is now powered by Hugo Congrats Martijn! You have made great progress. Thanks for your effort! Best regards, Jing On Thu,

[jira] [Created] (FLINK-31204) HiveCatalogITCase fails due to avro conflict in table store

Shammon created FLINK-31204: --- Summary: HiveCatalogITCase fails due to avro conflict in table store Key: FLINK-31204 URL: https://issues.apache.org/jira/browse/FLINK-31204 Project: Flink Issue Type

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Congrats Martijn! You have made great progress. Thanks for your effort! Best regards, Jing On Thu, Feb 23, 2023 at 8:47 PM Konstantin Knauf wrote: > Thanks, Martijn. That was a lot of work. > > Am Do., 23. Feb. 2023 um 16:33 Uhr schrieb Maximilian Michels < > m...@apache.org>: > > > Congrats! G

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Thanks, Martijn. That was a lot of work. Am Do., 23. Feb. 2023 um 16:33 Uhr schrieb Maximilian Michels < m...@apache.org>: > Congrats! Great work. This was a long time in the making! > > -Max > > On Thu, Feb 23, 2023 at 3:28 PM Martijn Visser > wrote: > > > > Hi everyone, > > > > The project web

Re: Proposal to improve the Apache Flink website

Maybe to expand on the comment from Max: From a technical perspective the website and documentation are 2 entirely different things, but from a users perspective could easily be perceived as being "the website". Again I feel like we lack a concrete list of issues; that would've likely answer

[VOTE] Release 1.15.4, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 1.15.4, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

[VOTE] Release 1.15.4, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 1.15.4, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

Re: [ANNOUNCE] New Apache Flink Committer - Anton Kalashnikov

Congratulations Anton, well deserved! Best, d. On Wed, Feb 22, 2023 at 5:01 AM Jane Chan wrote: > Congratulations, Anton! > > Best regards, > Jane > > On Wed, Feb 22, 2023 at 11:22 AM Yun Tang wrote: > > > Congratulations, Anton! > > > > Best > > Yun Tang > > >

Re: [DISCUSS] FLIP-291: Externalized Declarative Resource Management

Hi Everyone, @John This is a problem that we've spent some time trying to crack; in the end, we've decided to go against doing any upgrades to JobGraphStore from JobMaster to avoid having multiple writers that are guarded by different leader election lock (Dispatcher and JobMaster might live in a

[jira] [Created] (FLINK-31203) Application upgrade rollbacks failed in Flink Kubernetes Operator

hjw created FLINK-31203: --- Summary: Application upgrade rollbacks failed in Flink Kubernetes Operator Key: FLINK-31203 URL: https://issues.apache.org/jira/browse/FLINK-31203 Project: Flink Issue Type:

[ANNOUNCE] Apache Flink Kubernetes Operator 1.4.0 released

The Apache Flink community is very happy to announce the release of Apache Flink Kubernetes Operator 1.4.0. The Flink Kubernetes Operator allows users to manage their Apache Flink applications and their lifecycle through native k8s tooling like kubectl. Release highlights: - Flink Job Autosca

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

Hi, JingSong, Jing. thank for sharing your opinions. What you say makes sense, both approaches have pros and cons. If it is a modification of `TableEnvrionment`, such as listDatabases(catalog). It is actually consistent with the other overloaded methods before, and defining this method means tha

Re: Proposal to improve the Apache Flink website

Is this targeting the landing page, the main website, or the entire website including the documentation? Compare the main page of Spark with its documentation: https://spark.apache.org/ https://spark.apache.org/docs/latest/ I like the consistency of the current Flink page, but it is obviously eas

Re: [ANNOUNCE] Flink project website is now powered by Hugo

Congrats! Great work. This was a long time in the making! -Max On Thu, Feb 23, 2023 at 3:28 PM Martijn Visser wrote: > > Hi everyone, > > The project website at https://flink.apache.org is now powered by Hugo [1] > which is the same system as the documentation. > > The theme is the same as the d

[ANNOUNCE] Flink project website is now powered by Hugo

Hi everyone, The project website at https://flink.apache.org is now powered by Hugo [1] which is the same system as the documentation. The theme is the same as the documentation website, so there's no redesign involved. If you encounter any issues, please create a Jira ticket and feel free to pi

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

Hi all, Thanks for all suggestions. We will extend the watermark-related features in SQL layer with dynamic table options and 'OPTIONS' hint, just as everyone expects. I will modify Flip-296 as discussed. @Martijn As far as I know, there is no hint interface in the table API, so we can't use hin

[jira] [Created] (FLINK-31202) Add support for reading Parquet files containing Arrays with complex types.

Krzysztof Chmielewski created FLINK-31202: - Summary: Add support for reading Parquet files containing Arrays with complex types. Key: FLINK-31202 URL: https://issues.apache.org/jira/browse/FLINK-31202

[jira] [Created] (FLINK-31201) Provides option to sort partition for full stage in streaming read

Jingsong Lee created FLINK-31201: Summary: Provides option to sort partition for full stage in streaming read Key: FLINK-31201 URL: https://issues.apache.org/jira/browse/FLINK-31201 Project: Flink

[jira] [Created] (FLINK-31200) Add MAP_VALUES supported in SQL & Table API

jackylau created FLINK-31200: Summary: Add MAP_VALUES supported in SQL & Table API Key: FLINK-31200 URL: https://issues.apache.org/jira/browse/FLINK-31200 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-31199) Add MAP_KEYS supported in SQL & Table API

jackylau created FLINK-31199: Summary: Add MAP_KEYS supported in SQL & Table API Key: FLINK-31199 URL: https://issues.apache.org/jira/browse/FLINK-31199 Project: Flink Issue Type: Bug C

Re: Re: Re: [discussion] To introduce a formatter for Markdown files

Hi Zhongpu, Thanks for sharing. That sounds good to me. Once we get consensus in the community, please don't forget to update the content at [1] wrt mk guide and format guide. Best regards, Jing On Thu, Feb 23, 2023 at 4:54 AM Zhongpu Chen wrote: > Hi Jing, > > Prettier is a versatile formatt

[jira] [Created] (FLINK-31198) Class loader problem by incorrect classloader in flink sql 1.16

Rascal Wu created FLINK-31198: - Summary: Class loader problem by incorrect classloader in flink sql 1.16 Key: FLINK-31198 URL: https://issues.apache.org/jira/browse/FLINK-31198 Project: Flink Is

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

Hi Jingson, Thanks for sharing your thoughts. Please see my reply below. On Thu, Feb 23, 2023 at 10:16 AM Jingsong Li wrote: > Hi Jing Ge, > > First, flink-table-common contains all common classes of Flink Table, > I think it is hard to bypass its dependence. > If any time when we use flink-ta

[jira] [Created] (FLINK-31197) Exception while writing Parqeut files containing Arrays with complex types.

Krzysztof Chmielewski created FLINK-31197: - Summary: Exception while writing Parqeut files containing Arrays with complex types. Key: FLINK-31197 URL: https://issues.apache.org/jira/browse/FLINK-31197

[jira] [Created] (FLINK-31196) Flink on YARN honors env.java.home

Prabhu Joseph created FLINK-31196: - Summary: Flink on YARN honors env.java.home Key: FLINK-31196 URL: https://issues.apache.org/jira/browse/FLINK-31196 Project: Flink Issue Type: Improvement

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

Thanks for the warm discussions! I had an offline discussion with Kui about the replies. I think I could give some explanations on the original intention to introduce another WATERMARK_PARAMS. If we take a look at the current datastream API, the watermark strategy does not belong to any specifi

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

Hi Jing Ge, First, flink-table-common contains all common classes of Flink Table, I think it is hard to bypass its dependence. Secondly, almost all methods in Catalog looks useful to me, so if we are following LoD, we should add all methods again to TableEnvironment. I think it is redundant. And

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

Hi, While I can understand that there's a desire to first focus on solving this problem for SQL, I do wonder if we should ignore the Table API at this point. If we could include the syntax for the Table API, it potentially could also be implemented by another contributor without needing to create

Re: [DISCUSS] FLIP-297: Improve Auxiliary Sql Statements

Hi Jingson, Thanks for the knowledge sharing. IMHO, it looks more like a design guideline question than just avoiding public API change. Please correct me if I'm wrong. Catalog is in flink-table-common module and TableEnvironment is in flink-table-api-java. Depending on how and where those featur

[jira] [Created] (FLINK-31195) FullChangelogStoreSinkWrite bucket writer conflicts with rescale

Jingsong Lee created FLINK-31195: Summary: FullChangelogStoreSinkWrite bucket writer conflicts with rescale Key: FLINK-31195 URL: https://issues.apache.org/jira/browse/FLINK-31195 Project: Flink