Re: [Vote] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-20 Thread Matthias Pohl
+1 On Tue, Jan 19, 2021 at 10:44 AM Leonard Xu wrote: > +1 > > Best, > Leonard > > > 在 2021年1月19日,17:32,David Anderson 写道: > > > > +1 > > > > David > > > > On Tue, Jan 19, 2021 at 5:28 AM Forward Xu > wrote: > > > >> +1 > >> > >> Dian Fu 于2021年1月19日周二 上午11:40写道: > >> > >>> +1 > >>> > 在 2

[jira] [Created] (FLINK-21049) query_configuration.html content out date

2021-01-20 Thread Jira
谢波 created FLINK-21049: -- Summary: query_configuration.html content out date Key: FLINK-21049 URL: https://issues.apache.org/jira/browse/FLINK-21049 Project: Flink Issue Type: Bug Components: D

[jira] [Created] (FLINK-21050) Add an example for complex UDFs

2021-01-20 Thread Timo Walther (Jira)
Timo Walther created FLINK-21050: Summary: Add an example for complex UDFs Key: FLINK-21050 URL: https://issues.apache.org/jira/browse/FLINK-21050 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21051) SQLClientSchemaRegistryITCase unstable with InternalServerErrorException: Status 500

2021-01-20 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-21051: -- Summary: SQLClientSchemaRegistryITCase unstable with InternalServerErrorException: Status 500 Key: FLINK-21051 URL: https://issues.apache.org/jira/browse/FLINK-21051

Re: Re: [DISCUSS] Dealing with deprecated and legacy code in Flink

2021-01-20 Thread Matthias Pohl
Thanks Timo for opening this discussion. +1 I like the idea of adding a deprecation deadline and/or information when the functionality was deprecated. It looks like this is already done in the PyFlink code. Creating a JIRA issue for removing the functionality, as Till suggested, might help to mai

Re: Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Till Rohrmann
Congrats, Guowei! Cheers, Till On Wed, Jan 20, 2021 at 8:32 AM Matthias Pohl wrote: > Congrats, Guowei! > > On Wed, Jan 20, 2021 at 8:22 AM Congxian Qiu > wrote: > > > Congrats Guowei! > > > > Best, > > Congxian > > > > > > Danny Chan 于2021年1月20日周三 下午2:59写道: > > > > > Congratulations Guowei!

Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Cranmer, Danny
Congratulations Guowei!! On 20/01/2021, 05:35, "Kurt Young" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi everyone, I'm very happy to announce th

Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Ufuk Celebi
Congrats and welcome! :-) On Wed, Jan 20, 2021, at 9:57 AM, Cranmer, Danny wrote: > Congratulations Guowei!! > > On 20/01/2021, 05:35, "Kurt Young" wrote: > > CAUTION: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm t

[jira] [Created] (FLINK-21052) Wrong FlinkKafkaProducer Constructor described in docs

2021-01-20 Thread akisaya (Jira)
akisaya created FLINK-21052: --- Summary: Wrong FlinkKafkaProducer Constructor described in docs Key: FLINK-21052 URL: https://issues.apache.org/jira/browse/FLINK-21052 Project: Flink Issue Type: Bug

Re:Re: Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread hailongwang
Congratulations, Guowei! Best, Hailong 在 2021-01-20 15:55:24,"Till Rohrmann" 写道: >Congrats, Guowei! > >Cheers, >Till > >On Wed, Jan 20, 2021 at 8:32 AM Matthias Pohl >wrote: > >> Congrats, Guowei! >> >> On Wed, Jan 20, 2021 at 8:22 AM Congxian Qiu >> wrote: >> >> > Congrats Guowei! >> > >> > B

[jira] [Created] (FLINK-21053) Prevent further RejectedExecutionExceptions in CheckpointCoordinator failing JM

2021-01-20 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21053: - Summary: Prevent further RejectedExecutionExceptions in CheckpointCoordinator failing JM Key: FLINK-21053 URL: https://issues.apache.org/jira/browse/FLINK-21053

Re: [DISCUSS] Flink configuration from environment variables

2021-01-20 Thread Ingo Bürk
Hi Steven, understood, thanks for expanding on your point. I will prepare a FLIP now going for the solution of S3_ACCESS_KEY style environment variables since overall this fits Flink use-cases better. I think your point that users have to know how to convert s3.access-key to S3_ACCESS_KEY is valid

[jira] [Created] (FLINK-21054) Implement mini-batch optimized slicing window aggregate operator

2021-01-20 Thread Jark Wu (Jira)
Jark Wu created FLINK-21054: --- Summary: Implement mini-batch optimized slicing window aggregate operator Key: FLINK-21054 URL: https://issues.apache.org/jira/browse/FLINK-21054 Project: Flink Issue

Re: [Vote] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-20 Thread Aljoscha Krettek
+1 Aljoscha On 2021/01/18 08:29, Seth Wiesman wrote: Hi devs, The discussion of the FLIP-157 [1] seems has reached a consensus through the mailing thread [2]. I would like to start a vote for it. The vote will be opened until 20th January (72h), unless there is an objection or no enough votes

Re: [VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-01-20 Thread Aljoscha Krettek
+1 (binding) Best, Aljoscha On 2021/01/15 22:55, Yun Gao wrote: Hi all, I would like to start the vote for FLIP-147[1], which propose to support checkpoints after tasks finished and is discussed in [2]. The vote will last at least 72 hours (Jan 20th due to weekend), following the consensus

Re: [VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-01-20 Thread Arvid Heise
+1 (binding) Best, Arvid On Wed, Jan 20, 2021 at 12:13 PM Aljoscha Krettek wrote: > +1 (binding) > > Best, > Aljoscha > > On 2021/01/15 22:55, Yun Gao wrote: > > > >Hi all, > > > >I would like to start the vote for FLIP-147[1], which propose to support > checkpoints after > >tasks finished and

Re: [Vote] FLIP-157 Migrate Flink Documentation from Jekyll to Hugo

2021-01-20 Thread Arvid Heise
+1 On Wed, Jan 20, 2021 at 12:07 PM Aljoscha Krettek wrote: > +1 > > Aljoscha > > On 2021/01/18 08:29, Seth Wiesman wrote: > >Hi devs, > > > >The discussion of the FLIP-157 [1] seems has reached a consensus through > >the mailing thread [2]. I would like to start a vote for it. > > > >The vote w

Re: Re: [DISCUSS] Dealing with deprecated and legacy code in Flink

2021-01-20 Thread Piotr Nowojski
Hi, I would prefer not to rely on the Jira for marking when something is supposed to be deleted. If `@Deprecated(since, planned_to_remove_on)` would have two obligatory parameters, there would be no way to "forget" about marking it and it would be also self documenting (I don't imagine users using

Re: Re: [DISCUSS] Dealing with deprecated and legacy code in Flink

2021-01-20 Thread Khachatryan Roman
Hi, I think having two Deprecated annotations (Flink and Java) may be confusing. One alternative is to combine standard annotation with mandatory Javadocs tags (checked with checkstyle). And starting from Java 9 it has "since" and "forRemoval" arguments. Regards, Roman On Wed, Jan 20, 2021 at

[jira] [Created] (FLINK-21055) Allow TIMESTAMP WITH LOCAL TIME ZONE (Instant) to be rowtime

2021-01-20 Thread Vladislav Protsenko (Jira)
Vladislav Protsenko created FLINK-21055: --- Summary: Allow TIMESTAMP WITH LOCAL TIME ZONE (Instant) to be rowtime Key: FLINK-21055 URL: https://issues.apache.org/jira/browse/FLINK-21055 Project: F

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-20 Thread Till Rohrmann
Maybe a different minor idea: Would it be possible to treat the SSG resource requirements as a hint for the runtime similar to how slot sharing groups are designed at the moment? Meaning that we don't give the guarantee that Flink will always deploy this set of tasks together no matter what comes.

Re: Re: Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Seth Wiesman
Congratulations! On Wed, Jan 20, 2021 at 3:41 AM hailongwang <18868816...@163.com> wrote: > Congratulations, Guowei! > > Best, > Hailong > > 在 2021-01-20 15:55:24,"Till Rohrmann" 写道: > >Congrats, Guowei! > > > >Cheers, > >Till > > > >On Wed, Jan 20, 2021 at 8:32 AM Matthias Pohl > >wrote: > > >

Re: Re: Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Steven Wu
Congrats, Guowei! On Wed, Jan 20, 2021 at 10:32 AM Seth Wiesman wrote: > Congratulations! > > On Wed, Jan 20, 2021 at 3:41 AM hailongwang <18868816...@163.com> wrote: > > > Congratulations, Guowei! > > > > Best, > > Hailong > > > > 在 2021-01-20 15:55:24,"Till Rohrmann" 写道: > > >Congrats, Guowei

[jira] [Created] (FLINK-21057) Streaming checkpointing with small interval leads app to hang

2021-01-20 Thread Nazar Volynets (Jira)
Nazar Volynets created FLINK-21057: -- Summary: Streaming checkpointing with small interval leads app to hang Key: FLINK-21057 URL: https://issues.apache.org/jira/browse/FLINK-21057 Project: Flink

[jira] [Created] (FLINK-21056) Streaming checkpointing is failing occasionally

2021-01-20 Thread Nazar Volynets (Jira)
Nazar Volynets created FLINK-21056: -- Summary: Streaming checkpointing is failing occasionally Key: FLINK-21056 URL: https://issues.apache.org/jira/browse/FLINK-21056 Project: Flink Issue Typ

Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Paul Lam
Congrats, Guowei! Best, Paul Lam > 2021年1月21日 07:21,Steven Wu 写道: > > Congrats, Guowei! > > On Wed, Jan 20, 2021 at 10:32 AM Seth Wiesman wrote: > >> Congratulations! >> >> On Wed, Jan 20, 2021 at 3:41 AM hailongwang <18868816...@163.com> wrote: >> >>> Congratulations, Guowei! >>> >>> Bes

Re: Re: [VOTE] FLIP-147: Support Checkpoint After Tasks Finished

2021-01-20 Thread Yun Gao
Hi all, The vote has been opened for more than 72 hours, and currently we have alreadly received 4 votes (3 bindings) and no -1 votes. Thus I'm happy to announce that FLIP-147 is approved. * Guowei (changed to binding for being Committer already, Congrats Guowei!) * Roman (non-binding) * Alj

[VOTE] Release 1.10.3, release candidate #1

2021-01-20 Thread Xintong Song
Hi everyone, Please review and vote on the release candidate #1 for the version 1.10.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-20 Thread Xintong Song
I think this makes sense. The semantic of a SSG is that operators in the group *can* be scheduled together in a slot, which is not a *must*. Specifying resources for SSGs should not change that semantic. In cases that needs for scheduling the operators into different slots arise, it makes sense fo

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-20 Thread Yangze Guo
@Till Also +1 to treat the SSG resource requirements as a hint instead of a restrict. We can treat it as a follow-up effort and make it clear in JavaDocs at the first step. Best, Yangze Guo On Thu, Jan 21, 2021 at 10:00 AM Xintong Song wrote: > > I think this makes sense. > > The semantic of a

Re: [DISCUSS] FLIP-156: Runtime Interfaces for Fine-Grained Resource Requirements

2021-01-20 Thread Chesnay Schepler
Is there even a functional difference between specifying the requirements for an SSG vs specifying the same requirements on a single operator within that group (ideally a colocation group to avoid this whole hint business)? Wouldn't we get the best of both worlds in the latter case? Users can

[jira] [Created] (FLINK-21058) The Show Partitinos command is supported under the Flink dialect to show all partitions

2021-01-20 Thread Jira
孙铮 created FLINK-21058: -- Summary: The Show Partitinos command is supported under the Flink dialect to show all partitions Key: FLINK-21058 URL: https://issues.apache.org/jira/browse/FLINK-21058 Project: Flink

Re: [DISCUSS] Correct time-related function behavior in Flink SQL

2021-01-20 Thread Kurt Young
cc this to user & user-zh mailing list because this will affect lots of users, and also quite a lot of users were asking questions around this topic. Let me try to understand this from user's perspective. Your proposal will affect five functions, which are: - PROCTIME() - NOW() - CURREN

?????? [DISCUSS] Correct time-related function behavior in Flink SQL

2021-01-20 Thread zhisheng
Thanks to Leonard Xu for discussing this tricky topic. At present, there are many Flink jobs in our production environment that are used to count day-level reports (eg: count PV/UV ).  If use the default Flink SQL,  the window time range of the statistics is incorrect, then the statistical res

Re: [DISCUSS] Correct time-related function behavior in Flink SQL

2021-01-20 Thread Jark Wu
Great examples to understand the problem and the proposed changes, @Kurt! Thanks Leonard for investigating this problem. The time-zone problems around time functions and windows have bothered a lot of users. It's time to fix them! The return value changes sound reasonable to me, and keeping the r

[jira] [Created] (FLINK-21059) KafkaSourceEnumerator does not honor consumer properties

2021-01-20 Thread Thomas Weise (Jira)
Thomas Weise created FLINK-21059: Summary: KafkaSourceEnumerator does not honor consumer properties Key: FLINK-21059 URL: https://issues.apache.org/jira/browse/FLINK-21059 Project: Flink Issu

Re: [ANNOUNCE] Welcome Guowei Ma as a new Apache Flink Committer

2021-01-20 Thread Biao Liu
Congrats, Guowei! Thanks, Biao /'bɪ.aʊ/ On Thu, 21 Jan 2021 at 09:30, Paul Lam wrote: > Congrats, Guowei! > > Best, > Paul Lam > > > 2021年1月21日 07:21,Steven Wu 写道: > > > > Congrats, Guowei! > > > > On Wed, Jan 20, 2021 at 10:32 AM Seth Wiesman > wrote: > > > >> Congratulations! > >> > >> On

[jira] [Created] (FLINK-21060) Could not create the DispatcherResourceManagerComponent

2021-01-20 Thread Spongebob (Jira)
Spongebob created FLINK-21060: - Summary: Could not create the DispatcherResourceManagerComponent Key: FLINK-21060 URL: https://issues.apache.org/jira/browse/FLINK-21060 Project: Flink Issue Type:

[jira] [Created] (FLINK-21061) Introduce RemotePersistedValue construct in Stateful Functions

2021-01-20 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-21061: --- Summary: Introduce RemotePersistedValue construct in Stateful Functions Key: FLINK-21061 URL: https://issues.apache.org/jira/browse/FLINK-21061 Project:

[jira] [Created] (FLINK-21062) Meeting NPE when using the dynamic Index in elasticsearch connector

2021-01-20 Thread xiaozilong (Jira)
xiaozilong created FLINK-21062: -- Summary: Meeting NPE when using the dynamic Index in elasticsearch connector Key: FLINK-21062 URL: https://issues.apache.org/jira/browse/FLINK-21062 Project: Flink

[jira] [Created] (FLINK-21063) ElasticsearchSinkITCase fails while setting up ES cluster

2021-01-20 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21063: Summary: ElasticsearchSinkITCase fails while setting up ES cluster Key: FLINK-21063 URL: https://issues.apache.org/jira/browse/FLINK-21063 Project: Flink

[DISCUSS] FLIP-161: Configuration through environment variables

2021-01-20 Thread Ingo Bürk
Hi everyone, I've now started a FLIP and am opening this discussion thread. Very much looking forward to your feedback! FLIP: https://cwiki.apache.org/confluence/x/ngtRCg The first big point I'd like to discuss is about the mechanism of "when" the EVs (environment variables) are looked up. I'll