[jira] [Created] (FLINK-19238) RocksDB performance issue with low managed memory and high parallelism

2020-09-15 Thread Juha Mynttinen (Jira)
Juha Mynttinen created FLINK-19238: -- Summary: RocksDB performance issue with low managed memory and high parallelism Key: FLINK-19238 URL: https://issues.apache.org/jira/browse/FLINK-19238 Project: F

Re: Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Yu Li
Congrats and welcome, Arvid! Best Regards, Yu On Tue, 15 Sep 2020 at 14:51, Yun Gao wrote: > Congratulations Arvid ! > > Best, > Yun > > > > --Original Mail -- > Sender:Yangze Guo > Send Date:Tue Sep 15 13:39:56 2020 > Recipients:dev > Subject:Re: [ANNOUNCE]

Re: Re: [ANNOUNCE] New Apache Flink Committer - Niels Basjes

2020-09-15 Thread Yu Li
Congratulations, Niels! Best Regards, Yu On Tue, 15 Sep 2020 at 14:52, Yun Gao wrote: > Congratulations Niels! > > Best, > Yun > > > -- > Sender:Congxian Qiu > Date:2020/09/15 13:33:31 > Recipient:dev@flink.apache.org > Theme:R

Re: [DISCUSS] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread Dawid Wysakowicz
Sorry for joining so late. Generally speaking I like this idea very much! I have one idea about the StateBackend interface. Could we instead of adding a flag method boolean isLegacyStateBackend remove the checkpointstorage related methods from StateBackend right away? The old/legacy implementatio

Re: [ANNOUNCE] New Apache Flink Committer - Niels Basjes

2020-09-15 Thread Dawid Wysakowicz
Welcome, Niels! Best, Dawid On 14/09/2020 11:22, Matt Wang wrote: > Congratulations, Niels! > > > -- > > Best, > Matt Wang > > > On 09/14/2020 17:02,Konstantin Knauf wrote: > Congratulations! > > On Mon, Sep 14, 2020 at 10:51 AM tison wrote: > > Congrats! > > Best, > tison. > > > Aljoscha Krett

Re: [VOTE] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread Aljoscha Krettek
+1 (binding) Aljoscha

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Dawid Wysakowicz
Congratulations Arvid! Very well deserved! Best, Dawid On 15/09/2020 04:38, Zhijiang wrote: > Hi all, > > On behalf of the PMC, I’m very happy to announce Arvid Heise as a new Flink > committer. > > Arvid has been an active community member for more than a year, with 138 > contributions includ

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-09-15 Thread Aljoscha Krettek
On 15.09.20 07:00, Xuannan Su wrote: Thanks for your comment. I agree that we should not introduce tight coupling with PipelineExecutor to the execution environment. With that in mind, to distinguish the per-job and session mode, we can introduce a new method, naming isPerJobModeExecutor, in t

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Jingsong Li
Congratulations Arvid ! Best, Jingsong On Tue, Sep 15, 2020 at 3:27 PM Dawid Wysakowicz wrote: > Congratulations Arvid! Very well deserved! > > Best, > > Dawid > > On 15/09/2020 04:38, Zhijiang wrote: > > Hi all, > > > > On behalf of the PMC, I’m very happy to announce Arvid Heise as a new > Fl

[ANNOUNCE] Weekly Community Update 2020/37

2020-09-15 Thread Konstantin Knauf
Dear community, happy to share a belated update for the past week. This time with the release of Flink 1.11.2, a couple of discussions and FLIPs on improving Flink's APIs and dropping some baggage, most notably Scala 2.11, a new unified sink API and a bit more. Flink Development == *

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Aljoscha Krettek
On 15.09.20 01:33, Steven Wu wrote: ## concurrent checkpoints @Aljoscha Krettek regarding the concurrent checkpoints, let me illustrate with a simple DAG below. [image: image.png] Hi Steven, images don't make it through to the mailing lists. You would need to host the file somewhere and sen

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Aljoscha Krettek
On 15.09.20 06:05, Guowei Ma wrote: ## Using checkpointId In the batch execution mode there would be no normal checkpoint any more. That is why we do not introduce the checkpoint id in the API. So it is a great thing that sink decouples its implementation from checkpointid. :) Yes, this is a ve

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Dawid Wysakowicz
> What I understand is that HiveSink's implementation might need the local > committer(FileCommitter) because the file rename is needed. > But the iceberg only needs to write the manifest file. Would you like to > enlighten me why the Iceberg needs the local committer? > Thanks Sorry if I caused a

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Aljoscha Krettek
On 15.09.20 09:55, Dawid Wysakowicz wrote: BTW Let's not forget about Piotr's comment. I think we could add the isAvailable or similar method to the Writer interface in the FLIP. I'm not so sure about this, the sinks I'm aware of would not be able to implement this method: Kafka doesn't have t

[ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Tzu-Li (Gordon) Tai
Hi all, It's great seeing many new Flink committers recently, and to add to that I'd like to announce one more new committer: Igal Shilman! Igal has been a long time member of the community. You may very likely know Igal from the Stateful Functions sub-project, as he was the original author of it

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Paul Lam
Congrats, Igal! Best, Paul Lam > 2020年9月15日 16:14,Tzu-Li (Gordon) Tai 写道: > > Hi all, > > It's great seeing many new Flink committers recently, and to add to that > I'd like to announce one more new committer: Igal Shilman! > > Igal has been a long time member of the community. You may very l

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread David Anderson
Congrats, Igal! Well deserved. David On Tue, Sep 15, 2020 at 10:14 AM Tzu-Li (Gordon) Tai wrote: > Hi all, > > It's great seeing many new Flink committers recently, and to add to that > I'd like to announce one more new committer: Igal Shilman! > > Igal has been a long time member of the commun

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Paul Lam
Congrats, Arvid! Best, Paul Lam > 2020年9月15日 15:29,Jingsong Li 写道: > > Congratulations Arvid ! > > Best, > Jingsong > > On Tue, Sep 15, 2020 at 3:27 PM Dawid Wysakowicz > wrote: > >> Congratulations Arvid! Very well deserved! >> >> Best, >> >> Dawid >> >> On 15/09/2020 04:38, Zhijiang wr

Re: [VOTE] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread Tzu-Li (Gordon) Tai
+1 (binding) On Tue, Sep 15, 2020 at 3:26 PM Aljoscha Krettek wrote: > +1 (binding) > > Aljoscha >

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Leonard Xu
Congrats! Arvid. Best, Leonard > 在 2020年9月15日,16:23,Paul Lam 写道: > > Congrats, Arvid! > > Best, > Paul Lam > >> 2020年9月15日 15:29,Jingsong Li 写道: >> >> Congratulations Arvid ! >> >> Best, >> Jingsong >> >> On Tue, Sep 15, 2020 at 3:27 PM Dawid Wysakowicz >> wrote: >> >>> Congratulations

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Fabian Hueske
Congrats Arvid and welcome aboard! Cheers, Fabian Am Di., 15. Sept. 2020 um 10:23 Uhr schrieb Paul Lam : > Congrats, Arvid! > > Best, > Paul Lam > > > 2020年9月15日 15:29,Jingsong Li 写道: > > > > Congratulations Arvid ! > > > > Best, > > Jingsong > > > > On Tue, Sep 15, 2020 at 3:27 PM Dawid Wysako

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Fabian Hueske
Congrats Igal and welcome aboard! Cheers, Fabian Am Di., 15. Sept. 2020 um 10:22 Uhr schrieb David Anderson < da...@alpinegizmo.com>: > Congrats, Igal! Well deserved. > > David > > On Tue, Sep 15, 2020 at 10:14 AM Tzu-Li (Gordon) Tai > wrote: > > > Hi all, > > > > It's great seeing many new F

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-09-15 Thread Xuannan Su
Hi Aljoscha, I thought about relying on the failover mechanism to re-execute the whole graph when the cache doesn’t exist. The only concern I have is that every job that uses the cache table in the per-job cluster will have to go through the following process, job submit -> job fail because of

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Dian Fu
Congratulations! Regards, Dian > 在 2020年9月15日,下午4:32,Fabian Hueske 写道: > > Congrats Igal and welcome aboard! > > Cheers, > Fabian > > > > Am Di., 15. Sept. 2020 um 10:22 Uhr schrieb David Anderson < > da...@alpinegizmo.com>: > >> Congrats, Igal! Well deserved. >> >> David >> >> On Tue, S

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Dawid Wysakowicz
Congrats Igal. It's good to have you among committers! :) Best, Dawid On 15/09/2020 10:14, Tzu-Li (Gordon) Tai wrote: > Hi all, > > It's great seeing many new Flink committers recently, and to add to that > I'd like to announce one more new committer: Igal Shilman! > > Igal has been a long time

[jira] [Created] (FLINK-19239) FlinkKafkaProducer

2020-09-15 Thread zhangyunyun (Jira)
zhangyunyun created FLINK-19239: --- Summary: FlinkKafkaProducer Key: FLINK-19239 URL: https://issues.apache.org/jira/browse/FLINK-19239 Project: Flink Issue Type: Bug Components: Connec

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread David Anderson
Congratulations, Arvid! Well deserved. Best, David On Tue, Sep 15, 2020 at 10:23 AM Paul Lam wrote: > Congrats, Arvid! > > Best, > Paul Lam > > > 2020年9月15日 15:29,Jingsong Li 写道: > > > > Congratulations Arvid ! > > > > Best, > > Jingsong > > > > On Tue, Sep 15, 2020 at 3:27 PM Dawid Wysakowicz

[jira] [Created] (FLINK-19240) Hello, I have a job with multiple Kafka sources. They all contain certain historical data. If you use the events-time window, it will cause sources with less data to cov

2020-09-15 Thread Ryan (Jira)
Ryan created FLINK-19240: Summary: Hello, I have a job with multiple Kafka sources. They all contain certain historical data. If you use the events-time window, it will cause sources with less data to cover more sources through water mark. Is there a so

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Igal Shilman
Congrats Arvid! On Tue, Sep 15, 2020 at 11:12 AM David Anderson wrote: > Congratulations, Arvid! Well deserved. > > Best, > David > > On Tue, Sep 15, 2020 at 10:23 AM Paul Lam wrote: > > > Congrats, Arvid! > > > > Best, > > Paul Lam > > > > > 2020年9月15日 15:29,Jingsong Li 写道: > > > > > > Congra

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Matt Wang
Congrats Igal! -- Best, Matt Wang On 09/15/2020 17:00,Dawid Wysakowicz wrote: Congrats Igal. It's good to have you among committers! :) Best, Dawid On 15/09/2020 10:14, Tzu-Li (Gordon) Tai wrote: Hi all, It's great seeing many new Flink committers recently, and to add to that I'd like to a

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Xingbo Huang
Congratulations! Best, Xingbo Igal Shilman 于2020年9月15日周二 下午5:44写道: > Congrats Arvid! > > On Tue, Sep 15, 2020 at 11:12 AM David Anderson > wrote: > > > Congratulations, Arvid! Well deserved. > > > > Best, > > David > > > > On Tue, Sep 15, 2020 at 10:23 AM Paul Lam wrote: > > > > > Congrats, A

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Xingbo Huang
Congratulations! Best, Xingbo Matt Wang 于2020年9月15日周二 下午5:44写道: > Congrats Igal! > > > -- > > Best, > Matt Wang > > > On 09/15/2020 17:00,Dawid Wysakowicz wrote: > Congrats Igal. It's good to have you among committers! :) > > Best, > > Dawid > > On 15/09/2020 10:14, Tzu-Li (Gordon) Tai wrote: >

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Yu Li
Congrats and welcome, Igal! Best Regards, Yu On Tue, 15 Sep 2020 at 17:47, Xingbo Huang wrote: > Congratulations! > > Best, > Xingbo > > Matt Wang 于2020年9月15日周二 下午5:44写道: > > > Congrats Igal! > > > > > > -- > > > > Best, > > Matt Wang > > > > > > On 09/15/2020 17:00,Dawid Wysakowicz wrote: >

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Matthias Pohl
Congratulations! ;-) On Tue, Sep 15, 2020 at 11:47 AM Xingbo Huang wrote: > Congratulations! > > Best, > Xingbo > > Igal Shilman 于2020年9月15日周二 下午5:44写道: > > > Congrats Arvid! > > > > On Tue, Sep 15, 2020 at 11:12 AM David Anderson > > wrote: > > > > > Congratulations, Arvid! Well deserved. > >

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Matthias Pohl
Congrats, Igal! :-) On Tue, Sep 15, 2020 at 11:47 AM Xingbo Huang wrote: > Congratulations! > > Best, > Xingbo > > Matt Wang 于2020年9月15日周二 下午5:44写道: > > > Congrats Igal! > > > > > > -- > > > > Best, > > Matt Wang > > > > > > On 09/15/2020 17:00,Dawid Wysakowicz wrote: > > Congrats Igal. It's go

Re: [ANNOUNCE] New Apache Flink Committer - Niels Basjes

2020-09-15 Thread Matthias Pohl
Congrats! Best, Matthias On Tue, Sep 15, 2020 at 9:26 AM Dawid Wysakowicz wrote: > Welcome, Niels! > > Best, > > Dawid > > On 14/09/2020 11:22, Matt Wang wrote: > > Congratulations, Niels! > > > > > > -- > > > > Best, > > Matt Wang > > > > > > On 09/14/2020 17:02,Konstantin Knauf wrote: > > Con

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-09-15 Thread Aljoscha Krettek
On 15.09.20 10:54, Xuannan Su wrote: One way of solving this is to let the CatalogManager probe the existence of the IntermediateResult so that the planner can decide if the cache table should be used. That could be a reasonable solution, yes. Best, Aljoscha

[ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Yu Li
Hi all, It's great seeing many new Flink committers recently, and on behalf of the PMC, I'd like to announce one more new committer: Yun Tang! Yun has been an active contributor for more than two years, with 132 contributions including 72 commits and many PR reviews. Yun mainly works on state ba

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread 刘建刚
Congratulations! Best Matthias Pohl 于2020年9月15日周二 下午6:07写道: > Congratulations! ;-) > > On Tue, Sep 15, 2020 at 11:47 AM Xingbo Huang wrote: > > > Congratulations! > > > > Best, > > Xingbo > > > > Igal Shilman 于2020年9月15日周二 下午5:44写道: > > > > > Congrats Arvid! > > > > > > On Tue, Sep 15, 2020 a

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Rafi Aroch
Congratulations Igal! Well deserved! Rafi On Tue, Sep 15, 2020 at 11:14 AM Tzu-Li (Gordon) Tai wrote: > Hi all, > > It's great seeing many new Flink committers recently, and to add to that > I'd like to announce one more new committer: Igal Shilman! > > Igal has been a long time member of the

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Zhu Zhu
Congratulations! Thanks, Zhu Yu Li 于2020年9月15日周二 下午6:19写道: > Hi all, > > It's great seeing many new Flink committers recently, and on behalf of the > PMC, I'd like to announce one more new committer: Yun Tang! > > Yun has been an active contributor for more than two years, with 132 > contributi

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Yun Gao
Congratulations Yun Tang! Best, Yun Gao -- Sender:Zhu Zhu Date:2020/09/15 18:49:24 Recipient:dev Cc:; Yun Tang Theme:Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang Congratulations! Thanks, Zhu Yu Li 于2020年9月15日周二 下午6:19写道

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Zhu Zhu
Congratulations, Igal! Thanks, Zhu Rafi Aroch 于2020年9月15日周二 下午6:43写道: > Congratulations Igal! Well deserved! > > Rafi > > > On Tue, Sep 15, 2020 at 11:14 AM Tzu-Li (Gordon) Tai > wrote: > > > Hi all, > > > > It's great seeing many new Flink committers recently, and to add to that > > I'd like

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Xintong Song
Congratulations, Yun~! Thank you~ Xintong Song On Tue, Sep 15, 2020 at 6:50 PM Zhu Zhu wrote: > Congratulations! > > Thanks, > Zhu > > Yu Li 于2020年9月15日周二 下午6:19写道: > > > Hi all, > > > > It's great seeing many new Flink committers recently, and on behalf of > the > > PMC, I'd like to announ

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Xintong Song
Congratulations~! Thank you~ Xintong Song On Tue, Sep 15, 2020 at 6:43 PM Rafi Aroch wrote: > Congratulations Igal! Well deserved! > > Rafi > > > On Tue, Sep 15, 2020 at 11:14 AM Tzu-Li (Gordon) Tai > wrote: > > > Hi all, > > > > It's great seeing many new Flink committers recently, and to

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Dian Fu
Congratulations! Well deserved! Regards, Dian > 在 2020年9月15日,下午6:51,Yun Gao 写道: > > Congratulations Yun Tang! > > > Best, > Yun Gao > > > -- > Sender:Zhu Zhu > Date:2020/09/15 18:49:24 > Recipient:dev > Cc:; Yun Tang > Theme:Re

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Yangze Guo
Congrats, Yun! Best, Yangze Guo On Tue, Sep 15, 2020 at 6:58 PM Dian Fu wrote: > > Congratulations! Well deserved! > > Regards, > Dian > > > 在 2020年9月15日,下午6:51,Yun Gao 写道: > > > > Congratulations Yun Tang! > > > > > > Best, > > Yun Gao > > > > > > --

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Leonard Xu
Congrats, Yun! Best, Leonard > 在 2020年9月15日,19:01,Yangze Guo 写道: > > Congrats, Yun!

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Yang Wang
Congratulations, Yun! Best, Yang Leonard Xu 于2020年9月15日周二 下午7:11写道: > Congrats, Yun! > > Best, > Leonard > > 在 2020年9月15日,19:01,Yangze Guo 写道: > > > > Congrats, Yun! > >

[jira] [Created] (FLINK-19241) Forward ClusterEntrypoint ioExecutor to ResourceManager

2020-09-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19241: -- Summary: Forward ClusterEntrypoint ioExecutor to ResourceManager Key: FLINK-19241 URL: https://issues.apache.org/jira/browse/FLINK-19241 Project: Flink I

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Guowei Ma
Hi, Dawid >>I still find the merging case the most confusing. I don't necessarily understand why do you need the "SingleFileCommit" step in this scenario. The way I >> understand "commit" operation is that it makes some data/artifacts visible to the external system, thus it should be immutable fro

[jira] [Created] (FLINK-19242) org.apache.flink.table.api.ValidationException: Cannot resolve field

2020-09-15 Thread henvealf (Jira)
henvealf created FLINK-19242: Summary: org.apache.flink.table.api.ValidationException: Cannot resolve field Key: FLINK-19242 URL: https://issues.apache.org/jira/browse/FLINK-19242 Project: Flink

[jira] [Created] (FLINK-19243) Bump Snakeyaml to 1.27

2020-09-15 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-19243: Summary: Bump Snakeyaml to 1.27 Key: FLINK-19243 URL: https://issues.apache.org/jira/browse/FLINK-19243 Project: Flink Issue Type: Improvement

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Benchao Li
Congratulations! Zhu Zhu 于2020年9月15日周二 下午6:51写道: > Congratulations, Igal! > > Thanks, > Zhu > > Rafi Aroch 于2020年9月15日周二 下午6:43写道: > > > Congratulations Igal! Well deserved! > > > > Rafi > > > > > > On Tue, Sep 15, 2020 at 11:14 AM Tzu-Li (Gordon) Tai < > tzuli...@apache.org> > > wrote: > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Benchao Li
Congratulations! Yang Wang 于2020年9月15日周二 下午7:15写道: > Congratulations, Yun! > > Best, > Yang > > Leonard Xu 于2020年9月15日周二 下午7:11写道: > > > Congrats, Yun! > > > > Best, > > Leonard > > > 在 2020年9月15日,19:01,Yangze Guo 写道: > > > > > > Congrats, Yun! > > > > > -- Best, Benchao Li

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread tison
Congratulations, Yun! Best, tison. Benchao Li 于2020年9月15日周二 下午8:15写道: > Congratulations! > > Yang Wang 于2020年9月15日周二 下午7:15写道: > > > Congratulations, Yun! > > > > Best, > > Yang > > > > Leonard Xu 于2020年9月15日周二 下午7:11写道: > > > > > Congrats, Yun! > > > > > > Best, > > > Leonard > > > > 在 2020

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Igal Shilman
Congratulations! All the best, Igal. On Tue, Sep 15, 2020 at 2:17 PM tison wrote: > Congratulations, Yun! > > Best, > tison. > > > Benchao Li 于2020年9月15日周二 下午8:15写道: > > > Congratulations! > > > > Yang Wang 于2020年9月15日周二 下午7:15写道: > > > > > Congratulations, Yun! > > > > > > Best, > > > Yang >

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Dawid Wysakowicz
Congratulations! On 15/09/2020 12:19, Yu Li wrote: > Hi all, > > It's great seeing many new Flink committers recently, and on behalf of the > PMC, I'd like to announce one more new committer: Yun Tang! > > Yun has been an active contributor for more than two years, with 132 > contributions includi

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Seth Wiesman
Congrats Igal! On Tue, Sep 15, 2020 at 7:13 AM Benchao Li wrote: > Congratulations! > > Zhu Zhu 于2020年9月15日周二 下午6:51写道: > > > Congratulations, Igal! > > > > Thanks, > > Zhu > > > > Rafi Aroch 于2020年9月15日周二 下午6:43写道: > > > > > Congratulations Igal! Well deserved! > > > > > > Rafi > > > > > > >

Re: [DISCUSS] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread Seth Wiesman
Hey Dawid, I didn't want to break compatibility but if there is precedent and everyone is ok with it then I'm +1. Seth On Tue, Sep 15, 2020 at 2:22 AM Dawid Wysakowicz wrote: > Sorry for joining so late. > > Generally speaking I like this idea very much! > > I have one idea about the StateBack

[jira] [Created] (FLINK-19244) CsvRowDataDeserializationSchema throws cast exception : Row length mismatch.

2020-09-15 Thread Ying Z (Jira)
Ying Z created FLINK-19244: -- Summary: CsvRowDataDeserializationSchema throws cast exception : Row length mismatch. Key: FLINK-19244 URL: https://issues.apache.org/jira/browse/FLINK-19244 Project: Flink

Re: [DISCUSS] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread Dawid Wysakowicz
There is a good number of precedents that introduced backwards incompatible changes to that interface (which is PublicEvolving btw). We introduced a couple of additional arguments to the createKeyedStateBackend method and later on removed the methods with default implementation for backwards compat

Re: [DISCUSS] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread Seth Wiesman
Sounds good to me. I'll update the FLIP. On Tue, Sep 15, 2020 at 8:35 AM Dawid Wysakowicz wrote: > There is a good number of precedents that introduced backwards > incompatible changes to that interface (which is PublicEvolving btw). We > introduced a couple of additional arguments to the > crea

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Steven Wu
> images don't make it through to the mailing lists. You would need to host the file somewhere and send a link. Sorry about that. Here is the sample DAG in google drawings. https://docs.google.com/drawings/d/1-P8F2jF9RG9HHTtAfWEBRuU_2uV9aDTdqEt5dLs2JPk/edit?usp=sharing On Tue, Sep 15, 2020 at 4:

[jira] [Created] (FLINK-19245) Set default queue capacity for FLIP-27 source handover queue to 2

2020-09-15 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-19245: Summary: Set default queue capacity for FLIP-27 source handover queue to 2 Key: FLINK-19245 URL: https://issues.apache.org/jira/browse/FLINK-19245 Project: Flink

Re: Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread 刘大龙
Congratulations! > -原始邮件- > 发件人: "Dawid Wysakowicz" > 发送时间: 2020-09-15 20:34:34 (星期二) > 收件人: dev@flink.apache.org, tang...@apache.org, "Yun Tang" > 抄送: > 主题: Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang > > Congratulations! > > On 15/09/2020 12:19, Yu Li wrote: > > Hi all, >

[jira] [Created] (FLINK-19246) TableSourceITCase.testStreamScanParallelism fails on private Azure accounts

2020-09-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19246: -- Summary: TableSourceITCase.testStreamScanParallelism fails on private Azure accounts Key: FLINK-19246 URL: https://issues.apache.org/jira/browse/FLINK-19246 Proje

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Yuan Mei
congrats, Yun! On Tue, Sep 15, 2020 at 6:19 PM Yu Li wrote: > Hi all, > > It's great seeing many new Flink committers recently, and on behalf of the > PMC, I'd like to announce one more new committer: Yun Tang! > > Yun has been an active contributor for more than two years, with 132 > contributi

[jira] [Created] (FLINK-19247) Update Chinese documentation after removal of Kafka 0.10 and 0.11

2020-09-15 Thread Aljoscha Krettek (Jira)
Aljoscha Krettek created FLINK-19247: Summary: Update Chinese documentation after removal of Kafka 0.10 and 0.11 Key: FLINK-19247 URL: https://issues.apache.org/jira/browse/FLINK-19247 Project: Fl

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Stephan Ewen
Welcome, Igal! On Tue, Sep 15, 2020 at 3:18 PM Seth Wiesman wrote: > Congrats Igal! > > On Tue, Sep 15, 2020 at 7:13 AM Benchao Li wrote: > > > Congratulations! > > > > Zhu Zhu 于2020年9月15日周二 下午6:51写道: > > > > > Congratulations, Igal! > > > > > > Thanks, > > > Zhu > > > > > > Rafi Aroch 于2020年

[jira] [Created] (FLINK-19248) The main method caused an error: No result found for job, was execute() called before getting the result

2020-09-15 Thread Shiyu Jin (Jira)
Shiyu Jin created FLINK-19248: - Summary: The main method caused an error: No result found for job, was execute() called before getting the result Key: FLINK-19248 URL: https://issues.apache.org/jira/browse/FLINK-19248

[jira] [Created] (FLINK-19249) Job would wait sometime(~10 min) before failover if some connection broken

2020-09-15 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-19249: - Summary: Job would wait sometime(~10 min) before failover if some connection broken Key: FLINK-19249 URL: https://issues.apache.org/jira/browse/FLINK-19249

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Arvid Heise
Congratulations! On Tue, Sep 15, 2020 at 4:29 PM Yuan Mei wrote: > congrats, Yun! > > On Tue, Sep 15, 2020 at 6:19 PM Yu Li wrote: > > > Hi all, > > > > It's great seeing many new Flink committers recently, and on behalf of > the > > PMC, I'd like to announce one more new committer: Yun Tang! >

Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Arvid Heise
Congratulations :) On Tue, Sep 15, 2020 at 4:48 PM Stephan Ewen wrote: > Welcome, Igal! > > On Tue, Sep 15, 2020 at 3:18 PM Seth Wiesman wrote: > > > Congrats Igal! > > > > On Tue, Sep 15, 2020 at 7:13 AM Benchao Li wrote: > > > > > Congratulations! > > > > > > Zhu Zhu 于2020年9月15日周二 下午6:51写道:

Re: [VOTE] FLIP-142: Disentangle StateBackends from Checkpointing

2020-09-15 Thread David Anderson
+1 (binding) David On Tue, Sep 15, 2020 at 10:25 AM Tzu-Li (Gordon) Tai wrote: > +1 (binding) > > On Tue, Sep 15, 2020 at 3:26 PM Aljoscha Krettek > wrote: > > > +1 (binding) > > > > Aljoscha > > >

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-09-15 Thread Xuannan Su
Hi everyone, @Aljoscha, I have updated the Per-Job mode Section of the FLIP. It seems that people involved in the discussion have reach a consensus. If there are no more comments, I would like to start the voting thread tomorrow. Best, Xuannan On Sep 15, 2020, 6:18 PM +0800, Aljoscha Krettek ,

[jira] [Created] (FLINK-19250) SplitFetcherManager does not propagate errors correctly

2020-09-15 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-19250: Summary: SplitFetcherManager does not propagate errors correctly Key: FLINK-19250 URL: https://issues.apache.org/jira/browse/FLINK-19250 Project: Flink Issue

[jira] [Created] (FLINK-19251) Avoid confusing queue handling in "SplitReader.handleSplitsChanges()"

2020-09-15 Thread Stephan Ewen (Jira)
Stephan Ewen created FLINK-19251: Summary: Avoid confusing queue handling in "SplitReader.handleSplitsChanges()" Key: FLINK-19251 URL: https://issues.apache.org/jira/browse/FLINK-19251 Project: Flink

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Steven Wu
> AFAIK the committer would not see the file-1-2 when ck1 happens in the ExactlyOnce mode. @Guowei Ma I think you are right for exactly once checkpoint semantics. what about "at least once"? I guess we can argue that it is fine to commit file-1-2 for at least once mode. I still like the concept

[jira] [Created] (FLINK-19252) Jaas file created under io.tmp.dirs - folder not created if not exists

2020-09-15 Thread Koala Lam (Jira)
Koala Lam created FLINK-19252: - Summary: Jaas file created under io.tmp.dirs - folder not created if not exists Key: FLINK-19252 URL: https://issues.apache.org/jira/browse/FLINK-19252 Project: Flink

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Paul Lam
Congrats, Yun! Well deserved! Best, Paul Lam > 2020年9月15日 19:14,Yang Wang 写道: > > Congratulations, Yun! > > Best, > Yang > > Leonard Xu 于2020年9月15日周二 下午7:11写道: > >> Congrats, Yun! >> >> Best, >> Leonard >>> 在 2020年9月15日,19:01,Yangze Guo 写道: >>> >>> Congrats, Yun! >> >>

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Rui Li
Congratulations Yun! On Wed, Sep 16, 2020 at 10:20 AM Paul Lam wrote: > Congrats, Yun! Well deserved! > > Best, > Paul Lam > > > 2020年9月15日 19:14,Yang Wang 写道: > > > > Congratulations, Yun! > > > > Best, > > Yang > > > > Leonard Xu 于2020年9月15日周二 下午7:11写道: > > > >> Congrats, Yun! > >> > >> Best

Re: Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Yun Gao
Congratulations Igal! Best, Yun -- Sender:Stephan Ewen Date:2020/09/15 22:48:30 Recipient:dev Theme:Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman Welcome, Igal! On Tue, Sep 15, 2020 at 3:18 PM Seth Wiesman wrote:

[jira] [Created] (FLINK-19253) SourceReaderTestBase.testAddSplitToExistingFetcher hangs

2020-09-15 Thread Dian Fu (Jira)
Dian Fu created FLINK-19253: --- Summary: SourceReaderTestBase.testAddSplitToExistingFetcher hangs Key: FLINK-19253 URL: https://issues.apache.org/jira/browse/FLINK-19253 Project: Flink Issue Type: Bu

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Jark Wu
Congratulations Yun! On Wed, 16 Sep 2020 at 10:40, Rui Li wrote: > Congratulations Yun! > > On Wed, Sep 16, 2020 at 10:20 AM Paul Lam wrote: > > > Congrats, Yun! Well deserved! > > > > Best, > > Paul Lam > > > > > 2020年9月15日 19:14,Yang Wang 写道: > > > > > > Congratulations, Yun! > > > > > > Bes

[jira] [Created] (FLINK-19254) Invalid UTF-8 start byte exception

2020-09-15 Thread Jun Zhang (Jira)
Jun Zhang created FLINK-19254: - Summary: Invalid UTF-8 start byte exception Key: FLINK-19254 URL: https://issues.apache.org/jira/browse/FLINK-19254 Project: Flink Issue Type: Bug Compo

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Zhijiang
Congratulations and welcome, Yun! -- From:Jark Wu Send Time:2020年9月16日(星期三) 11:35 To:dev Cc:tangyun ; Yun Tang Subject:Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang Congratulations Yun! On Wed, 16 Sep 2020 at 10:40, Rui L

Re: Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Zhijiang
Congratulations and welcome, Igal! -- From:Yun Gao Send Time:2020年9月16日(星期三) 10:59 To:Stephan Ewen ; dev Subject:Re: Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman Congratulations Igal! Best, Yun

[VOTE] FLIP-36 - Support Interactive Programming in Flink Table API

2020-09-15 Thread Xuannan Su
Hi all, I'd like to start the vote for FLIP-36[1], which has been discussed in thread[2]. The vote will be open for 72h, until September 19, 2020, 04:00 AM UTC, unless there's an objection or not enough votes. Best, Xuannan [1]  https://cwiki.apache.org/confluence/display/FLINK/FLIP-36%3A+Sup

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Guowei Ma
Hi, Steven Thanks you for your thoughtful ideas and concerns. >>I still like the concept of grouping data files per checkpoint for streaming mode. it is cleaner and probably easier to manage and deal with commit failures. Plus, it >>can reduce dupes for the at least once >>mode. I understand chec

[ANNOUNCE] New Apache Flink Committer - Godfrey He

2020-09-15 Thread Jark Wu
Hi everyone, It's great seeing many new Flink committers recently, and on behalf of the PMC, I'd like to announce one more new committer: Godfrey He. Godfrey is a very long time contributor in the Flink community since the end of 2016. He has been a very active contributor in the Flink SQL compon

Re: [DISCUSS] FLIP-143: Unified Sink API

2020-09-15 Thread Guowei Ma
Hi,all Thanks for all your valuable options and ideas.Currently there are many topics in the mail. I try to summarize what is consensus and what is not. Correct me if I am wrong. ## Consensus 1. The motivation of the unified sink API is to decouple the sink implementation from the different runt

Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He

2020-09-15 Thread Guowei Ma
Congratulations :) Best, Guowei On Wed, Sep 16, 2020 at 12:19 PM Jark Wu wrote: > Hi everyone, > > It's great seeing many new Flink committers recently, and on behalf of the > PMC, > I'd like to announce one more new committer: Godfrey He. > > Godfrey is a very long time contributor in the Fli

Re: Re: [ANNOUNCE] New Apache Flink Committer - Igal Shilman

2020-09-15 Thread Guowei Ma
Congratulations :) Best, Guowei On Wed, Sep 16, 2020 at 11:54 AM Zhijiang wrote: > Congratulations and welcome, Igal! > > > -- > From:Yun Gao > Send Time:2020年9月16日(星期三) 10:59 > To:Stephan Ewen ; dev > Subject:Re: Re: [ANNOUNCE]

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Guowei Ma
Congratulations :) Best, Guowei On Wed, Sep 16, 2020 at 11:54 AM Zhijiang wrote: > Congratulations and welcome, Yun! > > > -- > From:Jark Wu > Send Time:2020年9月16日(星期三) 11:35 > To:dev > Cc:tangyun ; Yun Tang > Subject:Re: [ANNO

Re: [ANNOUNCE] New Apache Flink Committer - Niels Basjes

2020-09-15 Thread Guowei Ma
Congratulations :) Best, Guowei On Tue, Sep 15, 2020 at 6:14 PM Matthias Pohl wrote: > Congrats! > > Best, > Matthias > > On Tue, Sep 15, 2020 at 9:26 AM Dawid Wysakowicz > wrote: > > > Welcome, Niels! > > > > Best, > > > > Dawid > > > > On 14/09/2020 11:22, Matt Wang wrote: > > > Congratulat

Re: [ANNOUNCE] New Apache Flink Committer - Arvid Heise

2020-09-15 Thread Guowei Ma
Congratulations :) Best, Guowei On Tue, Sep 15, 2020 at 6:41 PM 刘建刚 wrote: > Congratulations! > > Best > > Matthias Pohl 于2020年9月15日周二 下午6:07写道: > > > Congratulations! ;-) > > > > On Tue, Sep 15, 2020 at 11:47 AM Xingbo Huang > wrote: > > > > > Congratulations! > > > > > > Best, > > > Xingbo

Re: [ANNOUNCE] New Apache Flink Committer - Godfrey He

2020-09-15 Thread Dian Fu
Congratulations, well deserved! Regards, Dian > 在 2020年9月16日,下午12:36,Guowei Ma 写道: > > Congratulations :) > > Best, > Guowei > > > On Wed, Sep 16, 2020 at 12:19 PM Jark Wu wrote: > >> Hi everyone, >> >> It's great seeing many new Flink committers recently, and on behalf of the >> PMC, >>

[jira] [Created] (FLINK-19255) Add configuration to make AsyncWaitOperation Chainable

2020-09-15 Thread Kyle (Jira)
Kyle created FLINK-19255: Summary: Add configuration to make AsyncWaitOperation Chainable Key: FLINK-19255 URL: https://issues.apache.org/jira/browse/FLINK-19255 Project: Flink Issue Type: Task

Re: [ANNOUNCE] New Apache Flink Committer - Yun Tang

2020-09-15 Thread Congxian Qiu
Congratulations! Best, Congxian Guowei Ma 于2020年9月16日周三 下午12:37写道: > Congratulations :) > > Best, > Guowei > > > On Wed, Sep 16, 2020 at 11:54 AM Zhijiang > wrote: > > > Congratulations and welcome, Yun! > > > > > > -- > > From:Ja

  1   2   >