[ANNOUNCE] New PMC member: Dian Fu

Hi all, On behalf of the Flink PMC, I'm happy to announce that Dian Fu is now part of the Apache Flink Project Management Committee (PMC). Dian Fu has been very active on PyFlink component, working on various important features, such as the Python UDF and Pandas integration, and keeps checking an

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

Thank you for your positive feedback Seth ! Would you please vote in the voting mail thread. Thank you! Best, Jincheng Seth Wiesman 于2020年8月10日周一 下午10:34写道： > I think this sounds good. +1 > > On Wed, Aug 5, 2020 at 8:37 PM jincheng sun > wrote: > >> Hi David, Than

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

n a specific way that I >> haven't thought of -- as in this case, where one can use a JDBC sink from >> Python if one thinks to use DDL. >> >> So I think it would be helpful to be explicit about both what is, and >> what is not, supported in PyFlink. And to have s

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

documentation is currently > organized is that it's relatively straightforward to compare the Python API > with the Java and Scala versions. I'm concerned that if the PyFlink docs > are more independent, it will be challenging to respond to questions about > which features from the

Re: [DISCUSS] FLIP-133: Rework PyFlink Documentation

Jincheng, >>> >> >>> >> Thanks a lot for bringing up this discussion and the proposal. +1 to >>> >> improve the Python API doc. >>> >> >>> >> I have received many feedbacks from PyFlink beginners about >>> >> th

[DISCUSS] FLIP-133: Rework PyFlink Documentation

Hi folks, Since the release of Flink 1.11, users of PyFlink have continued to grow. As far as I know there are many companies have used PyFlink for data analysis, operation and maintenance monitoring business has been put into production(Such as 聚美优品[1](Jumei), 浙江墨芷[2] (Mozhi) etc.). According t

Re: pyflink的table api 能否根据 filed的值进行判断插入到不同的sink表中

您好，jack： Table API 不用 if/else 直接用类似逻辑即可： val t1 = table.filter('x > 2).groupBy(..) val t2 = table.filter('x <= 2).groupBy(..) t1.insert_into("sink1) t2.insert_into("sink2") Best, Jincheng jack 于2020年6月19日周五 上午10:35写道： > > 测试使用如下结构： > table= t_env.from_path("source") > > if table.filter("

[ANNOUNCE] Yu Li is now part of the Flink PMC

Hi all, On behalf of the Flink PMC, I'm happy to announce that Yu Li is now part of the Apache Flink Project Management Committee (PMC). Yu Li has been very active on Flink's Statebackend component, working on various improvements, for example the RocksDB memory management for 1.10. and keeps che

Re: pyflink数据查询

你好 Jack, > pyflink 从source通过sql对数据进行查询聚合等操作 不输出到sink中，而是可以直接作为结果， 我这边可以通过开发web接口直接查询这个结果，不必去sink中进行查询 我理解你上面说的 【直接作为结果】+ 【web接口查询】已经包含了“sink”的动作。只是这个“sink” 是这样的实现而已。对于您的场景： 1. 如果您想直接将结果不落地（不存储）执行推送的 web页面，可以自定义一个Web Socket的Sink。 2. 如果您不是想直接推送到web页面，而是通过查询拉取结果，那么您上面说的 【直接作为结果】这句话就要描述一下，您想怎样作为结果？我

Re: Python UDF from Java

Thanks Flavio and Thanks Marta, That's a good question as many user want to know that! CC to user-zh mailing list :) Best, Jincheng - Twitter: https://twitter.com/sunjincheng121 - Flavio Pompermaier 于2020年5月1日周五 上午7:04写道： > Yes, that's awesome! I think this would be

Re: [ANNOUNCE] Apache Flink 1.9.3 released

Thanks for your great job, Dian! Best, Jincheng Hequn Cheng 于2020年4月25日周六 下午8:30写道： > @Dian, thanks a lot for the release and for being the release manager. > Also thanks to everyone who made this release possible! > > Best, > Hequn > > On Sat, Apr 25, 2020 at 7:57 PM Dian Fu wrote: > >> Hi e

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

Congratulations Jingsong! Best, Jincheng Zhu Zhu 于2020年2月24日周一 上午11:55写道： > Congratulations Jingsong! > > Thanks, > Zhu Zhu > > Fabian Hueske 于2020年2月22日周六 上午1:30写道： > >> Congrats Jingsong! >> >> Cheers, Fabian >> >> Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong > >: >> >> > Congratula

[ANNOUNCE] Apache Flink Python API(PyFlink) 1.9.2 released

Hi everyone, The Apache Flink community is very happy to announce the release of Apache Flink Python API(PyFlink) 1.9.2, which is the first release to PyPI for the Apache Flink Python API 1.9 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, alw

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

gt;>> > >>> > On Tue, Feb 11, 2020 at 12:17 PM Dian Fu >>> wrote: >>> > >>> > > +1 (non-binding) >>> > > >>> > > - Verified the signature and checksum >>> > > - Pip installed the package successfully: pip install

Re: [VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

l > and no exception. > - Try a word count example in IDE with Python 2.7.15 and Python 3.7.5, run > well and no exception. > > Best, > Wei > > > 在 2020年2月10日，19:12，jincheng sun 写道： > > Hi everyone, > > Please review and vote on the release candidate #1 f

[VOTE] Release Flink Python API(PyFlink) 1.9.2 to PyPI, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the PyFlink version 1.9.2, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * the official Apa

[DISCUSS] Upload the Flink Python API 1.9.x to PyPI for user convenience.

Hi folks, I am very happy to receive some user inquiries about the use of Flink Python API (PyFlink) recently. One of the more common questions is whether it is possible to install PyFlink without using source code build. The most convenient and natural way for users is to use `pip install apache-

Re: [ANNOUNCE] Apache Flink 1.9.2 released

Thanks for being the release manager and the great work Hequn :) Also thanks to the community making this release possible! BTW: I have add the 1.9.2 release to report. Best, Jincheng Hequn Cheng 于2020年1月31日周五 下午6:55写道： > Hi everyone, > > The Apache Flink community is very happy to announce t

Re: [ANNOUNCE] Dian Fu becomes a Flink committer

Congrats Dian Fu and welcome on board! Best, Jincheng Shuo Cheng 于2020年1月16日周四 下午6:22写道： > Congratulations! Dian Fu > > > Xingbo Wei Zhong 于2020年1月16日周四 下午6:13写道： >> jincheng sun > 于2020年1月16日周四 下午5:58写道： >

[ANNOUNCE] Dian Fu becomes a Flink committer

Hi everyone, I'm very happy to announce that Dian accepted the offer of the Flink PMC to become a committer of the Flink project. Dian Fu has been contributing to Flink for many years. Dian Fu played an essential role in PyFlink/CEP/SQL/Table API modules. Dian Fu has contributed several major fea

Re: [DISCUSS] What parts of the Python API should we focus on next ?

On Wed, Dec 18, 2019 at 19:05 jincheng sun > wrote: > >> Also CC user-zh. >> >> Best, >> Jincheng >> >> >> jincheng sun 于2019年12月19日周四 上午10:20写道： >> >>> Hi folks, >>> >>> As release-1.10 is under feature-freeze(

Re: [DISCUSS] What parts of the Python API should we focus on next ?

Also CC user-zh. Best, Jincheng jincheng sun 于2019年12月19日周四 上午10:20写道： > Hi folks, > > As release-1.10 is under feature-freeze(The stateless Python UDF is > already supported), it is time for us to plan the features of PyFlink for > the next release. > > To make sure the

[DISCUSS] What parts of the Python API should we focus on next ?

Hi folks, As release-1.10 is under feature-freeze(The stateless Python UDF is already supported), it is time for us to plan the features of PyFlink for the next release. To make sure the features supported in PyFlink are the mostly demanded for the community, we'd like to get more people involved

Re: [ANNOUNCE] Apache Flink 1.8.3 released

Thanks for being the release manager and the great work Hequn :) Also thanks to the community making this release possible! Best, Jincheng Jark Wu 于2019年12月12日周四 下午3:23写道： > Thanks Hequn for helping out this release and being the release manager. > Great work! > > Best, > Jark > > On Thu, 12 De

Re: [DISCUSS] Drop Kafka 0.8/0.9

+1 for drop it, and Thanks for bring up this discussion Chesnay! Best, Jincheng Jark Wu 于2019年12月5日周四 上午10:19写道： > +1 for dropping, also cc'ed user mailing list. > > > Best, > Jark > > On Thu, 5 Dec 2019 at 03:39, Konstantin Knauf > wrote: > > > Hi Chesnay, > > > > +1 for dropping. I have not

Re: [PROPOSAL] Contribute Stateful Functions to Apache Flink

Hi Stephan, bit +1 for adding this great features to Apache Flink. Regarding where we should place it, put it into Flink core repository or create a separate repository? I prefer put it into main repository and looking forward the more detail discussion for this decision. Best, Jincheng Jingso

Re: [ANNOUNCE] Apache Flink 1.8.2 released

Thanks for being the release manager and the great work Jark :) Also thanks to the community making this release possible! Best, Jincheng Jark Wu 于2019年9月13日周五 下午10:07写道： > Hi, > > The Apache Flink community is very happy to announce the release of Apache > Flink 1.8.2, which is the second bugf

[ANNOUNCE] Hequn becomes a Flink committer

Hi everyone, I'm very happy to announce that Hequn accepted the offer of the Flink PMC to become a committer of the Flink project. Hequn has been contributing to Flink for many years, mainly working on SQL/Table API features. He's also frequently helping out on the user mailing lists and helping

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

Congratulations Rong, Well deserved! Cheers, Jincheng Dian Fu 于2019年7月12日周五 上午9:06写道： > > Congrats Rong! > > > 在 2019年7月12日，上午8:47，Chen YuZhao 写道： > > congratulations! > > 获取 Outlook for iOS > > -- > *发件人:* Rong Rong > *发送时间:* 星期五, 七月 12, 20

Re: Flink 1.8.1 release tag missing?

Thanks Bekir Oguz and Chesnay! Sorry for that, I forgot push the tag, I've pushed the tag to the repo now. https://github.com/apache/flink/tree/release-1.8.1 Thanks again, and I'm very sorry for my negligence has caused confusion in your use. Thanks, Jincheng Bekir Oguz 于2019年7月10日周三 上午12:50写道

Re: [ANNOUNCE] Apache Flink 1.8.1 released

> Thanks jincheng for your great job. > > Best, JingsongLee > > -- > From:Congxian Qiu > Send Time:2019年7月3日(星期三) 14:35 > To:d...@flink.apache.org > Cc:Dian Fu ; jincheng sun > ; Hequn Cheng >

Re: [ANNOUNCE] Apache Flink 1.8.1 released

s to Gorden and the community making this release possible! > > Best, Hequn > > On Wed, Jul 3, 2019 at 9:40 AM jincheng sun > wrote: > >> Hi, >> >> The Apache Flink community is very happy to announce the release of >> Apache Flink 1.8.1, which is the fi

[ANNOUNCE] Apache Flink 1.8.1 released

Hi, The Apache Flink community is very happy to announce the release of Apache Flink 1.8.1, which is the first bugfix release for the Apache Flink 1.8 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streamin

Re: [DISCUSS] Deprecate previous Python APIs

+1 for removing and we can try our best to enrich the new Python API. Cheers, Jincheng Yu Li 于2019年6月14日周五 下午6:42写道： > +1 on removing plus an explicit NOTE thread, to prevent any neglection due > to the current title (deprecation). > > Best Regards, > Yu > > > On Fri, 14 Jun 2019 at 18:09, Step

Re: [DISCUSS] Deprecate previous Python APIs

big +1 for the proposal. We will soon complete all the Python API functional development of the 1.9 release, the development of UDFs will be carried out. After the support of UDFs is completed, it will be very natural to support Datastream API. If all of us agree with this proposal, I believe tha

Re: [SURVEY] Usage of flink-ml and [DISCUSS] Delete flink-ml

+1 for remove it! And we also plan to delete the `flink-libraries/flink-ml-uber`, right? Best, Jincheng Rong Rong 于2019年5月24日周五 上午1:18写道： > +1 for the deletion. > > Also I think it also might be a good idea to update the roadmap for the > plan of removal/development since we've reached the con

Re: [ANNOUNCE] Apache Flink 1.8.0 released

Thanks a lot for being our release manager @Aljoscha Krettek Great job! And also a big thanks to the community for making this release possible. Cheers, Jincheng Aljoscha Krettek 于2019年4月10日周三 下午4:31写道： > The Apache Flink community is very happy to announce the release of Apache > Flink 1.8.0,

Re: FlinkCEP and SQL?

Hi BR Esa, CEP is available in Flink SQL, Please the detail here: https://ci.apache.org/projects/flink/flink-docs-release-1.7/dev/table/sql.html#pattern-recognition Best, Jincheng Esa Heikkinen (TAU) 于2019年4月4日周四 下午4:44写道： > Hi > > > > What is the situation of FlinkCEP and SQL? > > > > Is it alr

Re: [DISCUSS] Introduction of a Table API Java Expression DSL

Thanks for bringing up this DISCUSS Timo! Java Expression DSL is pretty useful for java user. When we have the Java Expression DSL, Java API will become very rich and easy to use! +1 from my side. Best, Jincheng Dawid Wysakowicz 于2019年3月26日周二 下午5:08写道： > Hi, > > I really like the idea of int

Re: Is there window trigger in Table API ?

Hi luyj, Currently, TableAPI does not have the trigger, due to the behavior of the windows(unbounded, tumble, slide, session) is very clear.The behavior of each window is as follows: - Unbounded Window - Each set of keys is a grouping, and each event triggers a calculation. - Tumble Window

Re: [VOTE] Release 1.8.0, release candidate #3

comment-16797614> > in FLINK-11972. > > Best Regards, > Yu > > > On Thu, 21 Mar 2019 at 04:25, jincheng sun > wrote: > >> Thanks for the quick fix Aljoscha! The FLINK-11971 >> <https://issues.apache.org/jira/browse/FLINK-11971> has been merged. &g

Re: [VOTE] Release 1.8.0, release candidate #3

ecked checksums and GPG files > - verified that the source archives do not contains any binaries > - checked that all POM files point to the same version > - build from source successfully > > Best, > Kurt > > > On Wed, Mar 20, 2019 at 2:12 PM jincheng sun > wrote: >

Re: [VOTE] Release 1.8.0, release candidate #3

Hi Aljoscha&All, When I did the `end-to-end` test for RC3 under Mac OS, I found the following two problems: 1. The verification returned for different `minikube status` is is not enough for the robustness. The strings returned by different versions of different platforms are different. the follow

Re: [ANNOUNCE] Apache Flink 1.7.2 released

Thanks a lot for being our release manager Gordon , Great job! And also a big thanks to the community for making this release possible. Cheers, Jincheng Tzu-Li (Gordon) Tai 于2019年2月18日周一 上午10:29写道： > Hi, > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.

Re: [DISCUSS] Adding a mid-term roadmap to the Flink website

-Improvement-to-Flink-Window-Operator-with-Slicing-td25750.html >> [2] >> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-security-improvements-td21068.html >> [3] >> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Flink-Ker

Re: [DISCUSS] Adding a mid-term roadmap to the Flink website

Very excited and thank you for launching such a great discussion, Stephan ! Here only a little suggestion that in the Batch Streaming Unification section, do we need to add an item: - Same window operators on bounded/unbounded Table API and DataStream API (currently OVER window only exists in SQL

Re: [ANNOUNCE] New Flink PMC member Thomas Weise

Congrats Thomas ! Cheers, Jincheng Fabian Hueske 于2019年2月12日周二 下午5:59写道： > Hi everyone, > > On behalf of the Flink PMC I am happy to announce Thomas Weise as a new > member of the Apache Flink PMC. > > Thomas is a long time contributor and member of our community. > He is starting and participa

Re: [DISCUSS] Towards a leaner flink-dist

Hi Chesnay, Thank you for the proposal. And i like it very much. +1 for the leaner distribution. About improve the "Download" page, I think we can add the connectors download link in the "Optional components" section which @Timo Walther mentioned above. Regards, Jincheng Chesnay Schepler

Re: [ANNOUNCE] Apache Flink 1.5.6 released

Thanks a lot for being our release manager Thomas. Thanks a lot for made this release possible! Cheers, Jincheng Thomas Weise 于2018年12月27日周四 上午4:03写道： > The Apache Flink community is very happy to announce the release of Apache > Flink 1.5.6, which is the final bugfix release for the Apache Fli

Re: [ANNOUNCE] Apache Flink 1.7.1 released

Thanks for being the release manager Chesnay! Thanks a lot for made this release possible! Thanks, Jincheng Chesnay Schepler 于2018年12月23日周日 上午3:34写道： > The Apache Flink community is very happy to announce the release of > Apache Flink 1.7.1, which is the first bugfix release for the Apache > Fl

Re: [ANNOUNCE] Apache Flink 1.6.3 released

Thanks a lot for being our release manager Gordon. Thanks a lot for made this release possible! Cheers, Jincheng Tzu-Li (Gordon) Tai 于2018年12月23日周日 下午9:35写道： > Hi, > > The Apache Flink community is very happy to announce the release of > Apache Flink 1.6.3, which is the third bugfix release for

Re: delay one of the datastream when performing join operation on event-time and watermark

Hi Pakesh Kuma, I think you can using the interval-join, e.g.: orderStream .keyBy() .intervalJoin(invoiceStream.keyBy()) .between(Time.minutes(-5), Time.minutes(5)) The semantics of interval-join and detailed usage description can refer to https://ci.apache.org/projects/flink/flink-do

Re: MergingWindow

Hi aitozi, `MergingWindowSet` is a Utility, used for keeping track of merging Windows when using a MergingWindowAssigner in a WindowOperator. In flink `MergingWindowAssigner` only used for SessionWindow. The implementations of `MergingWindowAssigner` are `EventTimeSessionWindows` and `Process