Re: [DISCUSS] Create "flink-playgrounds" repository

2019-07-11 Thread Fabian Hueske
Hi, I think Quickstart should be as lightweight as possible and follow common practices. A Git repository for a few configuration files might feel like overkill, but IMO it makes sense because this ensures users can get started with 3 commands: $ git clone .../flink-playground $ cd flink-playgrou

[ANNOUNCE] Rong Rong becomes a Flink committer

2019-07-11 Thread Fabian Hueske
Hi everyone, I'm very happy to announce that Rong Rong accepted the offer of the Flink PMC to become a committer of the Flink project. Rong has been contributing to Flink for many years, mainly working on SQL and Yarn security features. He's also frequently helping out on the user@f.a.o mailing l

Re: [DISCUSS] Flink project bylaws

2019-07-22 Thread Fabian Hueske
Hi all, First of all thank you very much Becket for starting this discussion! I think it is a very good idea and overdue to formally define some of our community processes. Similar to Chesnay, I have concerns about the distinction between active and non-active / emeritus committers and PMC member

Re: instable checkpointing after migration to flink 1.8

2019-07-23 Thread Fabian Hueske
Hi Bekir, Another user reported checkpointing issues with Flink 1.8.0 [1]. These seem to be resolved with Flink 1.8.1. Hope this helps, Fabian [1] https://lists.apache.org/thread.html/991fe3b09fd6a052ff52e5f7d9cdd9418545e68b02e23493097d9bc4@%3Cuser.flink.apache.org%3E Am Mi., 17. Juli 2019 um 0

Re: [ANNOUNCE] Kete Young is now part of the Flink PMC

2019-07-23 Thread Fabian Hueske
Congrats Kurt! Cheers, Fabian Am Di., 23. Juli 2019 um 16:42 Uhr schrieb Rong Rong : > Congratulations Kurt!! > > -- > Rong > > On Tue, Jul 23, 2019 at 7:31 AM zhijiang .invalid> > wrote: > > > Congrats Kurt! > > > > Best, > > Zhijiang > > ---

Re: Apply for confluence Wiki create and edit permission

2019-07-24 Thread Fabian Hueske
Hi Xuannan, I've give you permissions to edit and create wiki pages. Please let me know if it does not work for you. Best, Fabian Am Mi., 24. Juli 2019 um 08:20 Uhr schrieb Xuannan Su : > Hi, > > I’d like to make a FLIP of the pluggable intermediate result storage, > phase 2 of FLIP-36[1]. > >

[ANNOUNCE] The Program of Flink Forward EU 2019 is live

2019-07-24 Thread Fabian Hueske
Hi everyone, I'm happy to announce the program of the Flink Forward EU 2019 conference. The conference takes place in the Berlin Congress Center (bcc) from October 7th to 9th. On the first day, we'll have four training sessions [1]: * Apache Flink Developer Training * Apache Flink Operations Trai

Re: Fwd: Kafka Summit listing on ASF events site

2019-07-26 Thread Fabian Hueske
Hi Austin, Thanks for asking to add Flink Forward to the ASF event calendar! I had asked for this a few weeks ago but we had to get brand approval first. We got the approval and I asked again on dev@community.a.o just a few minutes ago. Thanks, Fabian Am Fr., 26. Juli 2019 um 01:21 Uhr schrieb

Re: [DISCUSS] Flink project bylaws

2019-07-29 Thread Fabian Hueske
t; are > > > > worrying about 3 days minimum length is not enough for those who want > > to > > > > give feedback, we can make it 5 days. > > > > > > > > 3) Do we need a process do decide about removal of features (like the > > &

Re: [ANNOUNCE] Hequn becomes a Flink committer

2019-08-07 Thread Fabian Hueske
Congratulations Hequn! Am Mi., 7. Aug. 2019 um 14:50 Uhr schrieb Robert Metzger < rmetz...@apache.org>: > Congratulations! > > On Wed, Aug 7, 2019 at 1:09 PM highfei2...@126.com > wrote: > > > Congrats Hequn! > > > > Best, > > Jeff Yang > > > > > > Original Message > > Subject:

Re: Customize StreamingFileSink: Enable extending StreamingFileSink class

2019-08-07 Thread Fabian Hueske
Hi Kailash, Yes, I think creating another Jira and PR would be the right thing to do. Thank you, Fabian Am Fr., 2. Aug. 2019 um 10:29 Uhr schrieb Kailash Dayanand < kailash...@gmail.com>: > Hello, > > There were a few things which we missing in > https://issues.apache.org/jira/browse/FLINK-1253

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-08 Thread Fabian Hueske
Hi, I worked with Konstantin and reviewed the PR. I think the playground is a great way to get started with Flink and explore it's recovery mechanism and unique features like savepoints. I'm in favor of adding the required streaming example program for the 1.9 release unless there's a good technic

[HowTo] Testing Flink Playground (was: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release)

2019-08-08 Thread Fabian Hueske
ome examples doesn't look like new > feature to me. > BTW, I am also trying this tutorial based on release-1.9 branch, but > blocked by: > > git clone --branch release-1.10-SNAPSHOT > g...@github.com:apache/flink-playgrounds.git > > Neither 1.10 nor 1.9 exists in flink-p

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-08 Thread Fabian Hueske
es doesn't look like new > > feature to me. > > BTW, I am also trying this tutorial based on release-1.9 branch, but > > blocked by: > > > > git clone --branch release-1.10-SNAPSHOT > > g...@github.com:apache/flink-playgrounds.git > > > > Nei

Re: [DISCUSS] Flink project bylaws

2019-08-08 Thread Fabian Hueske
ot need another +1 for their commits. > > > > On Mon, Jul 29, 2019 at 2:11 PM Fabian Hueske wrote: > > > > > Hi Becket, > > > > > > Thanks a lot for pushing this forward and addressing the feedback. > > > I'm very happy with the current sta

[DISCUSS] Flink Docker Playgrounds

2019-08-08 Thread Fabian Hueske
Hi everyone, As you might know, some of us are currently working on Docker-based playgrounds that make it very easy for first-time Flink users to try out and play with Flink [0]. Our current setup (still work in progress with some parts merged to the master branch) looks as follows: * The playgro

Re: [ANNOUNCE] Progress updates for Apache Flink 1.9.0 release

2019-08-08 Thread Fabian Hueske
gt; value for a user who does not want to use the playgrounds. > Moreover, > > >> we > > >> > > already have the StateMachineExample job which can be used to read > > >> from > > >> > > Kafka if a Kafka cluster

Re: [DISCUSS] Flink Docker Playgrounds

2019-08-08 Thread Fabian Hueske
Aug. 2019 um 17:36 Uhr schrieb Fabian Hueske : > Hi everyone, > > As you might know, some of us are currently working on Docker-based > playgrounds that make it very easy for first-time Flink users to try out > and play with Flink [0]. > > Our current setup (still work in pro

Re: [VOTE] Flink Project Bylaws

2019-08-13 Thread Fabian Hueske
+1 for the proposed bylaws. Thanks for pushing this Becket! Cheers, Fabian Am Mo., 12. Aug. 2019 um 16:31 Uhr schrieb Robert Metzger < rmetz...@apache.org>: > I changed the permissions of the page. > > On Mon, Aug 12, 2019 at 4:21 PM Till Rohrmann > wrote: > > > +1 for the proposal. Thanks a lo

Re: Start contribution

2019-08-13 Thread Fabian Hueske
Hi Rishindra, Welcome to the Flink community. Thanks for reporting the bug and volunteering to fix it. Can you briefly discuss in the issue how you plan to fix and test the fix? Thank you, Fabian Am Mo., 12. Aug. 2019 um 23:48 Uhr schrieb Zili Chen : > Hi Rishindra, > > It would be helpful to

Re: [ANNOUNCE] Andrey Zagrebin becomes a Flink committer

2019-08-15 Thread Fabian Hueske
Congrats Andrey! Am Do., 15. Aug. 2019 um 07:58 Uhr schrieb Gary Yao : > Congratulations Andrey, well deserved! > > Best, > Gary > > On Thu, Aug 15, 2019 at 7:50 AM Bowen Li wrote: > > > Congratulations Andrey! > > > > On Wed, Aug 14, 2019 at 10:18 PM Rong Rong wrote: > > > >> Congratulations A

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-27 Thread Fabian Hueske
Hi all, Flink 1.9 Docker images are available at Docker Hub [1] now. Due to some configuration issue, there are only Scala 2.11 issues at the moment but this was fixed [2]. Flink 1.9 Scala 2.12 images should be available soon. Cheers, Fabian [1] https://hub.docker.com/_/flink [2] https://github.

Re: [ANNOUNCE] Apache Flink 1.9.0 released

2019-08-27 Thread Fabian Hueske
D* > The World's Fastest Human Translation Platform. > oy...@motaword.com — www.motaword.com > > > On Tue, Aug 27, 2019 at 8:11 AM Fabian Hueske wrote: > >> Hi all, >> >> Flink 1.9 Docker images are available at Docker Hub [1] now. >> Due to some configur

Re: [DISCUSS] FLIP-55: Introduction of a Table API Java Expression DSL

2019-08-29 Thread Fabian Hueske
Hi, IMO, we should define what we would like to optimize for: 1) easy-to-get-started experience or 2) productivity and ease-of-use While 1) is certainly important, I think we should put more emphasis on goal 2). That's why I favor as short as possible names for commonly used methods like column r

[ANNOUNCE] Flink Forward training registration closes on September 30th

2019-09-05 Thread Fabian Hueske
Hi all, The registration for the Flink Forward Europe training sessions closes in four weeks. The training takes place in Berlin at October 7th and is followed by two days of talks by speakers from companies like Airbus, Goldman Sachs, Netflix, Pinterest, and Workday [1]. The following four train

Re: Please add me as contributor

2019-09-05 Thread Fabian Hueske
Hi Jan, I assigned FLINK-13925 to you. Thanks for your contribution! Best, Fabian Am Di., 3. Sept. 2019 um 10:52 Uhr schrieb Jan Lukavský : > Hi Dawid, > > thanks for the explanation. I got warning from PR [1] associated with > JIRA [2]. > > Jan > > [1] https://github.com/apache/flink/pull/9579

Re: Fine grained batch recovery vs. native libraries

2019-09-05 Thread Fabian Hueske
Thanks for reporting the problem David! Cheers, Fabian Am Mi., 4. Sept. 2019 um 14:09 Uhr schrieb David Morávek : > Hi Chesnay, I've created FLINK-13958 > to track the issue. > > Thanks, > D. > > On Wed, Sep 4, 2019 at 1:56 PM Chesnay Schepler

[ANNOUNCE] Kostas Kloudas joins the Flink PMC

2019-09-06 Thread Fabian Hueske
Hi everyone, I'm very happy to announce that Kostas Kloudas is joining the Flink PMC. Kostas is contributing to Flink for many years and puts lots of effort in helping our users and growing the Flink community. Please join me in congratulating Kostas! Cheers, Fabian

Re: [ANNOUNCE] Zili Chen becomes a Flink committer

2019-09-11 Thread Fabian Hueske
Congrats Zili Chen :-) Cheers, Fabian Am Mi., 11. Sept. 2019 um 12:48 Uhr schrieb Biao Liu : > Congrats Zili! > > Thanks, > Biao /'bɪ.aʊ/ > > > > On Wed, 11 Sep 2019 at 18:43, Oytun Tez wrote: > >> Congratulations! >> >> --- >> Oytun Tez >> >> *M O T A W O R D* >> The World's Fastest Human Tran

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

2019-09-11 Thread Fabian Hueske
Hi all, I'd like to add my opinion on this topic as well ;-) In general, I think overriding built-in function with temp functions has a couple of benefits but also a few challenges: * Users can reimplement the behavior of a built-in functions of a different system, e.g., for backward compatibili

Re: Uncertain result when using group by in stream sql

2019-09-13 Thread Fabian Hueske
Hi, A GROUP BY query on a streaming table requires that the result is continuously updated. Updates are propagated as a retraction stream (see tEnv.toRetractStream(table, Row.class).print(); in your code). A retraction stream encodes the type of the update as a boolean flag, the "true" and "false

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

2019-09-13 Thread Fabian Hueske
objects(tables, views). If not given explicitly the > > current catalog & database would be used, both in the create statement or > > when using the function. > > > > Point taken though your preference would be to support overriding > built-in > > functions. >

Re: Is Idle state retention time in SQL client possible?

2019-09-17 Thread Fabian Hueske
Hi, This can be set via the environment file. Please have a look at the documentation [1] (see "execution: min-idle-state-retention: " and "execution: max-idle-retention: " keys). Fabian [1] https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/table/sqlClient.html#environment-files A

Re: Is Idle state retention time in SQL client possible?

2019-09-17 Thread Fabian Hueske
I'm not sure what you are asking for. "execution: min/max-idle-state-retention" are the entries in the configuration file for the SQL CLI client to configure "idle state retention time" as described in the link that you posted. Btw. user question should be directed to the u...@flink.apache.org mai

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

2019-09-19 Thread Fabian Hueske
+1 to what Stephan (and Thomas) said. Am Do., 19. Sept. 2019 um 09:54 Uhr schrieb Stephan Ewen : > Some quick thoughts on the connector contribution process. I basically > reiterate here what Thomas mentioned in another thread about the Kinesis > connector. > > For connectors, we should favor a l

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

2019-09-19 Thread Fabian Hueske
ry, my bad, I've enabled comments for the doc. > Does it work for now? > > On Thu, Sep 19, 2019 at 4:07 PM Fabian Hueske wrote: > > > > +1 to what Stephan (and Thomas) said. > > > > Am Do., 19. Sept. 2019 um 09:54 Uhr schrieb Stephan Ewen < > se...@apache

Re: [ANNOUNCE] Apache Flink 1.10.0 released

2020-02-12 Thread Fabian Hueske
Congrats team and a big thank you to the release managers! Am Mi., 12. Feb. 2020 um 16:33 Uhr schrieb Timo Walther : > Congratualations everyone! Great stuff :-) > > Regards, > Timo > > > On 12.02.20 16:05, Leonard Xu wrote: > > Great news! > > Thanks everyone involved ! > > Thanks Gary and Yu fo

[ANNOUNCE] Flink Forward San Francisco 2020 Program is Live

2020-02-14 Thread Fabian Hueske
Hi everyone, We announced the program of Flink Forward San Francisco 2020. The conference takes place at the Hyatt Regency in San Francisco from March 23rd to 25th. On the first day we offer four training sessions [1]: * Apache Flink Developer Training * Apache Flink Runtime & Operations Training

Re: [ANNOUNCE] Flink Forward San Francisco 2020 Program is Live

2020-02-14 Thread Fabian Hueske
Fr., 14. Feb. 2020 um 17:48 Uhr schrieb Fabian Hueske : > Hi everyone, > > We announced the program of Flink Forward San Francisco 2020. > The conference takes place at the Hyatt Regency in San Francisco from > March 23rd to 25th. > > On the first day we offer four

Re: [ANNOUNCE] Jingsong Lee becomes a Flink committer

2020-02-21 Thread Fabian Hueske
Congrats Jingsong! Cheers, Fabian Am Fr., 21. Feb. 2020 um 17:49 Uhr schrieb Rong Rong : > Congratulations Jingsong!! > > Cheers, > Rong > > On Fri, Feb 21, 2020 at 8:45 AM Bowen Li wrote: > > > Congrats, Jingsong! > > > > On Fri, Feb 21, 2020 at 7:28 AM Till Rohrmann > > wrote: > > > >> Congr

Re: [DISCUSS]FLIP-113: Support SQL and planner hints

2020-03-10 Thread Fabian Hueske
Hi, RE error handling: I don't think it is a good idea to simply log invalid hints. This makes it very hard for systems that integrate Flink to consume these errors. I'm not saying we should throw an exception. We could also execute a query with invalid hints but should have a mechanism to provide

Re: [ANNOUNCE] New Committers and PMC member

2020-04-01 Thread Fabian Hueske
Congrats everyone! Cheers, Fabian Am Mi., 1. Apr. 2020 um 18:26 Uhr schrieb Yun Tang : > Congratulations to all of you! > > Best > Yun Tang > > From: Yang Wang > Sent: Wednesday, April 1, 2020 22:28 > To: dev > Subject: Re: [ANNOUNCE] New Committers and PMC mem

Re: [ANNOUNCE] New Flink committer: Seth Wiesman

2020-04-07 Thread Fabian Hueske
Congrats Seth! Well deserved :-) Cheers, Fabian Am Di., 7. Apr. 2020 um 10:09 Uhr schrieb Yangze Guo : > Congratulations Seth! > > Best, > Yangze Guo > > On Tue, Apr 7, 2020 at 4:07 PM Jiayi Liao wrote: > > > > > > > > Congratulations Seth :) > > > > > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Hequn Chen

2020-04-17 Thread Fabian Hueske
Congrats Hequn! Am Fr., 17. Apr. 2020 um 14:29 Uhr schrieb hufeih...@mails.ucas.ac.cn < hufeih...@mails.ucas.ac.cn>: > Congratulations , Hequn > > Best wish > > > hufeih...@mails.ucas.ac.cn > Congratulations, Hequn! > > Paul Lam 于2020年4月17日周五 下午3:02写道: > > > Congrats Hequn! Thanks a lot for your

Re: [DISCUSS] [FLINK-16824] Creating Temporal Table Function via DDL

2020-04-17 Thread Fabian Hueske
Hi all, First of all, I appologize for the text wall that's following... ;-) A temporal table join joins an append-only table and a temporal table. The question about how to represent a temporal table join boils down to two questions: 1) How to represent a temporal table 2) How to specify the jo

Re: [DISCUSS] [FLINK-16824] Creating Temporal Table Function via DDL

2020-04-17 Thread Fabian Hueske
TEMPORAL` keyword, a `FOR SYSTEM_TIME AS OF x` would only > > work on processing time by a lookup into the external system or on > > event-time by using the time semantics that the external system supports. > > > > Regarding retraction table with a primary key and a time-attri

Re: [DISCUSS] [FLINK-16824] Creating Temporal Table Function via DDL

2020-04-17 Thread Fabian Hueske
C formats. TEMPORAL VIEW is flexible but will involve > more SQL codes. I think > we can support them both. > > Best, > Jark > > [1]: > > https://docs.google.com/document/d/1onyIUUdWAHfr_Yd5nZOE7SOExBc6TiW5C4LiL5FrjtQ/edit#heading=h.sz656g8mb2wb > > On Fri, 17 Apr 2020

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

2019-09-19 Thread Fabian Hueske
Hi everyone, I thought again about option #1 and something that I don't like is that the resolved address of xyz is different in "CREATE FUNCTION xyz" and "CREATE TEMPORARY FUNCTION xyz". IMO, adding the keyword "TEMPORARY" should only change the lifecycle of the function, but not where it is loca

Re: [DISCUSS] Contribute Pulsar Flink connector back to Flink

2019-09-19 Thread Fabian Hueske
create pages in FLIP. > > > > > > > > > > > > > Thanks for sharing the pulsar FLIP. > > > > > > > Would you mind enabling comments/suggestions on the google doc > > > link? > > > > > > Sorry, my bad, I've enabled commen

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

2019-09-19 Thread Fabian Hueske
't get much more explicit than the above command. Sorry for bringing up a new option in the middle of the discussion, but as I said, I think it has a bunch of benefits and I don't see major drawbacks (maybe you do?). What do you think? Fabian Am Do., 19. Sept. 2019 um 11:24 Uhr schrieb Fa

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

2019-09-19 Thread Fabian Hueske
lt-in functions. Fabian Am Do., 19. Sept. 2019 um 11:52 Uhr schrieb Kurt Young : > Hi Fabian, > > I think it's almost the same with #2 with different keyword: > > CREATE TEMPORARY BUILTIN FUNCTION xxx > > Best, > Kurt > > > On Thu, Sep 19, 2019 at 5:50 PM Fabian

Re: Confluence permission for FLIP creation

2019-09-19 Thread Fabian Hueske
Hi Terry, I gave you permissions. Thanks, Fabian Am Do., 19. Sept. 2019 um 04:09 Uhr schrieb Terry Wang : > Hi all, > > As communicated in an email thread, I'm proposing Flink SQL ddl > enhancement. I have a draft design doc that I'd like to convert it to a > FLIP. Thus, it would be great if an

Re: Add Bucket File System Table Sink

2019-09-20 Thread Fabian Hueske
Hi Jun, Thank you very much for your contribution. I think a Bucketing File System Table Sink would be a great addition. Our code contribution guidelines [1] recommend to discuss the design with the community before opening a PR. First of all, this ensures that the design is aligned with Flink's

Re: [DISCUSS] FLIP-66: Support time attribute in SQL DDL

2019-09-20 Thread Fabian Hueske
Hi Jark, Thanks for the summary! I like the proposal! It makes it very clear that an event time attribute is an existing column on which watermark metadata is defined whereas a processing time attribute is a computed field. I have one comment regarding the section on "Complex Watermark Strategie

Re: Confluence permission for FLIP creation

2019-09-23 Thread Fabian Hueske
Hi Forward, I gave you the permissions. Best, Fabian Am So., 22. Sept. 2019 um 13:03 Uhr schrieb Forward Xu < forwardxu...@gmail.com>: > Hi devs, > > I'd like to create a page about the Support SQL 2016-2017 JSON functions in > Flink SQL > < > https://docs.google.com/document/d/1JfaFYIFOAY8P2pF

Re: [DISCUSS] FLIP-57 - Rework FunctionCatalog

2019-09-23 Thread Fabian Hueske
Dawid -1/0 depending on keyword > > > > >> #3:2(+1), 3(-1), 3(0) - net: -1 > > > > >> > > > > >> Given the result, I'd like to change my vote for #2 from 0 to +1, > to > > > > make > > > > >> it a stronger

Re: [COMMITTER] repo locked due to synchronization issues

2019-09-24 Thread Fabian Hueske
Maybe it's a mix of pushing to the ASF repository and Github mirrors? I'm only pushing to the ASF repositories (although not that frequently anymore...). Cheers, Fabian Am Di., 24. Sept. 2019 um 10:50 Uhr schrieb Till Rohrmann < trohrm...@apache.org>: > Pushing directly to Github also works for

Re: Confluence permission for FLIP creation

2019-09-25 Thread Fabian Hueske
Hi, I gave you the permissions for the wiki. Thanks, Fabian Am Mi., 25. Sept. 2019 um 05:04 Uhr schrieb Yadong Xie : > Hi all > > I'm proposing to improve the Flink user experience in the Web UI and I have > created a draft proposal doc. > > Could anyone grant the permission to convert the doc

Re: [VOTE] FLIP-57: Rework FunctionCatalog

2019-09-30 Thread Fabian Hueske
Hi all, Sorry for the late reply. I think it might lead to confusing situations if temporary functions (or any temporary db objects for that matter) are bound to the life cycle of an (external) db/catalog. Imaging a situation where you create a temp function in a db in an external catalog and use

Re: [VOTE] FLIP-57: Rework FunctionCatalog

2019-10-01 Thread Fabian Hueske
nction has always highest > >> precedence and should be stable within the local session. Otherwise it > >> could magically disappear while someone else is performing modifications > >> in the catalog. > >> > >> Furthermore, this feature is very useful fo

Re: [VOTE] Accept Stateful Functions into Apache Flink

2019-10-21 Thread Fabian Hueske
+1 (binding) Am Mo., 21. Okt. 2019 um 16:18 Uhr schrieb Thomas Weise : > +1 (binding) > > > On Mon, Oct 21, 2019 at 7:10 AM Timo Walther wrote: > > > +1 (binding) > > > > Thanks, > > Timo > > > > > > On 21.10.19 15:59, Till Rohrmann wrote: > > > +1 (binding) > > > > > > Cheers, > > > Till > > >

[ANNOUNCE] Becket Qin joins the Flink PMC

2019-10-28 Thread Fabian Hueske
Hi everyone, I'm happy to announce that Becket Qin has joined the Flink PMC. Let's congratulate and welcome Becket as a new member of the Flink PMC! Cheers, Fabian

Re: [DISCUSS] Move flink-orc to flink-formats from flink-connectors

2019-10-30 Thread Fabian Hueske
+1 from my side as well. Am Mi., 30. Okt. 2019 um 04:51 Uhr schrieb Jingsong Li < jingsongl...@gmail.com>: > Thanks jark for reminding me. > I will start a vote thread. > > On Wed, Oct 30, 2019 at 11:40 AM Jark Wu wrote: > > > Hi Jingsong, > > > > Do we need a formal vote? Or do we need to wait

Flink Forward North America 2020 - Call for Presentations open until January 12th, 2020

2019-11-20 Thread Fabian Hueske
Hi all, Flink Forward North America returns to San Francisco on March 23-25, 2020. For the first time in North America, the conference will feature two days of talks and one day of training. We are happy to announce that the Call for Presentations is open! If you'd like to give a talk and share

Re: [ANNOUNCE] Zhu Zhu becomes a Flink committer

2019-12-13 Thread Fabian Hueske
Congrats Zhu Zhu and welcome on board! Best, Fabian Am Fr., 13. Dez. 2019 um 17:51 Uhr schrieb Till Rohrmann < trohrm...@apache.org>: > Hi everyone, > > I'm very happy to announce that Zhu Zhu accepted the offer of the Flink PMC > to become a committer of the Flink project. > > Zhu Zhu has been

[ANNOUNCE] Flink Forward SF Call for Presentation closing soon!

2020-01-06 Thread Fabian Hueske
Hi all, First of all, Happy New Year to everyone! Many of you probably didn't spent the holidays thinking a lot about Flink. Now, however, is the right time to focus again and decide which talk(s) to submit for Flink Forward San Francisco because the Call for Presentations is closing this Sunday,

Re: What is the suggested way to validate SQL?

2020-01-09 Thread Fabian Hueske
Hi all, Yes, I agree. It would be good to have dedicated methods to check the validity of SQL queries. I would propose to have two validation methods: 1. syntactic and semantic validation of a SQL query, i.e., SQL keywords, catalog information, types in expressions and functions, etc. This is a l

[ANNOUNCE] Flink Forward San Francisco 2020 Call for Presentation extended!

2020-01-13 Thread Fabian Hueske
Hi everyone, We know some of you only came back from holidays last week. To give you more time to submit a talk, we decided to extend the Call for Presentations for Flink Forward San Francisco 2020 until Sunday January 19th. The conference takes place on March 23-25 with two days of talks and one

Re: [DISCUSS] Integrate Flink Docker image publication into Flink release process

2020-01-22 Thread Fabian Hueske
Hi everyone, First of all, thank you very much Patrick for maintaining and publishing the Flink Docker images so far and for starting this discussion! I'm in favor of adding the Dockerfiles in a separate repository and not in the main Flink repository. I also think that it makes sense to first fo

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-23 Thread Fabian Hueske
Congrats Yu! Good to have you on board! Cheers, Fabian Am Do., 23. Jan. 2020 um 11:13 Uhr schrieb Piotr Nowojski < pi...@ververica.com>: > Congratulations! :) > > > On 23 Jan 2020, at 10:48, Tzu-Li (Gordon) Tai > wrote: > > > > Congratulations :) > > > > On Thu, Jan 23, 2020, 5:07 PM Yadong Xie

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-28 Thread Fabian Hueske
+1 Am Di., 28. Jan. 2020 um 15:23 Uhr schrieb Yun Tang : > +1 (non-binding) > > From: Stephan Ewen > Sent: Tuesday, January 28, 2020 21:36 > To: dev ; patr...@ververica.com < > patr...@ververica.com> > Subject: Re: [VOTE] Integrate Flink Docker image publication

[ANNOUNCE] Community Discounts for Flink Forward SF 2020 Registrations

2020-01-30 Thread Fabian Hueske
Hi everyone, The registration for Flink Forward SF 2020 is open now! Flink Forward San Francisco 2020 will take place from March 23rd to 25th. The conference will start with one day of training and continue with two days of keynotes and talks. We would like to invite you to join the Apache Flink

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Fabian Hueske
for us Patrick! Just kidding :), it was > > mostly > > > > > done by Patrick, all kudos to him. > > > > > Just one question, we will be able to still be featured as an > > official > > > > > docker image in this case? > > >

Re: request for contributor permission

2018-04-26 Thread Fabian Hueske
Hi Steven, done. Looking forward to your contributions. @Michael: JIRA contributor permissions allow people to assign JIRA issues to themselves. This is not the same as becoming a committer, for which one has to earn the merit first. Best, Fabian 2018-04-26 23:04 GMT+02:00 Suneel Marthi : > No

Re: How to start guide for developers

2018-04-27 Thread Fabian Hueske
Hi Tarush, Please have a look at the contribution guide [1]. Best, Fabian [1] http://flink.apache.org/how-to-contribute.html 2018-04-27 14:39 GMT+02:00 tarush grover : > Hi Devs, > > Where I can find guidelines for flink setup. > > I have followed how to contribute doc, do we have best practic

Re: request for contributor permission

2018-05-02 Thread Fabian Hueske
or the clarification. Sorry for the mis-information. > > > > Michael > > > > > On Apr 26, 2018, at 3:20 PM, Fabian Hueske wrote: > > > > > > Hi Steven, > > > > > > done. Looking forward to your contributions. > > > > > >

Re: Introduction

2018-05-02 Thread Fabian Hueske
Welcome to the Flink community Tarush! It's great that you'd like to contribute :-) The Flink community does not operate a slack channel. All relevant development communication is happening on the dev@flink.apache.org mailing list to which you posted with your mail. I've given you Contributor per

Re: [Discuss] Proposing FLIP-25 - Support User State TTL Natively in Flink

2018-05-02 Thread Fabian Hueske
roposals. Can you grant me the proper access? > > Thanks, > > Bowen > > > > > On Tue, Apr 24, 2018 at 2:40 AM, Fabian Hueske wrote: > >> Hi Bowen, >> >> Thanks for updating the proposal. This looks pretty good (as I said >> before). >> Th

Re: Flink consuming more memory than expected

2018-05-04 Thread Fabian Hueske
Hi, There are a few JIRA tickets that address this problem [1] [2]. Summary: The best execution strategy depends on the amount of data / window configuration. Best, Fabian [1] https://issues.apache.org/jira/browse/FLINK-7001 [2] https://issues.apache.org/jira/browse/FLINK-5387 2018-05-04 7:22

Re: Confusing error message in MemCheckpointStreamFactory with large state size?

2018-05-07 Thread Fabian Hueske
Hi Ken and Rong, That's a good point. The FSStateBackend holds all state in the JVM heap as well. The name is also not well chosen, IMO. Thanks for creating the JIRA ticket! Fabian 2018-05-05 0:52 GMT+02:00 Ken Krugler : > > > On May 3, 2018, at 9:06 PM, Rong Rong wrote: > > > > Agree it is d

[ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

2018-05-08 Thread Fabian Hueske
Hi everyone, I'm happy to announce that two members of the Flink community accepted the offer of the PMC to become committers. * Xingcan Cui has been contributing to Flink for about a year, focusing on Flink's relational APIs (SQL & Table API). In the past year, Xingcan has started design discuss

Re: [HA] Is it possible to remove external dependency caused by high-availability.zookeeper.storageDir

2018-05-08 Thread Fabian Hueske
Hi Hao, You do not necessarily need HDFS but some kind of distribute filesystem that can be accessed from all nodes is required. Flink doesn't need the FS just for job meta data, but also to store checkpoints of the application state for fault tolerance. Best, Fabian 2018-05-08 4:31 GMT+02:00 Ha

Re: [DISCUSS] Configuration for local recovery

2018-05-14 Thread Fabian Hueske
+1 for Stephan's proposal. 2018-05-14 8:22 GMT+02:00 Shuyi Chen : > +1 to the proposal. IMO, the current option "ENABLE_FILE_BASED" contains > too much implementation details and might confuse the simple users. Having > a simple on/off toggle for majority of the users and an advanced option for >

Re: [Discuss] Proposing FLIP-25 - Support User State TTL Natively in Flink

2018-05-14 Thread Fabian Hueske
o option 1, is that it doesn't impact > existing timer-related checkpoint/savepoint, restore and migrations. > > What do you think? And, any other Flink committers want to chime in for > ideas? I've also documented the above two discussion points to the FLIP > page. >

Re: Support more intelligent function lookup in FunctionCatalog for UDF

2018-05-14 Thread Fabian Hueske
Hi Rong, I didn't look into the details of the example that you provided, but I think if we can improve the internal type resolution of scalar UDFs we should definitely go for it. There is quite a bit of information available such as the signatures of the eval() methods but also the argument types

Re: Snapshots and RC-candidate maven artifacts

2018-05-14 Thread Fabian Hueske
Hi, I'd assume that we stopped updating 1.5-SNAPSHOT jars when we forked off the release-1.5 branch and updated the version on master to 1.6-SNAPSHOT. Best, Fabian 2018-05-14 15:51 GMT+02:00 Flavio Pompermaier : > Hi to all. > we were trying to run a 1.5 Flink job and we set the version to > 1.

Re: Closing (automatically?) inactive pull requests

2018-05-15 Thread Fabian Hueske
I'm with Chesnay on this issue. Stale PRs, i.e., a PR where a contributor becomes inactive, are one of our smallest issues, IMO. There are more reasons for the high number of PRs. * Lack of timely reviews. * Not eagerly closing PRs that have no or very little chance of being merged. Common reasons

Re: [DISCUSS] Adding new interfaces in [Stream]ExecutionEnvironment

2018-05-16 Thread Fabian Hueske
Hi, I'm not sure if we need to modify the existing method. What we need is a bit different from what registerCachedFile() provides. The method ensures that a file is copied to each TaskManager and can be locally accessed from a function's RuntimeContext. In our case, we don't need to access the fi

Re: [Discuss] Proposing FLIP-25 - Support User State TTL Natively in Flink

2018-05-16 Thread Fabian Hueske
keyed state) > > What do you think? > > Best, > Sihua > > On 05/14/2018 15:20,Fabian Hueske > wrote: > > Hi Sihua, > > I think it makes sense to couple state TTL to the timer service. We'll > need some kind of timers to expire state, so I think we should

Re: Closing (automatically?) inactive pull requests

2018-05-16 Thread Fabian Hueske
>>> time > >>>>> on context switching for me and for everyone else that will have to > >>> scroll > >>>>> pass or look on those PR to check their status. > >>>>> > >>>>> Keep in mind that I am not

Re: [DISCUSS] Adding new interfaces in [Stream]ExecutionEnvironment

2018-05-16 Thread Fabian Hueske
gt; On Wed, May 16, 2018 at 1:29 AM, Fabian Hueske wrote: > > > Hi, > > > > I'm not sure if we need to modify the existing method. > > What we need is a bit different from what registerCachedFile() provides. > > The method ensures that a file is copied to each

Re: [DISCUSS] GitBox

2018-05-16 Thread Fabian Hueske
+1 Kenneth Knowles schrieb am Mi., 16. Mai 2018, 21:04: > When I open a pull request to Beam, it is on by default. I have just run an > experiment to see if it is remembering the last option I checked and it is > not. Even after I disable it for one pull request, the next one has it > checked ag

[NOTE] Tracking release notes in the documentation

2018-05-18 Thread Fabian Hueske
Hi everyone, I've collected the release notes for 1.5 (hopefully I didn't miss anything important) and added a page in the documentation [1]. The page is linked from the documentation start page. The page will also be linked from the release announcement and the downloads page. I also added a pag

Flink Forward Berlin 2018 - Call for Presentations open until 4th June

2018-05-18 Thread Fabian Hueske
Hi all, Flink Forward returns to Berlin on September 3-5, 2018. We are happy to announce the Call for Presentations is now open! Please submit a proposal if you'd like to present your Apache Flink experience, best practices or use case in front of an international audience of highly skilled and e

Re: [VOTE] Release 1.5.0, release candidate #4

2018-05-18 Thread Fabian Hueske
FLINK-9091 is hard to reproduce and only affects the build but no functionality of Flink or its correctness. IMO, we should not block the release it. Since it's hard to reproduce, we cannot be sure that Timo's fix actually solves the problem. We can merge the fix to the master and see if the probl

Re: [VOTE] Enable GitBox integration (#2)

2018-05-23 Thread Fabian Hueske
+1 2018-05-23 8:49 GMT+02:00 Aljoscha Krettek : > +1 > > > On 22. May 2018, at 15:36, Thomas Weise wrote: > > > > +1 > > > > > > On Tue, May 22, 2018 at 2:37 AM, Timo Walther > wrote: > > > >> +1 > >> > >> Am 22.05.18 um 10:49 schrieb Ted Yu: > >> > >> +1 > >>> Original message ---

Re: [PROPOSAL] Introduce Elastic Bloom Filter For Flink

2018-05-23 Thread Fabian Hueske
Thanks for the proposal Sihua! Let me try to summarize the motivation / scope of this proposal. You are proposing to add support for a special Bloom Filter state per KeyGroup and reduce the number of key accesses by checking the Bloom Filter first. This is would be a rather generic feature that

Re: [VOTE] Release 1.5.0, release candidate #5

2018-05-23 Thread Fabian Hueske
+1 (binding) - checked hashes and signatures - checked source archive and didn't find unexpected binary files - built from source archive skipping the tests (mvn -DskipTests clean install), started a local cluster, and ran an example program. Thanks, Fabian 2018-05-23 15:39 GMT+02:00 Till Rohr

Re: [ANNOUNCE] Apache Flink 1.5.0 release

2018-05-28 Thread Fabian Hueske
Thank you Till for serving as a release manager for Flink 1.5! 2018-05-25 19:46 GMT+02:00 Till Rohrmann : > Quick update: I had to update the date of the release blog post which also > changed the URL. It can now be found here: > > http://flink.apache.org/news/2018/05/25/release-1.5.0.html > > Ch

[ANNOUNCE] Final Reminder - Call for Presentations - Flink Forward Berlin 2018

2018-05-28 Thread Fabian Hueske
Hi all, This is the final reminder for the call for presentations for Flink Forward Berlin 2018. *The call closes in 7 days* (June 4, 11:59 PM CEST). Submit your talk and get to present your Apache Flink and stream processing ideas, experiences, use cases, and best practices on September 4-5 in

  1   2   3   4   5   6   7   8   9   10   >