[ANNOUNCE] Apache Flink 1.11.1 released

2020-07-21 Thread Dian Fu
The Apache Flink community is very happy to announce the release of Apache Flink 1.11.1, which is the first bugfix release for the Apache Flink 1.11 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streamin

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-21 Thread Forward Xu
Congratulations! Best, Forward godfrey he 于2020年7月22日周三 上午10:45写道: > Congratulations! > > Best, > Godfrey > > Till Rohrmann 于2020年7月21日周二 下午10:46写道: > > > Congrats, Piotr! > > > > Cheers, > > Till > > > > On Thu, Jul 9, 2020 at 4:15 AM Xingcan Cui wrote: > > > > > Congratulations, Piotr! >

[jira] [Created] (FLINK-18668) BytesHashMap#growAndRehash should release newly allocated segments before throwing the exception

2020-07-21 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-18668: --- Summary: BytesHashMap#growAndRehash should release newly allocated segments before throwing the exception Key: FLINK-18668 URL: https://issues.apache.org/jira/browse/FLINK-18668

Re: thrift support

2020-07-21 Thread Chen Qin
Thanks, Yu sharing more background on this. Jark, We were able to sync with Yu a bit offline. I think we should reuse Jira and the future on how to reuse code when we get into the implementation phase. and continue the discussion maybe share a google doc detail list of work and options so folks c

Re: [DISCUSS] FLIP-36 - Support Interactive Programming in Flink Table API

2020-07-21 Thread Xuannan Su
Hi Kurt, Thanks for the comments. 1. How do you identify the CachedTable? For the current design proposed in FLIP-36, we are using the first approach you mentioned, where the key of the map is the Cached Table java object. I think it is fine not to be able to identify another table representing

Re: [REMINDER] Use 'starter' labels for Jira issues where it makes sense

2020-07-21 Thread Till Rohrmann
Thanks for the reminder Andrey. This is important for helping new contributors to find their way around in the Flink project. Cheers, Till On Mon, Jul 20, 2020 at 5:30 PM Aljoscha Krettek wrote: > Yes, thanks Andrey! That's a good reminder for everyone. :-) > > On 20.07.20 16:02, Andrey Zagrebi

[jira] [Created] (FLINK-18667) Data Types documentation misunderstand users

2020-07-21 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-18667: Summary: Data Types documentation misunderstand users Key: FLINK-18667 URL: https://issues.apache.org/jira/browse/FLINK-18667 Project: Flink Issue Type: New

Re: Flink Redis connectivity

2020-07-21 Thread Yun Tang
Hi Ramya Have you ever tried flink-connector-redis in bahir [1][2]? I think you could use it or obtain some insights. [1] http://bahir.apache.org/docs/flink/current/flink-streaming-redis/ [2] https://github.com/apache/bahi

[jira] [Created] (FLINK-18666) Update japicmp configuration for 1.11.1

2020-07-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-18666: --- Summary: Update japicmp configuration for 1.11.1 Key: FLINK-18666 URL: https://issues.apache.org/jira/browse/FLINK-18666 Project: Flink Issue Type: Task Comp

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-21 Thread godfrey he
Congratulations! Best, Godfrey Till Rohrmann 于2020年7月21日周二 下午10:46写道: > Congrats, Piotr! > > Cheers, > Till > > On Thu, Jul 9, 2020 at 4:15 AM Xingcan Cui wrote: > > > Congratulations, Piotr! > > > > Best, Xingcan > > > > On Wed, Jul 8, 2020, 21:53 Yang Wang wrote: > > > > > Congratulations P

Re: thrift support

2020-07-21 Thread Yu Yang
Thanks for the discussion. In https://github.com/apache/flink/pull/8067 we made an initial version on adding thrift-format support in flink, and haven't got time to finish it. Feel free to take it over and make changes. I've also linked this discussion thread in https://issues.apache.org/jira/brows

[jira] [Created] (FLINK-18665) Filesystem connector should use TableSchema exclude computed columns

2020-07-21 Thread Jark Wu (Jira)
Jark Wu created FLINK-18665: --- Summary: Filesystem connector should use TableSchema exclude computed columns Key: FLINK-18665 URL: https://issues.apache.org/jira/browse/FLINK-18665 Project: Flink I

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

2020-07-21 Thread Till Rohrmann
Congrats, Piotr! Cheers, Till On Thu, Jul 9, 2020 at 4:15 AM Xingcan Cui wrote: > Congratulations, Piotr! > > Best, Xingcan > > On Wed, Jul 8, 2020, 21:53 Yang Wang wrote: > > > Congratulations Piotr! > > > > > > Best, > > Yang > > > > Dan Zou 于2020年7月8日周三 下午10:36写道: > > > > > Congratulations

Re: [ANNOUNCE] Apache Flink 1.11.0 released

2020-07-21 Thread Till Rohrmann
Thanks a lot for being our release managers Zhijiang and Piotr and thanks to everyone who helped making this release possible. Cheers, Till On Wed, Jul 8, 2020 at 10:59 AM godfrey he wrote: > Congratulations! > > Thanks Zhijiang and Piotr for the great work, and thanks everyone for > their cont

[jira] [Created] (FLINK-18664) Publish Dockerfiles for release 1.11.1

2020-07-21 Thread Dian Fu (Jira)
Dian Fu created FLINK-18664: --- Summary: Publish Dockerfiles for release 1.11.1 Key: FLINK-18664 URL: https://issues.apache.org/jira/browse/FLINK-18664 Project: Flink Issue Type: Task Compo

[jira] [Created] (FLINK-18663) Fix Flink On YARN AM not exit

2020-07-21 Thread tartarus (Jira)
tartarus created FLINK-18663: Summary: Fix Flink On YARN AM not exit Key: FLINK-18663 URL: https://issues.apache.org/jira/browse/FLINK-18663 Project: Flink Issue Type: Bug Components: R

Re: Flink Redis connectivity

2020-07-21 Thread Yangze Guo
Hi, I think you could implement `RichMapFunction` and create `redisClient` in the `open` method. Best, Yangze Guo On Tue, Jul 21, 2020 at 6:43 PM Ramya Ramamurthy wrote: > > Hi, > > As per the understanding we have from the documentation, I guess its not > possible to take the redis connection

Flink Redis connectivity

2020-07-21 Thread Ramya Ramamurthy
Hi, As per the understanding we have from the documentation, I guess its not possible to take the redis connection within the Data Stream. In that case, how should i proceed ? How can i access a DB client object within the stream ?? I am using Flink 1.7. any help here would be appreciated. Thanks

[jira] [Created] (FLINK-18662) Provide more detailed metrics why unaligned checkpoint is taking long time

2020-07-21 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-18662: -- Summary: Provide more detailed metrics why unaligned checkpoint is taking long time Key: FLINK-18662 URL: https://issues.apache.org/jira/browse/FLINK-18662 Projec

[jira] [Created] (FLINK-18661) [Kinesis][EFO] Stream consumer Registration/Deregistration

2020-07-21 Thread Danny Cranmer (Jira)
Danny Cranmer created FLINK-18661: - Summary: [Kinesis][EFO] Stream consumer Registration/Deregistration Key: FLINK-18661 URL: https://issues.apache.org/jira/browse/FLINK-18661 Project: Flink

[jira] [Created] (FLINK-18660) Bump netty to 4.1.51

2020-07-21 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-18660: Summary: Bump netty to 4.1.51 Key: FLINK-18660 URL: https://issues.apache.org/jira/browse/FLINK-18660 Project: Flink Issue Type: Sub-task C

[jira] [Created] (FLINK-18659) FileNotFoundException when writing Hive orc tables

2020-07-21 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-18659: Summary: FileNotFoundException when writing Hive orc tables Key: FLINK-18659 URL: https://issues.apache.org/jira/browse/FLINK-18659 Project: Flink Issue Type

[jira] [Created] (FLINK-18658) MiniClusterResource does not forward RpcServiceSharing setting

2020-07-21 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-18658: Summary: MiniClusterResource does not forward RpcServiceSharing setting Key: FLINK-18658 URL: https://issues.apache.org/jira/browse/FLINK-18658 Project: Flink

[jira] [Created] (FLINK-18657) Change semantics of DESCRIBE SELECT statement

2020-07-21 Thread Fabian Hueske (Jira)
Fabian Hueske created FLINK-18657: - Summary: Change semantics of DESCRIBE SELECT statement Key: FLINK-18657 URL: https://issues.apache.org/jira/browse/FLINK-18657 Project: Flink Issue Type: I

Re: thrift support

2020-07-21 Thread Jark Wu
Thanks Dawid for the link. I have a glance at the PR. I think we can continue the thrift format based on the PR (would be better to reach out to the author). Best, Jark On Tue, 21 Jul 2020 at 15:58, Dawid Wysakowicz wrote: > Hi, > > I've just spotted this PR that might be helpful in the discus

[jira] [Created] (FLINK-18656) Start Delay metric is always zero for unaligned checkpoints

2020-07-21 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-18656: -- Summary: Start Delay metric is always zero for unaligned checkpoints Key: FLINK-18656 URL: https://issues.apache.org/jira/browse/FLINK-18656 Project: Flink

Re: thrift support

2020-07-21 Thread Dawid Wysakowicz
Hi, I've just spotted this PR that might be helpful in the discussion: https://github.com/apache/flink/pull/8067 Best, Dawid On 20/07/2020 04:30, Benchao Li wrote: > Hi Chen, > > Thanks for bringing up this discussion. We are doing something similar > internally recently. > > Our use case is th

Re: [RESULT][VOTE] Release 1.11.1, release candidate #1

2020-07-21 Thread Piotr Nowojski
Thank you Dian for carrying out the vote! :) Piotrek wt., 21 lip 2020 o 07:28 Dian Fu napisał(a): > Hi everyone, > > I'm happy to announce that we have unanimously approved this release. > > There are 9 approving votes, 4 of which are binding: > * Jark (binding) > * Yu (binding) > * Zhijiang (b