[DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Chesnay Schepler
Hello, I would like to do another flink-shaded release for 1.11.0, to include a zookeeper 3.4 security fix and resolve a shading issue when working with Gradle.

Re: [DISCUSS] FLIP-84 Feedback Summary

2020-05-25 Thread Timo Walther
+1 Personally, I would declare it as `collect(): ClosableIterator` to avoid an additional class in the API and reuse existing Flink utils. Regards, Timo On 17.05.20 10:21, Jingsong Li wrote: +1 Best, Jingsong Lee On Sun, May 17, 2020 at 3:42 PM Kurt Young wrote: +1 from my side. Best,

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Jingsong Li
+1 for the proposal. It makes me clearer. Best, Jingsong Lee On Mon, May 25, 2020 at 2:51 PM Zhijiang wrote: > Thanks for launching this discussion and giving so detailed infos, > Robert! +1 on my side for the proposal. > > For "Affects Version", I previously thought it was only for the alread

[ANNOUNCE] Weekly Community Update 2020/21

2020-05-25 Thread Konstantin Knauf
Dear community, happy to share this week's community update! Flink Development == * [releases] Zhijiang has published a first release candidate for Apache Flink 1.11.0. This is a "preview-only" release candidate to facilitate current testing efforts. There will not be a vote on this

[jira] [Created] (FLINK-17918) Jobs with two input operators are loosing data in unaligned checkpoints

2020-05-25 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17918: -- Summary: Jobs with two input operators are loosing data in unaligned checkpoints Key: FLINK-17918 URL: https://issues.apache.org/jira/browse/FLINK-17918 Project:

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Yang Wang
+1 from this useful proposal. This makes me clearer about "Resolve" and "Close" since I used to be confused by this two button. Best, Yang Jingsong Li 于2020年5月25日周一 下午3:10写道: > +1 for the proposal. > It makes me clearer. > > Best, > Jingsong Lee > > On Mon, May 25, 2020 at 2:51 PM Zhijiang .i

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Zhu Zhu
This is very helpful! +1 Thanks, Zhu Zhu Yang Wang 于2020年5月25日周一 下午4:04写道: > +1 from this useful proposal. > > This makes me clearer about "Resolve" and "Close" since I used to be > confused by this two button. > > Best, > Yang > > Jingsong Li 于2020年5月25日周一 下午3:10写道: > > > +1 for the proposal.

Re: java.lang.NoSuchMethodError while writing to Kafka from Flink

2020-05-25 Thread Chesnay Schepler
Please double-check that your distribution and application jar were built against the same Flink version. This looks related to a binary-compatibility issues reporter in FLINK-13586 .

Re: Shall we avoid binding "unsafe ports" during random port selection?

2020-05-25 Thread Till Rohrmann
Hi Weike, would it be good enough if the user did not include unsafe ranges when specifying `rest.bind-port`? My concern with excluding unsafe ports is that it adds some invisible magic which can be hard to understand for the user. I think over the past couple of years it has proven that auto magi

Re: Please update the Requirements of PyPI

2020-05-25 Thread Till Rohrmann
Thanks for the pointer Ray. I've pulled in Jincheng who works on Flink's Python integration. Cheers, Till On Mon, May 25, 2020 at 8:41 AM Ray Chen wrote: > Hi PyFlink Developers, > > > I got some errors from the pyarrow depended on apache-flink v1.10.1. > > It seems updating pyarrow version gr

Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Till Rohrmann
+1 for the new flink-shaded release. Cheers, Till On Mon, May 25, 2020 at 9:06 AM Chesnay Schepler wrote: > Hello, > > I would like to do another flink-shaded release for 1.11.0, to include a > zookeeper 3.4 security fix and resolve a shading issue when working with > Gradle. > > >

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-05-25 Thread Yun Tang
I noticed that there still existed travis related bot commands in the github PR page, and I think we should remove the command hint now. From: Robert Metzger Sent: Thursday, April 23, 2020 15:44 To: dev Subject: Re: [DISCUSS] Switch to Azure Pipelines as the pri

[jira] [Created] (FLINK-17919) KafkaConsumerThread should add ratelimiter functionality as well

2020-05-25 Thread zhangminglei (Jira)
zhangminglei created FLINK-17919: Summary: KafkaConsumerThread should add ratelimiter functionality as well Key: FLINK-17919 URL: https://issues.apache.org/jira/browse/FLINK-17919 Project: Flink

Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Zhijiang
Thanks for driving this, Chesnay! +1 on my side. Best, Zhijiang -- From:Till Rohrmann Send Time:2020年5月25日(星期一) 16:28 To:dev Subject:Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0) +1 for the new flink-shaded re

[jira] [Created] (FLINK-17920) Add the Python example of Time-windowed join in Table API doc

2020-05-25 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-17920: Summary: Add the Python example of Time-windowed join in Table API doc Key: FLINK-17920 URL: https://issues.apache.org/jira/browse/FLINK-17920 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.11.0, release candidate #1

2020-05-25 Thread Yang Wang
Since the official image for 1.11 has not been release, I just want to post how to build the image with provided Flink binary. I think many users are running Flink in container environment(e.g. docker, Kubernetes, etc.) and hope this could help them with the testing. git clone 'https://github.c

[jira] [Created] (FLINK-17921) RpcGlobalAggregateManager#updateGlobalAggregate would cause akka.timeout

2020-05-25 Thread zhangminglei (Jira)
zhangminglei created FLINK-17921: Summary: RpcGlobalAggregateManager#updateGlobalAggregate would cause akka.timeout Key: FLINK-17921 URL: https://issues.apache.org/jira/browse/FLINK-17921 Project: Fli

Re: Please update the Requirements of PyPI

2020-05-25 Thread jincheng sun
Thanks Ray and Till, Could you provide more information about the errors you encountered? Is it the same error message as reported in https://issues.apache.org/jira/browse/BEAM-8368? Best, Jincheng Till Rohrmann 于2020年5月25日周一 下午4:28写道: > Thanks for the pointer Ray. I've pulled in Jincheng who

[jira] [Created] (FLINK-17922) Refactor generic and hive table rules for HiveCatalog

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17922: Summary: Refactor generic and hive table rules for HiveCatalog Key: FLINK-17922 URL: https://issues.apache.org/jira/browse/FLINK-17922 Project: Flink Issue T

[jira] [Created] (FLINK-17923) It will throw MemoryAllocationException if rocksdb statebackend and Python UDF are used in the same slot

2020-05-25 Thread Dian Fu (Jira)
Dian Fu created FLINK-17923: --- Summary: It will throw MemoryAllocationException if rocksdb statebackend and Python UDF are used in the same slot Key: FLINK-17923 URL: https://issues.apache.org/jira/browse/FLINK-17923

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-05-25 Thread Chesnay Schepler
The travis bot commands must be retained so long as we accept PRs for 1.9/1.10 . On 25/05/2020 10:50, Yun Tang wrote: I noticed that there still existed travis related bot commands in the github PR page, and I think we should remove the command hint now. From:

Re: [DISCUSS] FLIP-126: Unify (and separate) Watermark Assigners

2020-05-25 Thread Aljoscha Krettek
The specifics of naming diverged a bit from the FLIP during implementation but that should be fine. What matters in the end is the intention of the FLIP and that the code that is committed in the end is good and consistent in itself. Best, Aljoscha On 24.05.20 05:12, Guanghui Zhang wrote: Hi

Re: Shall we avoid binding "unsafe ports" during random port selection?

2020-05-25 Thread Ufuk Celebi
I agree with Till. I think this should be a concern of the user configuring the port range. – Ufuk On Mon, May 25, 2020 at 10:27 AM Till Rohrmann wrote: > Hi Weike, > > would it be good enough if the user did not include unsafe ranges when > specifying `rest.bind-port`? My concern with excludi

Re: [DISCUSS] Release flink-shaded 11.0 (and include it in 1.11.0)

2020-05-25 Thread Hequn Cheng
+1 It would be nice to have these fixes! Best, Hequn On Mon, May 25, 2020 at 5:00 PM Zhijiang wrote: > Thanks for driving this, Chesnay! > +1 on my side. > > Best, > Zhijiang > -- > From:Till Rohrmann > Send Time:2020年5月25日(星期一) 1

[jira] [Created] (FLINK-17924) HBase connector:we can write data to HBase table, but con`t read data from HBase

2020-05-25 Thread pengnengsong (Jira)
pengnengsong created FLINK-17924: Summary: HBase connector:we can write data to HBase table, but con`t read data from HBase Key: FLINK-17924 URL: https://issues.apache.org/jira/browse/FLINK-17924 Proj

[jira] [Created] (FLINK-17925) Throws unsupported exception when using metastore commit policy for filesystem table

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17925: Summary: Throws unsupported exception when using metastore commit policy for filesystem table Key: FLINK-17925 URL: https://issues.apache.org/jira/browse/FLINK-17925

Re: [DISCUSS] Switch to Azure Pipelines as the primary CI tool / switch off Travis

2020-05-25 Thread Yun Tang
If we still need to accept PRs for Flink-1.9/1.10, that could explain why we still need that command hint. Chesnay, thanks for your explanation. From: Chesnay Schepler Sent: Monday, May 25, 2020 18:17 To: dev@flink.apache.org ; Yun Tang Subject: Re: [DISCUSS] Swi

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Congxian Qiu
@ches...@apache.org Thanks for the confirmation Best, Congxian Zhu Zhu 于2020年5月25日周一 下午4:13写道: > This is very helpful! > +1 > > Thanks, > Zhu Zhu > > Yang Wang 于2020年5月25日周一 下午4:04写道: > > > +1 from this useful proposal. > > > > This makes me clearer about "Resolve" and "Close" since I used

[jira] [Created] (FLINK-17926) Can't build flink-web docker image because of EOL of Ubuntu:18.10

2020-05-25 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-17926: - Summary: Can't build flink-web docker image because of EOL of Ubuntu:18.10 Key: FLINK-17926 URL: https://issues.apache.org/jira/browse/FLINK-17926 P

[jira] [Created] (FLINK-17927) Default value of "sink.partition-commit.trigger" should be "process-time"

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17927: Summary: Default value of "sink.partition-commit.trigger" should be "process-time" Key: FLINK-17927 URL: https://issues.apache.org/jira/browse/FLINK-17927 Project: Fl

[jira] [Created] (FLINK-17928) Incorrect state size reported when using unaligned checkpoints

2020-05-25 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-17928: -- Summary: Incorrect state size reported when using unaligned checkpoints Key: FLINK-17928 URL: https://issues.apache.org/jira/browse/FLINK-17928 Project: Flink

[jira] [Created] (FLINK-17929) Fix invalid liquid expressions

2020-05-25 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17929: Summary: Fix invalid liquid expressions Key: FLINK-17929 URL: https://issues.apache.org/jira/browse/FLINK-17929 Project: Flink Issue Type: Bug

Re: [DISCUSS] Semantics of our JIRA fields

2020-05-25 Thread Robert Metzger
Hi all, thanks a lot for the feedback. The majority of responses are very positive to my proposal. I have put my proposal into our wiki: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=154995514 Regarding the comments so far: @Jark: I clarified this in the wiki. @Israel: I have

[jira] [Created] (FLINK-17931) Document fromValues

2020-05-25 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-17931: Summary: Document fromValues Key: FLINK-17931 URL: https://issues.apache.org/jira/browse/FLINK-17931 Project: Flink Issue Type: Sub-task Co

[jira] [Created] (FLINK-17932) All hbase config Options can not work in HBaseTableSource

2020-05-25 Thread Leonard Xu (Jira)
Leonard Xu created FLINK-17932: -- Summary: All hbase config Options can not work in HBaseTableSource Key: FLINK-17932 URL: https://issues.apache.org/jira/browse/FLINK-17932 Project: Flink Issue T

[VOTE] Release flink-shaded 11.0, release candidate #1

2020-05-25 Thread Chesnay Schepler
Hi everyone, Please review and vote on the release candidate #1 for the version 11.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

[jira] [Created] (FLINK-17933) TaskManager was terminated on Yarn - investigate

2020-05-25 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-17933: - Summary: TaskManager was terminated on Yarn - investigate Key: FLINK-17933 URL: https://issues.apache.org/jira/browse/FLINK-17933 Project: Flink Is

Re: [DISCUSS] Releasing Stateful Functions 2.1.0 soon?

2020-05-25 Thread Stephan Ewen
Nice work, thanks for pushing this, Gordon! +1 also from my side for a quick release. I think it already warrants a release to have the 1.10.1 upgrade and the fix to not fail on savepoints that are triggered concurrently to a checkpoint. Even nicer that there are two cool new features included.

[jira] [Created] (FLINK-17934) StreamingFileWriter should set chainingStrategy

2020-05-25 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-17934: Summary: StreamingFileWriter should set chainingStrategy Key: FLINK-17934 URL: https://issues.apache.org/jira/browse/FLINK-17934 Project: Flink Issue Type: B

[jira] [Created] (FLINK-17935) Logs could not show up when deploying Flink on Yarn via "--executor"

2020-05-25 Thread Yang Wang (Jira)
Yang Wang created FLINK-17935: - Summary: Logs could not show up when deploying Flink on Yarn via "--executor" Key: FLINK-17935 URL: https://issues.apache.org/jira/browse/FLINK-17935 Project: Flink

[jira] [Created] (FLINK-17936) Implement type inference for AS

2020-05-25 Thread Timo Walther (Jira)
Timo Walther created FLINK-17936: Summary: Implement type inference for AS Key: FLINK-17936 URL: https://issues.apache.org/jira/browse/FLINK-17936 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17937) Change some hive connector tests to IT cases

2020-05-25 Thread Rui Li (Jira)
Rui Li created FLINK-17937: -- Summary: Change some hive connector tests to IT cases Key: FLINK-17937 URL: https://issues.apache.org/jira/browse/FLINK-17937 Project: Flink Issue Type: Test C