Re: The Questions about Submitting PR

Till, Thank you for your answers. Best regards, Roc | | Roc Marshal | | 邮箱：flin...@126.com | 签名由 网易邮箱大师 定制 On 05/05/2020 14:25, Till Rohrmann wrote: Hi Roc, afaik it can take a bit of time until the status of the PR is updated in accordance with the AZP results. As of a couple of days ago,

[jira] [Created] (FLINK-17511) "RocksDB Memory Management end-to-end test" fails with "Current block cache usage 202123272 larger than expected memory limit 200000000"

Robert Metzger created FLINK-17511: -- Summary: "RocksDB Memory Management end-to-end test" fails with "Current block cache usage 202123272 larger than expected memory limit 2" Key: FLINK-17511 URL: https:

Re: The Questions about Submitting PR

Hi Roc, afaik it can take a bit of time until the status of the PR is updated in accordance with the AZP results. As of a couple of days ago, we no longer use Travis for running CI. That's why you don't see it anymore. Cheers, Till On Tue, May 5, 2020 at 1:59 AM Roc Marshal wrote: > Hi,all. >

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

Thanks for all the feedback. I will open the PRs now which change the notification settings of the above-mentioned repositories. Cheers, Till On Tue, May 5, 2020 at 6:26 AM Hequn Cheng wrote: > +1, thanks a lot for driving this. > > Best, Hequn > > On Tue, May 5, 2020 at 11:56 AM Dian Fu wrote

[GitHub] [flink-web] carp84 commented on a change in pull request #330: Add Apache Flink release 1.10.1

carp84 commented on a change in pull request #330: URL: https://github.com/apache/flink-web/pull/330#discussion_r419883635 ## File path: _config.yml ## @@ -192,6 +192,10 @@ component_releases: release_archive: flink: + - +version_short: "1.10" Review comme

[jira] [Created] (FLINK-17510) StreamingKafkaITCase. testKafka timeouts on downloading Kafka

Robert Metzger created FLINK-17510: -- Summary: StreamingKafkaITCase. testKafka timeouts on downloading Kafka Key: FLINK-17510 URL: https://issues.apache.org/jira/browse/FLINK-17510 Project: Flink

Re: [DISCUSS] flink-connector-rabbitmq api changes

@Austin in my initial implementation you get the envelope as well. I basically pass to the interface everything i get from the RMQ client https://github.com/senegalo/flink/blob/e67f344884b4186126c38eaa8e112d6e5cf1152e/flink-connectors/flink-connector-rabbitmq/src/main/java/org/apache/flink/streami

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1, thanks a lot for driving this. Best, Hequn On Tue, May 5, 2020 at 11:56 AM Dian Fu wrote: > +1 > > Regards, > Dian > > > 在 2020年5月5日，上午9:58，Yangze Guo 写道： > > > > +1 > > > > Best, > > Yangze Guo > > > > On Tue, May 5, 2020 at 6:14 AM Thomas Weise wrote: > >> > >> +1 > >> > >> > >> On Mon,

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1 Regards, Dian > 在 2020年5月5日，上午9:58，Yangze Guo 写道： > > +1 > > Best, > Yangze Guo > > On Tue, May 5, 2020 at 6:14 AM Thomas Weise wrote: >> >> +1 >> >> >> On Mon, May 4, 2020 at 10:02 AM Marta Paes Moreira >> wrote: >> >>> +1, this is quite annoying and distracting. >>> >>> Marta >>>

Re: [VOTE] Release 1.10.1, release candidate #2

Thanks a lot for managing the release! +1 (binding) - Go through all new commits for 1.10.1 and spot no new license problems. - Built from source archive successfully. - Signatures and hash are correct. - Run SocketWindowWordCount on the local cluster. - Install Python package and run Python Word

Re: Re: The use of state ttl incremental cleanup strategy in sql deduplication resulting in significant performance degradation

Hi Andrey, Thanks for the tuning ideas. I will explain the design of deduplication. The mini-batch implementation of deduplication buffers a bundle of input data in heap (Java Map), when the bundle size hit the trigger size or trigger time, the buffered data will be processed together. So we only

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1 Best, Yangze Guo On Tue, May 5, 2020 at 6:14 AM Thomas Weise wrote: > > +1 > > > On Mon, May 4, 2020 at 10:02 AM Marta Paes Moreira > wrote: > > > +1, this is quite annoying and distracting. > > > > Marta > > > > On Mon, May 4, 2020 at 6:27 PM Yu Li wrote: > > > > > +1 > > > > > > Best Rega

The Questions about Submitting PR

Hi,all. I have two questions about submitting pr When I submit PR and trigger azure test, it always shows the status of pending, but the details page is in the status of success. In addition, my PR has no information about Travis testing. What is the cause of this phenomenon? Thank you for your a

Re: Re: The use of state ttl incremental cleanup strategy in sql deduplication resulting in significant performance degradation

Hi lsyldliu, You can try to tune the StateTtlConfig. As the documentation suggests [1] the TTL incremental cleanup can decrease the per record performance. This is the price of the automatic cleanup. If the only thing, which happens mostly in your operator, is working with state then even checking

Re: [DISCUSS] flink-connector-rabbitmq api changes

Thanks Aljoscha, I'm happy to take FLINK-17204 for now, if you're able to assign it to me, and we'll go from there? Excited to use what you come up with Karim! It also looks like FLINK-8510 migh

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1 On Mon, May 4, 2020 at 10:02 AM Marta Paes Moreira wrote: > +1, this is quite annoying and distracting. > > Marta > > On Mon, May 4, 2020 at 6:27 PM Yu Li wrote: > > > +1 > > > > Best Regards, > > Yu > > > > > > On Tue, 5 May 2020 at 00:21, Konstantin Knauf wrote: > > > > > Yes, please. >

[jira] [Created] (FLINK-17509) Support OracleDialect

Flavio Pompermaier created FLINK-17509: -- Summary: Support OracleDialect Key: FLINK-17509 URL: https://issues.apache.org/jira/browse/FLINK-17509 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17508) Develop OracleCatalog

Flavio Pompermaier created FLINK-17508: -- Summary: Develop OracleCatalog Key: FLINK-17508 URL: https://issues.apache.org/jira/browse/FLINK-17508 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-17507) Training figure program_dataflow.svg should use preferred parts of the API

David Anderson created FLINK-17507: -- Summary: Training figure program_dataflow.svg should use preferred parts of the API Key: FLINK-17507 URL: https://issues.apache.org/jira/browse/FLINK-17507 Projec

Re: [DISCUSS] Update our Roadmap

Hey all, The roadmap has been updated last in September 2019. There is quite a bit of outdated information on that page. Is there a volunteer who wants to create a first draft for an updated version? On Mon, Aug 19, 2019 at 12:14 PM Robert Metzger wrote: > Nice, thanks! Looking forward to the P

[GitHub] [flink-web] XBaith commented on pull request #333: [FLINK-17490] Add training page

XBaith commented on pull request #333: URL: https://github.com/apache/flink-web/pull/333#issuecomment-623640938 Thank you @alpinegizmo . This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1, this is quite annoying and distracting. Marta On Mon, May 4, 2020 at 6:27 PM Yu Li wrote: > +1 > > Best Regards, > Yu > > > On Tue, 5 May 2020 at 00:21, Konstantin Knauf wrote: > > > Yes, please. > > > > On Mon, May 4, 2020 at 5:50 PM Dawid Wysakowicz > > wrote: > > > > > +1 > > > > > > Y

Re: [DISCUSS] Releasing "fat" and "slim" Flink distributions

Thanks everyone for this lively discussion and all your thoughts. Let me try to summarise the current state of the discussion and then let's see how we can move it forward. To begin with, I think everyone agrees that we want to improve Flink's user experience. In particular, we want to improve th

[jira] [Created] (FLINK-17506) SavepointEnvironment does not honour 'io.tmp.dirs' property

David Artiga created FLINK-17506: Summary: SavepointEnvironment does not honour 'io.tmp.dirs' property Key: FLINK-17506 URL: https://issues.apache.org/jira/browse/FLINK-17506 Project: Flink

[DISCUSS] Updates to our Licensing wiki (was: Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4)

Thanks Robert, I think these supplements are quite instructive and make the whole process more clear. nit: it surprised me a little bit that this voting thread of a canceled RC is revived so I edited the subject in this reply. Best Regards, Yu On Mon, 4 May 2020 at 22:48, Robert Metzger wrote:

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1 Best Regards, Yu On Tue, 5 May 2020 at 00:21, Konstantin Knauf wrote: > Yes, please. > > On Mon, May 4, 2020 at 5:50 PM Dawid Wysakowicz > wrote: > > > +1 > > > > Yes, please. I've also observed a lot of noise in the past days. > > > > Best, > > > > Dawid > > > > On 04/05/2020 17:48, Tzu-L

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

Yes, please. On Mon, May 4, 2020 at 5:50 PM Dawid Wysakowicz wrote: > +1 > > Yes, please. I've also observed a lot of noise in the past days. > > Best, > > Dawid > > On 04/05/2020 17:48, Tzu-Li (Gordon) Tai wrote: > > +1 > > > > All the recent new repos, flink-statefun / flink-statefun-docker /

Re: [DISCUSS] Have foreground processes also create log files

Hi everyone, thanks for starting this discussion Chesnay. I think it would be nice if we also displayed the logs when starting the process in the foreground. The repercussions could be mitigated if the default logger configurations would contain file rolling with a max log file size. @Yang I th

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1 Yes, please. I've also observed a lot of noise in the past days. Best, Dawid On 04/05/2020 17:48, Tzu-Li (Gordon) Tai wrote: > +1 > > All the recent new repos, flink-statefun / flink-statefun-docker / > flink-training etc. are also sending notifications to issues@. > > Gordon > > > On Mon, M

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

+1 All the recent new repos, flink-statefun / flink-statefun-docker / flink-training etc. are also sending notifications to issues@. Gordon On Mon, May 4, 2020, 11:44 PM Till Rohrmann wrote: > Hi everyone, > > due to some changes on the ASF side, we are now seeing issue and pull > request not

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

Big +1 to this. Best, Jark On Mon, 4 May 2020 at 23:44, Till Rohrmann wrote: > Hi everyone, > > due to some changes on the ASF side, we are now seeing issue and pull > request notifications for the flink-web [1] and flink-shaded [2] repo on > dev@flink.apache.org. I think this is not ideal sinc

Re: [DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

For future reference here is the link describing how to configure the notifications: https://cwiki.apache.org/confluence/display/INFRA/.asf.yaml+features+for+git+repositories#id-.asf.yamlfeaturesforgitrepositories-Notificationsettingsforrepositories On Mon, May 4, 2020 at 5:43 PM Till Rohrmann wr

[DISCUSS] Send issue and pull request notifications for flink-web and flink-shaded to iss...@flink.apache.org

Hi everyone, due to some changes on the ASF side, we are now seeing issue and pull request notifications for the flink-web [1] and flink-shaded [2] repo on dev@flink.apache.org. I think this is not ideal since the dev ML is much more noisy now. I would propose to send these notifications to iss..

Re: [DISCUSS] Hierarchies in ConfigOption

Hi everyone, I like Timo's proposal to organize our configuration more hierarchical since this is what the coding guide specifies. The benefit I see is that config options belonging to the same concept will be found in the same nested object. Moreover, it will be possible to split the configuratio

[GitHub] [flink-web] hequn8128 commented on a change in pull request #330: Add Apache Flink release 1.10.1

hequn8128 commented on a change in pull request #330: URL: https://github.com/apache/flink-web/pull/330#discussion_r419501350 ## File path: _config.yml ## @@ -192,6 +192,10 @@ component_releases: release_archive: flink: + - +version_short: "1.10" Review co

Re: [VOTE] Apache Flink Stateful Functions Release 2.0.0, release candidate #4

I think I conceptually added everything Stephan mentioned into the Wiki: https://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=97552147&selectedPageVersions=5&selectedPageVersions=3 I'm looking forward to any comments or corrections. On Wed, Apr 1, 2020 at 12:20 PM Chesnay Sch

Re: Presentation - Real World Architectural Patterns with Apache Pulsar and Flink

Thanks for sharing your talk with the Flink community. Cheers, Till On Tue, Apr 28, 2020 at 10:00 PM Devin Bost wrote: > You can also access the slide deck here: > https://www.slideshare.net/DevinBost/realworld-pulsar-architectural-patterns > [image: image.png] > Devin G. Bost > > > On Tue, Apr

[GitHub] [flink-web] morsapaes commented on pull request #333: [FLINK-17490] Add training page

morsapaes commented on pull request #333: URL: https://github.com/apache/flink-web/pull/333#issuecomment-623493486 Thanks, David! I think this makes it more intuitive to find. 👌 This is an automated message from the Apache G

[jira] [Created] (FLINK-17505) Merge small files produced by StreamingFileSink

Piotr Nowojski created FLINK-17505: -- Summary: Merge small files produced by StreamingFileSink Key: FLINK-17505 URL: https://issues.apache.org/jira/browse/FLINK-17505 Project: Flink Issue Typ

[RESULT][VOTE] FLIP-108: edit the Public API

Hi all, The voting time for changing the Public API of FLIP-108[1] has passed. I'm closing the vote now. There were 3 + 1 votes, 3 of which are binding: - Till (binding) - Becket (binding) - Yu Li (binding) - Xintong Song (non-binding) There were no -1 votes. Thus, changes have been accepted.

[jira] [Created] (FLINK-17504) Update translation of Getting Started / Overview

David Anderson created FLINK-17504: -- Summary: Update translation of Getting Started / Overview Key: FLINK-17504 URL: https://issues.apache.org/jira/browse/FLINK-17504 Project: Flink Issue Ty

[GitHub] [flink-shaded] piyushnarang commented on pull request #85: [FLINK-16955] Bump Zookeeper 3.4.X to 3.4.14

piyushnarang commented on pull request #85: URL: https://github.com/apache/flink-shaded/pull/85#issuecomment-623458136 Ok, I've already done that degree of sanity checking and ran a few of the tests on my machine locally. T

[GitHub] [flink-web] carp84 commented on pull request #330: Add Apache Flink release 1.10.1

carp84 commented on pull request #330: URL: https://github.com/apache/flink-web/pull/330#issuecomment-623447337 Thanks for the review @hequn8128 . All comments addressed, PTAL. Thanks. This is an automated message from the Ap

[GitHub] [flink-web] carp84 commented on a change in pull request #330: Add Apache Flink release 1.10.1

carp84 commented on a change in pull request #330: URL: https://github.com/apache/flink-web/pull/330#discussion_r419413870 ## File path: _posts/2020-05-05-release-1.10.1.md ## @@ -0,0 +1,370 @@ +--- +layout: post +title: "Apache Flink 1.10.1 Released" +date: 2020-05-05 12:00

[GitHub] [flink-shaded] zentol commented on pull request #85: [FLINK-16955] Bump Zookeeper 3.4.X to 3.4.14

zentol commented on pull request #85: URL: https://github.com/apache/flink-shaded/pull/85#issuecomment-623430510 @piyushnarang There is unfortunately no _easy_ way of doing that. I'd suggest to modify `tools/ci/maven-utils.sh` in the Flink project to checkout your branch, install it, and

[GitHub] [flink-web] alpinegizmo commented on pull request #333: [FLINK-17490] Add training page

alpinegizmo commented on pull request #333: URL: https://github.com/apache/flink-web/pull/333#issuecomment-623427987 @morsapaes @XBaith I've changed it, based on your feedback. ![image](https://user-images.githubusercontent.com/43608/80964626-82e73480-8e11-11ea-85f6-b9d2d920bef0.png

[jira] [Created] (FLINK-17503) Make memory configuration logging more user-friendly

Till Rohrmann created FLINK-17503: - Summary: Make memory configuration logging more user-friendly Key: FLINK-17503 URL: https://issues.apache.org/jira/browse/FLINK-17503 Project: Flink Issue

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

@Konstantin It is part a) since it is not used by all hadoop users (as they may be using their existing hadoop infrastructure or one provided by the cloud service), but I'd say it's mostly for maintenance reasons. The reality is that we cannot truly maintain flink-shaded-hadoop. There are too

Re: [DISCUSS] flink-connector-rabbitmq api changes

Hi, Okay i created a ticket: https://issues.apache.org/jira/browse/FLINK-17502 i will work on the modifications "keeping the old constructor" and brush up on the contribution guides and move from there :) Regards, Karim Mansour On Mon, May 4, 2020 at 10:00 AM Aljoscha Krettek wrote: > Yes, th

[jira] [Created] (FLINK-17502) More granular source parsing

Karim Mansour created FLINK-17502: - Summary: More granular source parsing Key: FLINK-17502 URL: https://issues.apache.org/jira/browse/FLINK-17502 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-17501) Improve logging in AbstractServerHandler#channelRead(ChannelHandlerContext, Object)

Gary Yao created FLINK-17501: Summary: Improve logging in AbstractServerHandler#channelRead(ChannelHandlerContext, Object) Key: FLINK-17501 URL: https://issues.apache.org/jira/browse/FLINK-17501 Project:

Re: [DISCUSS] Adding support for Hadoop 3 and removing flink-shaded-hadoop

Hey Robert and others, overall +1 to support Hadoop 3. It would be a great to unblock Flink support in EMR 6.0 as noted in the linked FLINK ticket. The arguments raised against flink-shaded-hadoop make sense to me. I have a few general questions still: 1) Will the flink-shaded-hadoop module (in

[jira] [Created] (FLINK-17500) Deploy JobGraph form file in StandaloneClusterEntrypoint

Ufuk Celebi created FLINK-17500: --- Summary: Deploy JobGraph form file in StandaloneClusterEntrypoint Key: FLINK-17500 URL: https://issues.apache.org/jira/browse/FLINK-17500 Project: Flink Issue

Re: [DISCUSS] flink-connector-rabbitmq api changes

Yes, that's what I was proposing! @Karim If there's not already a Jira issue, please create one. You can ping me, so that I can assign you. @Austin There's a Jira component for the RMQ source, maybe you can take a stab at some of the issues there: https://issues.apache.org/jira/browse/FLINK-