[jira] [Created] (FLINK-11860) Remove all the usage of deprecated unit-provided memory options in docs and scripts

2019-03-07 Thread Yun Tang (JIRA)
Yun Tang created FLINK-11860: Summary: Remove all the usage of deprecated unit-provided memory options in docs and scripts Key: FLINK-11860 URL: https://issues.apache.org/jira/browse/FLINK-11860 Project:

[jira] [Created] (FLINK-11859) Improve SpanningRecordSerializer performance by serializing record length to serialization buffer directly

2019-03-07 Thread Yingjie Cao (JIRA)
Yingjie Cao created FLINK-11859: --- Summary: Improve SpanningRecordSerializer performance by serializing record length to serialization buffer directly Key: FLINK-11859 URL: https://issues.apache.org/jira/browse/FLINK

apply for contributor permission

2019-03-07 Thread 何春平
Hi, I want to contribute to Apache Flink. would you please give me the contributor permission? my jira id is moxian thanks

[jira] [Created] (FLINK-11858) Introduce block compressor/decompressor for batch table runtime

2019-03-07 Thread Kurt Young (JIRA)
Kurt Young created FLINK-11858: -- Summary: Introduce block compressor/decompressor for batch table runtime Key: FLINK-11858 URL: https://issues.apache.org/jira/browse/FLINK-11858 Project: Flink

[jira] [Created] (FLINK-11857) Introduce BinaryExternalSorter to batch table runtime

2019-03-07 Thread Jingsong Lee (JIRA)
Jingsong Lee created FLINK-11857: Summary: Introduce BinaryExternalSorter to batch table runtime Key: FLINK-11857 URL: https://issues.apache.org/jira/browse/FLINK-11857 Project: Flink Issue T

[jira] [Created] (FLINK-11856) Introduce BinaryHashTable and LongHashTable to batch table runtime

2019-03-07 Thread Kurt Young (JIRA)
Kurt Young created FLINK-11856: -- Summary: Introduce BinaryHashTable and LongHashTable to batch table runtime Key: FLINK-11856 URL: https://issues.apache.org/jira/browse/FLINK-11856 Project: Flink

I want to be contributor

2019-03-07 Thread leocook
HiGuys, IwanttocontributetoApacheFlink. Wouldyoupleasegivemethepermissionasacontributor? MyJIRAIDisleocook, thanks!

Re: [ANNOUNCEMENT] March 2019 Bay Area Apache Flink Meetup

2019-03-07 Thread Xuefu Zhang
Hi all, As an update, this meetup will take place at 505 Brannan St · San Francisco, CA . Many thanks to Pinterest for their generosity of h

[jira] [Created] (FLINK-11855) Race condition in EmbeddedLeaderService

2019-03-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-11855: - Summary: Race condition in EmbeddedLeaderService Key: FLINK-11855 URL: https://issues.apache.org/jira/browse/FLINK-11855 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] Update on Flink 1.8 Release Progress

2019-03-07 Thread Aljoscha Krettek
Hi, Another update: things are looking mostly good! There is only one release blocker remaining [1] as of the time of this writing. Unfortunately, tomorrow is a public holiday in Germany so I might not get around to creating a first RC, sorry for that! Regarding, https://issues.apache.org/jira

Re: Sharing state between subtasks

2019-03-07 Thread Thomas Weise
The state sharing support will be part of the upcoming 1.8 release. We have also completed most of the synchronization work for the Kinesis consumer and will contribute those changes to Flink soon. Most of the code will be reusable for Kafka consumer. We will need the same support in the Kafka c

Re: Sharing state between subtasks

2019-03-07 Thread Gerard Garcia
Any advance related to synchronizing ingestion by event/ingestion-time between kafka partitions? On Thu, Nov 15, 2018 at 1:27 AM Jamie Grier wrote: > Hey all, > > I think all we need for this on the state sharing side is pretty simple. I > opened a JIRA to track this work and submitted a PR for

Re: JobManager scale limitation - Slow S3 checkpoint deletes

2019-03-07 Thread Jamie Grier
All of the suggestions is this thread are good ones. I had also considered farming the actual cleanup work out to all the TaskMangers as well but didn't realize how the easy the fix might be for this. Thanks, Till. With Till's change https://github.com/apache/flink/pull/7924 the problem we're ac

Re: [DISCUSS] Create a Flink ecosystem website

2019-03-07 Thread Becket Qin
Absolutely! Thanks for the pointer. I'll submit a PR to update the ecosystem page and the navigation. Thanks, Jiangjie (Becket) Qin On Thu, Mar 7, 2019 at 8:47 PM Robert Metzger wrote: > Okay. I will reach out to spark-packages.org and see if they are willing > to share. > > Do you want to rai

Re: [DISCUSS] Improve the flinkbot

2019-03-07 Thread Robert Metzger
Each Jira ticket has a "last updated" field, and in a JIRA search, you can sort results by that field. So I will regularly check all Jira tickets which have been updated since the last time my tool checked. For all changed Jira tickets, I'll update the PR if the component has changed. The impleme

Re: [DISCUSS] Improve the flinkbot

2019-03-07 Thread Chesnay Schepler
How do you intend to keep the label up-to-date with whatever modifications are made in JIRA? On 07.03.2019 13:40, Robert Metzger wrote: I will automatically assign the Jira component as a label to the PR, yes. You won't have to manually update the label on the PR, this will be done automaticall

[jira] [Created] (FLINK-11854) Introduce batch physical nodes

2019-03-07 Thread godfrey he (JIRA)
godfrey he created FLINK-11854: -- Summary: Introduce batch physical nodes Key: FLINK-11854 URL: https://issues.apache.org/jira/browse/FLINK-11854 Project: Flink Issue Type: New Feature

Re: [DISCUSS] Create a Flink ecosystem website

2019-03-07 Thread Robert Metzger
Okay. I will reach out to spark-packages.org and see if they are willing to share. Do you want to raise a PR to update the ecosystem page (maybe sync with the "Software Projects" listed here: https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink) and link it in the navigation? Best,

??????Fwd: DataStream EventTime last data cannot be output??

2019-03-07 Thread ??????
the watermark > end timestamp of the window should trigger the window. - -- ;./??: "?? ??"; : 2019??3??7??(??) 8:35 ??: "dev"; : Fwd: DataStream EventTime last data cannot be output?? > > > ??: ??

Re: [DISCUSS] Improve the flinkbot

2019-03-07 Thread Robert Metzger
I will automatically assign the Jira component as a label to the PR, yes. You won't have to manually update the label on the PR, this will be done automatically. So JIRA will stay the ground truth for setting the component correctly. On Thu, Mar 7, 2019 at 10:11 AM Chesnay Schepler wrote: > Com

[jira] [Created] (FLINK-11853) Allow /jars/:jarid/plan as a POST request too

2019-03-07 Thread Stephen Connolly (JIRA)
Stephen Connolly created FLINK-11853: Summary: Allow /jars/:jarid/plan as a POST request too Key: FLINK-11853 URL: https://issues.apache.org/jira/browse/FLINK-11853 Project: Flink Issue

Re: Error on importing flink source code into Intellij

2019-03-07 Thread Felipe Gutierrez
Thank you for your suggestions, I did everything that you said however did not worked. After all, I deleted the /home/myuser/.m2 directory and generated the source again. I also closed my Eclipse IDE because the machine was running out of memory. I am not sure about the second action. But when I re

[jira] [Created] (FLINK-11852) Improve Processing function example

2019-03-07 Thread Flavio Pompermaier (JIRA)
Flavio Pompermaier created FLINK-11852: -- Summary: Improve Processing function example Key: FLINK-11852 URL: https://issues.apache.org/jira/browse/FLINK-11852 Project: Flink Issue Type: I

Re: JobManager scale limitation - Slow S3 checkpoint deletes

2019-03-07 Thread Till Rohrmann
I think part of the problem is that we currently use the executor of the common RpcService to run the I/O operations as Stephan suspected [1]. I will be fixing this problem for 1.8.0 and 1.7.3. This should resolve the problem but supporting different means of clean up might still be interesting to

[jira] [Created] (FLINK-11851) ClusterEntrypoint provides wrong executor to HaServices

2019-03-07 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-11851: - Summary: ClusterEntrypoint provides wrong executor to HaServices Key: FLINK-11851 URL: https://issues.apache.org/jira/browse/FLINK-11851 Project: Flink Iss

[jira] [Created] (FLINK-11850) ZooKeeperHaServicesTest#testSimpleCloseAndCleanupAllData fails on Travis

2019-03-07 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-11850: - Summary: ZooKeeperHaServicesTest#testSimpleCloseAndCleanupAllData fails on Travis Key: FLINK-11850 URL: https://issues.apache.org/jira/browse/FLINK-11850

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

2019-03-07 Thread Kostas Kloudas
Hi, Thanks for the comments. I agree with the Ufuk's and Elias' proposal. - "cancel" remains the good old "cancel" - "terminate" becomes "stop --drain-with-savepoint" - "suspend" becomes "stop --with-savepoint" - "cancel-with-savepoint" is subsumed by "stop --with-savepoint" As you see from the

Re: [DISCUSS] Create a Flink ecosystem website

2019-03-07 Thread Becket Qin
Hi Robert, I think it at least worths checking if spark-packages.org owners are willing to share. Thanks for volunteering to write the requirement descriptions! In any case, that will be very helpful. Since a static page has almost no cost, and we will need it to redirect to the dynamic site anyw

[jira] [Created] (FLINK-11849) The flink document about checkpoint and savepoint may be wrong

2019-03-07 Thread xulongfetion (JIRA)
xulongfetion created FLINK-11849: Summary: The flink document about checkpoint and savepoint may be wrong Key: FLINK-11849 URL: https://issues.apache.org/jira/browse/FLINK-11849 Project: Flink

Re: [DISCUSS] Improve the flinkbot

2019-03-07 Thread Chesnay Schepler
Component labels seem a bit redundant. Every JIRA with an open PR already has a "pull-request-available" tag. So this information already exists. I assume you'll base the labels on the component tags at the time the PR is opened, but this also implies that they may be set incorrectly (or not a