Re: [DISCUSS] FLIP-1 : Fine grained recovery from task failures

2016-07-12 Thread Aljoscha Krettek
I added a FLIP document in the wiki: https://cwiki.apache.org/confluence/display/FLINK/FLIP-1+%3A+Fine+Grained+Recovery+from+Task+Failures For now, this contains the link to the Google Doc and a link to this discussion thread. Once a Jira is created for this it should also be added there. On Tue,

[jira] [Created] (FLINK-4204) Clean up gelly-examples

2016-07-12 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-4204: Summary: Clean up gelly-examples Key: FLINK-4204 URL: https://issues.apache.org/jira/browse/FLINK-4204 Project: Flink Issue Type: Improvement Compo

Re: [DISCUSS] FLIP 1 - Flink Improvement Proposal

2016-07-12 Thread Aljoscha Krettek
I'll make the changes to the list of things that we consider public "API" and also add these to the FLIP Template. Then we should be good to go. I'll convert the design docs I started to FLIPs in the next few days and will also ask other people that have authored design docs to move them to FLIPs.

Re: [DISCUSS] FLIP-1 : Fine grained recovery from task failures

2016-07-12 Thread Chesnay Schepler
shouldn't the proposal be contained in the wiki instead of GoogleDocs? On 12.07.2016 19:55, Stephan Ewen wrote: Hi all! Here is the very first FLIP (FLink Improvement Proposal): Fine grained recovery from task failures It describes a proposed enhancement for reducing the work done during recov

[DISCUSS] FLIP-1 : Fine grained recovery from task failures

2016-07-12 Thread Stephan Ewen
Hi all! Here is the very first FLIP (FLink Improvement Proposal): Fine grained recovery from task failures It describes a proposed enhancement for reducing the work done during recovery. https://docs.google.com/document/d/16S584XFzkfFu3MOfVCE0rHZ_JJgQrQuw9SXpanoMiMo Please comment in this mail

Re: sampling function

2016-07-12 Thread Till Rohrmann
Stratified sampling would also be beneficial for the DataSet API. I think it would be best if this method is also added to DataSetUtils or made available via the flink-contrib module. Furthermore, I think that it would be easiest if you created the JIRA for this feature, because you know what you w

[jira] [Created] (FLINK-4203) Improve Table API documentation

2016-07-12 Thread Timo Walther (JIRA)
Timo Walther created FLINK-4203: --- Summary: Improve Table API documentation Key: FLINK-4203 URL: https://issues.apache.org/jira/browse/FLINK-4203 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4202) Add JM metric which shows the restart duration

2016-07-12 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4202: Summary: Add JM metric which shows the restart duration Key: FLINK-4202 URL: https://issues.apache.org/jira/browse/FLINK-4202 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-4201) Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted

2016-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4201: - Summary: Checkpoints for jobs in non-terminal state (e.g. suspended) get deleted Key: FLINK-4201 URL: https://issues.apache.org/jira/browse/FLINK-4201 Project: Flin

[jira] [Created] (FLINK-4200) Kafka consumers should log the offset from which they restore

2016-07-12 Thread Stefan Richter (JIRA)
Stefan Richter created FLINK-4200: - Summary: Kafka consumers should log the offset from which they restore Key: FLINK-4200 URL: https://issues.apache.org/jira/browse/FLINK-4200 Project: Flink

Re: sampling function

2016-07-12 Thread Paris Carbone
Hey Do, I think that more sophisticated samplers could make a better fit in the ML library and not in the core API but I am not very familiar with the milestones there. Maybe the maintainers of the batch ML library could check if sampling techniques could be useful there I guess. Paris > On 1

[jira] [Created] (FLINK-4199) Wrong client behavior when submitting job to non-existing cluster

2016-07-12 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-4199: - Summary: Wrong client behavior when submitting job to non-existing cluster Key: FLINK-4199 URL: https://issues.apache.org/jira/browse/FLINK-4199 Project: Flink

[jira] [Created] (FLINK-4198) Replace org.apache.flink.streaming.api.windowing.time.Time with org.apache.flink.api.common.time.Time

2016-07-12 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4198: Summary: Replace org.apache.flink.streaming.api.windowing.time.Time with org.apache.flink.api.common.time.Time Key: FLINK-4198 URL: https://issues.apache.org/jira/browse/FLINK-41