Re: checkpointing a OneInputStreamOperator/AbstractStreamOperator

2016-09-12 Thread Aljoscha Krettek
Hi, yes you guessed correctly: CheckpointedAsynchronously only works with functions and not with the lower-level StreamOperator. You would have to implement snapshotOperatorState() and restoreState(). These interfaces are quite low-level, though, and not stable. For example, in Flink 1.2 we're refa

Flink Cluster Load Distribution Question

2016-09-12 Thread amir bahmanyari
Hi Colleagues,Just joined this forum.I have done everything possible to get a 4 nodes Flink cluster to work peoperly & run a Beam app.It always generates system-output logs (*.out) in only one node. Its so slow for 4 nodes being there.Seems like the load is not distributed amongst all 4

Re: Posting Flink Cluster questions

2016-09-12 Thread Henry Saputra
HI, Please send email to dev-subscr...@flink.apache.org and follow the instructions from the auto reply to subscribe to Apache Flink dev@ list to participate in the discussions. Thanks, Henry On Mon, Sep 12, 2016 at 2:25 PM, amir bahmanyari wrote: > > Hi, > Whats the link to post a FlinkClust

[jira] [Created] (FLINK-4614) CLONE - Kafka connector documentation refers to Flink 1.2-SNAPSHOT

2016-09-12 Thread Neelesh Srinivas Salian (JIRA)
Neelesh Srinivas Salian created FLINK-4614: -- Summary: CLONE - Kafka connector documentation refers to Flink 1.2-SNAPSHOT Key: FLINK-4614 URL: https://issues.apache.org/jira/browse/FLINK-4614

checkpointing a OneInputStreamOperator/AbstractStreamOperator

2016-09-12 Thread dan bress
Hi Flink Devs, I have an operator that implements both OneInputStreamOperator and AbstractStreamOperator, and I would like to preserve its state. I started by having it implement CheckpointedAsynchronously like my other stateful functions, but this didn't work(in the flink UI under the check

Savepoint and restart in the same command?

2016-09-12 Thread Ron Crocker
I attended Jamie Grier’s excellent presentation at Flink Forward today ("Robust Stream Processing with Apache Flink” - http://flink-forward.org/kb_sessions/robust-stream-processing-with-apache-flink/ ) where he s

ML contributions

2016-09-12 Thread Gábor Hermann
Hey all, We are planning to contribute some algorithms and improvements to Flink ML at SZTAKI . I have already opened a JIRA for an implicit feedback ALS, but probably more will come soon. We are implementing algori

[jira] [Created] (FLINK-4613) Extend ALS to handle implicit feedback datasets

2016-09-12 Thread JIRA
Gábor Hermann created FLINK-4613: Summary: Extend ALS to handle implicit feedback datasets Key: FLINK-4613 URL: https://issues.apache.org/jira/browse/FLINK-4613 Project: Flink Issue Type: New