[jira] [Created] (FLINK-3179) Combiner is not injected if Reduce or GroupReduce input is explicitly partitioned

2015-12-16 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-3179: Summary: Combiner is not injected if Reduce or GroupReduce input is explicitly partitioned Key: FLINK-3179 URL: https://issues.apache.org/jira/browse/FLINK-3179 Proje

Re: Apache Tinkerpop & Geode Integration?

2015-12-16 Thread Vasiliki Kalavri
Hey, I think I might have confused you, so let me try to explain :) First, Gremlin is a language similar to Cypher, but it is also a traversal machine, which also supports distributed traversals. For distributed traversals, Gremlin uses a "graph computer", which runs the Gremlin traversals using

Re: Apache Tinkerpop & Geode Integration?

2015-12-16 Thread Stephan Ewen
I am not very familiar with Gremlin, but I remember a brainstorming session with Martin Neumann on porting Cypher (the neo4j query language) to Flink. We looked at Cypher queries for filtering and traversing the graph. It looked like it would work well. We remember we could even model recursive co

Re: Apache Tinkerpop & Geode Integration?

2015-12-16 Thread Stephan Ewen
I am not very familiar with Gremlin, but I remember a brainstorming session with Martin Neumann on porting Cypher (the neo4j query language) to Flink. We looked at Cypher queries for filtering and traversing the graph. It looked like it would work well. We remember we could even model recursive co

Re: No job recovery after job manager failure

2015-12-16 Thread Ufuk Celebi
Hey Ali, can you send me the complete logs? I don’t think it’s possible via the mailing list. Just send it to my private email u...@apache.org. – Ufuk > On 16 Dec 2015, at 17:26, Kashmar, Ali wrote: > > Hi, > > I’m trying to test HA on a 3-node Flink cluster (task slots = 48). So I > start

Re: No job recovery after job manager failure

2015-12-16 Thread Ufuk Celebi
Hey Ali, can you send me the complete logs? I don’t think it’s possible via the mailing list. Just send it to my private email u...@apache.org. – Ufuk > On 16 Dec 2015, at 17:26, Kashmar, Ali wrote: > > Hi, > > I’m trying to test HA on a 3-node Flink cluster (task slots = 48). So I > start

No job recovery after job manager failure

2015-12-16 Thread Kashmar, Ali
Hi, I’m trying to test HA on a 3-node Flink cluster (task slots = 48). So I started a job with parallelism = 32 and waited for a few seconds so that all nodes are doing work. I then shut down the node that had the leader job manager, and by shut down I mean I powered off the virtual machine run

Flink shell in Jupyter

2015-12-16 Thread Gyula Fóra
Hey Guys, Has anyone tried to setup the Flink scala shell with Jupyter? I would assume the logic is similar to Zeppelin. The reason I am asking this because we have a Jupyter cluster that runs python and scala (2.11 I believe) and Spark works on it, so we figured it would be good to add support f

[DISCUSS] Time Behavior in Streaming Jobs (Event-time/processing-time)

2015-12-16 Thread Aljoscha Krettek
Hi, I thought a bit about how to improve the handling of time in Flink, mostly as it relates to windows. The problem is that mixing processing-time and event-time windows in one topology is very hard (impossible) right now. Let my explain it with this example: val env: StreamExecutionEnvironmen

[DISCUSS] Flink roadmap for 2016

2015-12-16 Thread Kostas Tzoumas
Hi everyone, I think it is very interesting to both developers and users of Flink to define a roadmap for future development. Together with Stephan, we started a draft containing a couple of areas that we think are important to focus on next. https://docs.google.com/document/d/1ExmtVpeVVT3TIhO1Jo

[jira] [Created] (FLINK-3178) Make Closing Behavior of Window Operators Configurable

2015-12-16 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3178: --- Summary: Make Closing Behavior of Window Operators Configurable Key: FLINK-3178 URL: https://issues.apache.org/jira/browse/FLINK-3178 Project: Flink Is

[jira] [Created] (FLINK-3177) Add Stream Operator that Discards Late Elements

2015-12-16 Thread Aljoscha Krettek (JIRA)
Aljoscha Krettek created FLINK-3177: --- Summary: Add Stream Operator that Discards Late Elements Key: FLINK-3177 URL: https://issues.apache.org/jira/browse/FLINK-3177 Project: Flink Issue Typ