Re: [DISCUSS] Proposed updates to Flink project site

Hi Mike, I like your proposal. It correctly tackles two things that beginners will appreciate: clearer structure and information about companies that are using Flink. Especially that last part is important because it's easier to adopt a new piece of software if you know that other big players are a

Re: [DISCUSS] Proposed updates to Flink project site

I really like your proposal. +1. I did some of the previous site updates, but never actually had the time to really think it through like you did. All main changes (start page, intro to Flink, and moving the quick starts) look very cool and well thought out. Looking forward to the initial PR. :

Re: [DISCUSS] Proposed updates to Flink project site

I agree with Aljoscha and Ufuk. Making the Flink website more accessible for newcomers would be a big gain :-) +1 for the changes. Cheers, Till On Tue, Nov 8, 2016 at 9:43 AM, Ufuk Celebi wrote: > I really like your proposal. +1. > > I did some of the previous site updates, but never actually h

Re: Could Not Submit Job DataStream Because No Connection to a JobManager

Hi David, the dev ML is intended for technical discussions about Flink. Problems related to the usage of Flink should go to the u...@flink.apache.org. Be aware that the ML does not allow attachments. Thus, we don't see your JobManager log. Cheers, Till On Mon, Nov 7, 2016 at 8:53 PM, daviD wrot

Re: [DISCUSS] Releasing Flink 1.1.4

The issue FLINK-4904 (Add a limit for how much data may be spilled in checkpoint alignments) is doen for master and I am currently backporting it. Hope to finish that this week... Stephan On Wed, Nov 2, 2016 at 5:03 PM, Till Rohrmann wrote: > It might make sense to backport > > - [FLINK-4944]

[jira] [Created] (FLINK-5033) CEP operators don't properly advance time

Till Rohrmann created FLINK-5033: Summary: CEP operators don't properly advance time Key: FLINK-5033 URL: https://issues.apache.org/jira/browse/FLINK-5033 Project: Flink Issue Type: Bug

Re: Could Not Submit Job DataStream Because No Connection to a JobManager

Ah! Thanks Till. Now I am better informed :) -daviD On Tuesday, November 8, 2016 2:14 AM, Till Rohrmann wrote: Hi David, the dev ML is intended for technical discussions about Flink. Problems related to the usage of Flink should go to the u...@flink.apache.org. Be aware that the ML doe

[jira] [Created] (FLINK-5034) Don't Write StateDescriptor to RocksDB Snapshot

Aljoscha Krettek created FLINK-5034: --- Summary: Don't Write StateDescriptor to RocksDB Snapshot Key: FLINK-5034 URL: https://issues.apache.org/jira/browse/FLINK-5034 Project: Flink Issue Typ

[jira] [Created] (FLINK-5035) Don't Write TypeSerializer to Heap State Snapshot

Aljoscha Krettek created FLINK-5035: --- Summary: Don't Write TypeSerializer to Heap State Snapshot Key: FLINK-5035 URL: https://issues.apache.org/jira/browse/FLINK-5035 Project: Flink Issue T

Re: [DISCUSS] Releasing Flink 1.1.4

I opened a pull request for the backport of [FLINK-4904] https://github.com/apache/flink/pull/2773 On Tue, Nov 8, 2016 at 2:00 PM, Stephan Ewen wrote: > The issue FLINK-4904 (Add a limit for how much data may be spilled in > checkpoint alignme

Left outer join

Hello, I'm facing an issue with leftOuterJoin: - input is a DataSet[String] - metrics is a DataSet[(String,Long)] I'm doing a leftOuterJoin like this: input .leftOuterJoin(metrics) .where(0) .equalTo(0) { (left,right) => ... } But I encounter the following error: Specifying keys via

Re: Left outer join

Hi Thomas, either you map your input data set into a tuple input.map(x => Tuple1(x)) or you specify a key selector leftOuterJoin(metrics).where(x => x).equalTo(0). I think the user ML u...@flink.apache.org would be a better place to ask Flink usage related questions. The dev ML is mainly used for

Re: Left outer join

This should work as well: input .leftOuterJoin(metrics) .where("*") .equalTo(0) { (left,right) => ... } 2016-11-08 23:10 GMT+01:00 Till Rohrmann : > Hi Thomas, > > either you map your input data set into a tuple input.map(x => Tuple1(x)) > or you specify a key selector leftOuterJoin(me

Re: [DISCUSS] Proposed updates to Flink project site

Hi Mike, Thanks for the proposal. It's a great idea to restructure the Flink web site. We have been adding more and more content to the site but it lacks structure. Especially new users would benefit from changes which make the web site more discoverable. >From the pdf, it looks like the main cha

Re: [DISCUSS] Add Side Input/Broadcast Set For Streaming API

Hi, all, we are also trying to find one way to do state initialization for stateful job, which has some external data stored in external storage. Side Input is a great feature meeting the requirement. I am looking forward to a full proposal including runtime implementations. 2016-11-01 21:52 GMT+0

Re: [DISCUSS] Proposed updates to Flink project site

Hi Mike, I really like the idea! Especially that you pointed out we need a substantial rework on the introduction page to let users that are new to modern streaming frameworks understand the space first. With this content as a prelude, once the detailed Flink contents kick in, it will definitel

[jira] [Created] (FLINK-5036) Perform the grouping of keys in restoring instead of checkpointing

Xiaogang Shi created FLINK-5036: --- Summary: Perform the grouping of keys in restoring instead of checkpointing Key: FLINK-5036 URL: https://issues.apache.org/jira/browse/FLINK-5036 Project: Flink