Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Márton Balassi
Based on the requests listed in this thread Stephan and myself cherry-picked the following commits: 7634310 [FLINK-1266] Generalize DistributedFileSystem implementation (rmetzger) 40a2705 [FLINK-1266] Update mongodb link and address pull request comments (rmetzger) cd66ced [FLINK-1266] Properly pa

Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Ufuk Celebi
Thanks, Marton. Yes, I think https://issues.apache.org/jira/browse/FLINK-1376. Till has a fix coming up for it. Should we wait for this or postpone it to 0.8.1? – Ufuk On 12 Jan 2015, at 10:16, Márton Balassi wrote: > Based on the requests listed in this thread Stephan and myself > cherry-pic

Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Till Rohrmann
I only have to fix a last dead lock and then the fix should be working. On Mon, Jan 12, 2015 at 11:06 AM, Ufuk Celebi wrote: > Thanks, Marton. Yes, I think > https://issues.apache.org/jira/browse/FLINK-1376. > > Till has a fix coming up for it. Should we wait for this or postpone it to > 0.8.1?

Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Stephan Ewen
It would be good to have the patch, but it is also a very tricky patch, so pushing it hastily may be problematic. We could put out 0.8 and very soon a 0.8.1 with that fix. Am 12.01.2015 11:12 schrieb "Till Rohrmann" : > I only have to fix a last dead lock and then the fix should be working. > > O

Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Ufuk Celebi
On Mon, Jan 12, 2015 at 11:22 AM, Stephan Ewen wrote: > It would be good to have the patch, but it is also a very tricky patch, so > pushing it hastily may be problematic. > I agree. @Till: would that be OK with you? If yes, I think we are good to go for the next RC.

Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Till Rohrmann
Yeah I agree with that. On Mon, Jan 12, 2015 at 11:30 AM, Ufuk Celebi wrote: > On Mon, Jan 12, 2015 at 11:22 AM, Stephan Ewen wrote: > > > It would be good to have the patch, but it is also a very tricky patch, > so > > pushing it hastily may be problematic. > > > > I agree. @Till: would that b

Re: [VOTE] Release Apache Flink 0.8.0 (RC1)

2015-01-12 Thread Márton Balassi
Thanks, guys. FLINK-1376 goes to 0.8.1. I'm building the next release candidate for 0.8.0 then. On Mon, Jan 12, 2015 at 11:36 AM, Till Rohrmann wrote: > Yeah I agree with that. > > On Mon, Jan 12, 2015 at 11:30 AM, Ufuk Celebi wrote: > > > On Mon, Jan 12, 2015 at 11:22 AM, Stephan Ewen wrote:

Gather a distributed dataset

2015-01-12 Thread Alexander Alexandrov
Hi there, I wished for intermediate datasets, and Santa Ufuk made my wishes come true (thank you, Santa)! Now that FLINK-986 is in the mainline, I want to ask some practical questions. In Spark, there is a way to put a value from the local driver to the distributed runtime via val x = env.paral

Re: Type Hints in the Java API

2015-01-12 Thread Timo Walther
Thanks for the doc! I will add a complete list of all currently supported types (including Enums, Writables etc. not metioned in the doc) and types that will be supported in near future (e.g. multi-dimensional arrays). On 09.01.2015 17:37, Stephan Ewen wrote: Here is a doc that details type

Fwd: The Apache Software Foundation Announces Apache™ Flink™ as a Top-Level Project

2015-01-12 Thread Kostas Tzoumas
-- Forwarded message -- From: *Sally Khudairi* Date: Monday, January 12, 2015 Subject: The Apache Software Foundation Announces Apache™ Flink™ as a Top-Level Project To: Apache Announce List >> this announcement is available online at http://s.apache.org/YrZ Open Source distrib

RE: Gather a distributed dataset

2015-01-12 Thread Paris Carbone
Hello Alexander, Intermediate results are indeed looking promising, also for finally implementing a proper flink-shell for exploratory data analysis. We are also looking at the moment on how to implement a collect() for the flink-streaming scala api that returns a Seq that can be consumed at the

Re: Gather a distributed dataset

2015-01-12 Thread Ufuk Celebi
Hey Alexander, On 12 Jan 2015, at 11:42, Alexander Alexandrov wrote: > Hi there, > > I wished for intermediate datasets, and Santa Ufuk made my wishes come true > (thank you, Santa)! > > Now that FLINK-986 is in the mainline, I want to ask some practical > questions. > > In Spark, there is a

[jira] [Created] (FLINK-1387) Integrate website index.html into jekyll layout.

2015-01-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1387: - Summary: Integrate website index.html into jekyll layout. Key: FLINK-1387 URL: https://issues.apache.org/jira/browse/FLINK-1387 Project: Flink Issue Type:

Re: Gather a distributed dataset

2015-01-12 Thread Alexander Alexandrov
Thanks, I am currently looking at the new ExecutionEnvironment API. > I think Stephan is working on the scheduling to support this kind of programs. @Stephan: is there a feature branch for that somewhere? 2015-01-12 12:05 GMT+01:00 Ufuk Celebi : > Hey Alexander, > > On 12 Jan 2015, at 11:42, Al

[jira] [Created] (FLINK-1388) POJO support for writeAsCsv

2015-01-12 Thread Timo Walther (JIRA)
Timo Walther created FLINK-1388: --- Summary: POJO support for writeAsCsv Key: FLINK-1388 URL: https://issues.apache.org/jira/browse/FLINK-1388 Project: Flink Issue Type: New Feature Com

[jira] [Created] (FLINK-1389) Allow setting custom file extensions for files created by the FileOutputFormat

2015-01-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1389: - Summary: Allow setting custom file extensions for files created by the FileOutputFormat Key: FLINK-1389 URL: https://issues.apache.org/jira/browse/FLINK-1389 Projec

Flink @ Heise

2015-01-12 Thread Andreas Kunft
FYI http://www.heise.de/newsticker/meldung/Big-Data-Apache-Flink-wird-Top-Level-Projekt-2516177.html

Re: Flink @ Heise

2015-01-12 Thread Robert Metzger
Hey Andreas, thanks for sharing. Due to the press announcement by the ASF today, there is quite some attention in the news. For all non-germans: Heise is one of the biggest IT-news sites here. On Mon, Jan 12, 2015 at 3:10 PM, Andreas Kunft wrote: > FYI > > http://www.heise.de/newsticker/meldun

[jira] [Created] (FLINK-1390) java.lang.ClassCastException: X cannot be cast to X

2015-01-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1390: - Summary: java.lang.ClassCastException: X cannot be cast to X Key: FLINK-1390 URL: https://issues.apache.org/jira/browse/FLINK-1390 Project: Flink Issue Ty

[jira] [Created] (FLINK-1391) Kryo fails to properly serialize avro collection types

2015-01-12 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-1391: - Summary: Kryo fails to properly serialize avro collection types Key: FLINK-1391 URL: https://issues.apache.org/jira/browse/FLINK-1391 Project: Flink Issue

[VOTE] Release Apache Flink 0.8.0 (RC2)

2015-01-12 Thread Márton Balassi
Please vote on releasing the following candidate as Apache Flink version 0.8.0 This release will be the first major release for Flink as a top level project. - The commit to be voted on is in the branch "release-0.8.0-rc2" (commit 9ee74f

Re: Flink @ Heise

2015-01-12 Thread Henry Saputra
Thanks for sharing =) On Mon, Jan 12, 2015 at 6:10 AM, Andreas Kunft wrote: > FYI > > http://www.heise.de/newsticker/meldung/Big-Data-Apache-Flink-wird-Top-Level-Projekt-2516177.html

[jira] [Created] (FLINK-1392) Serializing Protobuf - issue 1

2015-01-12 Thread Felix Neutatz (JIRA)
Felix Neutatz created FLINK-1392: Summary: Serializing Protobuf - issue 1 Key: FLINK-1392 URL: https://issues.apache.org/jira/browse/FLINK-1392 Project: Flink Issue Type: Bug Repo

[jira] [Created] (FLINK-1393) Serializing Protobuf - issue 2

2015-01-12 Thread Felix Neutatz (JIRA)
Felix Neutatz created FLINK-1393: Summary: Serializing Protobuf - issue 2 Key: FLINK-1393 URL: https://issues.apache.org/jira/browse/FLINK-1393 Project: Flink Issue Type: Bug Repo