Re: how to write dataset in a file?

2015-11-22 Thread jun aoki
Hi Stephan, thank you for further explanation and clarification. The current behavior now makes sense to me. The hard part is, that those information is spread along documents. I have made a pull request to clarify the current behavior in the Javadoc. https://github.com/apache/flink/pull/1392 On

[jira] [Created] (FLINK-3059) Javadoc fix for DataSet.writeAsText()

2015-11-22 Thread jun aoki (JIRA)
jun aoki created FLINK-3059: --- Summary: Javadoc fix for DataSet.writeAsText() Key: FLINK-3059 URL: https://issues.apache.org/jira/browse/FLINK-3059 Project: Flink Issue Type: Bug Reporte

[jira] [Created] (FLINK-3058) Add Kafka consumer for new 0.9.0.0 Kafka API

2015-11-22 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-3058: - Summary: Add Kafka consumer for new 0.9.0.0 Kafka API Key: FLINK-3058 URL: https://issues.apache.org/jira/browse/FLINK-3058 Project: Flink Issue Type: New

Re: how to write dataset in a file?

2015-11-22 Thread Stephan Ewen
You can configure the system to always create a directly (not just on parallelism > 1), see "fs.output.always-create-directory"under https://ci.apache.org/projects/flink/flink-docs-release-0.10/setup/config.html#file-systems The behavior we support right now is pretty much what people coming from

Re: Storm Compatibility

2015-11-22 Thread Maximilian Michels
> > Multiple inputs per bolt is currently not supported. :( > FlinkTopologyBuilder has a bug. There is already a JIRA for it: > https://issues.apache.org/jira/browse/FLINK-2837 > > I know already how to fix it (hope to can get it into 0.10.1) I already have this working since a couple of days. Ju

[jira] [Created] (FLINK-3057) Provide a way to pass informaiton back to the plan

2015-11-22 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-3057: --- Summary: Provide a way to pass informaiton back to the plan Key: FLINK-3057 URL: https://issues.apache.org/jira/browse/FLINK-3057 Project: Flink Issue

Re: [DISCUSS] Release Flink 0.10.1 soon

2015-11-22 Thread Robert Metzger
It seems that we have merged all critical fixes into the release-0.10 branch. Since nobody else stepped up as a release manager, I'll do it again. It has been a while Lets see how the scripts have evolved ;) On Fri, Nov 20, 2015 at 2:21 PM, Matthias J. Sax wrote: > Nice. > > I just would nee

Re: Null Pointer Exception in tests but only in COLLECTION mode

2015-11-22 Thread Martin Junghanns
Hi, What he meant was MultipleProgramsTestBase, not FlinkTestBase. I debugged this a bit. The NPE is thrown in https://github.com/apache/flink/blob/master/flink-java/src/main/java/org/apache/flink/api/java/operators/AggregateOperator.java#L296 since current can be null if the input iterator i