Re: Guide for Flink Source/Sinks

2016-05-10 Thread Till Rohrmann
Yes I did. Sorry my bad. On May 11, 2016 7:31 AM, "Aljoscha Krettek" wrote: > I think Till mistyped, sinks are always parallel, you don't need the > ParallelSinkFunction. > > On Tue, 10 May 2016 at 18:56 M Singh wrote: > > > Hi Till, Folks: > > I found ParallelSourceFunction/RichParallelSourceFu

Re: Guide for Flink Source/Sinks

2016-05-10 Thread Aljoscha Krettek
I think Till mistyped, sinks are always parallel, you don't need the ParallelSinkFunction. On Tue, 10 May 2016 at 18:56 M Singh wrote: > Hi Till, Folks: > I found ParallelSourceFunction/RichParallelSourceFunctions in the > flink-streaming-java_2.10 module (1.1-SNAPSHOT), but could not find > Par

[jira] [Created] (FLINK-3897) why does jobmanager process has too many ForkJoinTask object

2016-05-10 Thread ZhengBowen (JIRA)
ZhengBowen created FLINK-3897: - Summary: why does jobmanager process has too many ForkJoinTask object Key: FLINK-3897 URL: https://issues.apache.org/jira/browse/FLINK-3897 Project: Flink Issue T

Re: Guide for Flink Source/Sinks

2016-05-10 Thread M Singh
Hi Till, Folks: I found ParallelSourceFunction/RichParallelSourceFunctions in the flink-streaming-java_2.10 module (1.1-SNAPSHOT), but could not find ParallelSinkFunction et. al.  Am I missing anything ? Thanks On Tuesday, May 10, 2016 5:31 AM, M Singh wrote: Thanks Till for the poi

[jira] [Created] (FLINK-3896) Allow a StreamTask to be Externally Cancelled.

2016-05-10 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-3896: - Summary: Allow a StreamTask to be Externally Cancelled. Key: FLINK-3896 URL: https://issues.apache.org/jira/browse/FLINK-3896 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-3894) Remove Program Packaging via Plans

2016-05-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3894: --- Summary: Remove Program Packaging via Plans Key: FLINK-3894 URL: https://issues.apache.org/jira/browse/FLINK-3894 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-3895) Remove Focs for Program Packaging via Plans

2016-05-10 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-3895: --- Summary: Remove Focs for Program Packaging via Plans Key: FLINK-3895 URL: https://issues.apache.org/jira/browse/FLINK-3895 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-3893) LeaderChangeStateCleanupTest times out

2016-05-10 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3893: - Summary: LeaderChangeStateCleanupTest times out Key: FLINK-3893 URL: https://issues.apache.org/jira/browse/FLINK-3893 Project: Flink Issue Type: Bu

[jira] [Created] (FLINK-3892) ConnectionUtils may die with NullPointerException

2016-05-10 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3892: - Summary: ConnectionUtils may die with NullPointerException Key: FLINK-3892 URL: https://issues.apache.org/jira/browse/FLINK-3892 Project: Flink Iss

Re: Guide for Flink Source/Sinks

2016-05-10 Thread M Singh
Thanks Till for the pointers. Mans On Tuesday, May 10, 2016 1:07 AM, Till Rohrmann wrote: Hi Mans,there is no explicit guide for how to write a custom source/sink as far as I know. There is just a paragraph in the data sources section (https://ci.apache.org/projects/flink/flink-docs-m

[jira] [Created] (FLINK-3891) Add a class containing all supported Table API types

2016-05-10 Thread Timo Walther (JIRA)
Timo Walther created FLINK-3891: --- Summary: Add a class containing all supported Table API types Key: FLINK-3891 URL: https://issues.apache.org/jira/browse/FLINK-3891 Project: Flink Issue Type:

[jira] [Created] (FLINK-3890) Deprecate streaming mode flag from Yarn CLI

2016-05-10 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3890: - Summary: Deprecate streaming mode flag from Yarn CLI Key: FLINK-3890 URL: https://issues.apache.org/jira/browse/FLINK-3890 Project: Flink Issue Typ

[jira] [Created] (FLINK-3889) Make File Monitoring Function checkpointable.

2016-05-10 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-3889: - Summary: Make File Monitoring Function checkpointable. Key: FLINK-3889 URL: https://issues.apache.org/jira/browse/FLINK-3889 Project: Flink Issue Type: Sub

Re: [VOTE] Release Apache Flink 1.0.3 (RC3)

2016-05-10 Thread Fabian Hueske
Forwarding my vote from RC2. +1 to release. I checked: - building from source (mvn clean install) OK - no dependencies added or modified OK - hashes OK - signatures OK Cheers, Fabian 2016-05-10 12:06 GMT+02:00 Gyula Fóra : > + 1 from me > > Ufuk Celebi ezt írta (időpont: 2016. máj. 9., H, 10:

Re: [VOTE] Release Apache Flink 1.0.3 (RC3)

2016-05-10 Thread Gyula Fóra
+ 1 from me Ufuk Celebi ezt írta (időpont: 2016. máj. 9., H, 10:25): > Dear Flink community, > > Please vote on releasing the following candidate as Apache Flink version > 1.0.3. > > The commit to be voted on: > f3a6b5f1e8d85d10e1449e2f96291408b781 > > Branch: > release-1.0.3-rc3 (see > > ht

[PROPOSAL] Structure the Flink Open Source Development

2016-05-10 Thread Stephan Ewen
Hi everyone! We propose to establish some lightweight structures in the Flink open source community and development process, to help us better handle the increased interest in Flink (mailing list and pull requests), while not overwhelming the committers, and giving users and contributors a good ex

Re: Guide for Flink Source/Sinks

2016-05-10 Thread Till Rohrmann
Hi Mans, there is no explicit guide for how to write a custom source/sink as far as I know. There is just a paragraph in the data sources section ( https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/#data-sources ). For sources you have to implement the SourceFunction interface

Re: Service frontend as a source and sink

2016-05-10 Thread Till Rohrmann
Hi Maxim, Flink does not execute the operators in the JobManager but the TaskManager. The JobManager's role is the orchestration of the Flink job. Unfortunately, there is currently no way to explicitly control the deployment of tasks to TaskManagers with different roles. However, Flink supports s