Re: [DISCUSS] Handling event-time in continuous file processing.

2016-12-09 Thread Fabian Hueske
Hi Kostas, I think it would be good to open two JIRAs to track these issues: 1) to document the shortcomings of the current solution 2) propose a solution based on your idea of group-ids. Would you like to do that? Thanks, Fabian 2016-12-01 10:48 GMT+01:00 Fabian Hueske : > Hi Kostas, > > Tha

[jira] [Created] (FLINK-5304) Change method name from crossApply to join in Table API

2016-12-09 Thread Jark Wu (JIRA)
Jark Wu created FLINK-5304: -- Summary: Change method name from crossApply to join in Table API Key: FLINK-5304 URL: https://issues.apache.org/jira/browse/FLINK-5304 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-5305) Documentation of collect() should mention parameter akka.framesize

2016-12-09 Thread Arnaud Linz (JIRA)
Arnaud Linz created FLINK-5305: -- Summary: Documentation of collect() should mention parameter akka.framesize Key: FLINK-5305 URL: https://issues.apache.org/jira/browse/FLINK-5305 Project: Flink

Re: [DISCUSS] Merging the FLIP-6 feature branch into the Master branch

2016-12-09 Thread Stephan Ewen
I would be +1 to merge the FLIP-6 branch to the master branch after the 1.2 branch is forked off, if we manage to do that in a timely fashion. Would actually be safer that way... On Tue, Dec 6, 2016 at 8:49 PM, Robert Metzger wrote: > I've reactivated the 1.2 release thread and the actual list

Re: [DISCUSS] Merging the FLIP-6 feature branch into the Master branch

2016-12-09 Thread Till Rohrmann
I agree with Stephan. +1 for merging it after forking 1.2 off and trying to do this in the near future. Cheers, Till On Fri, Dec 9, 2016 at 11:50 AM, Stephan Ewen wrote: > I would be +1 to merge the FLIP-6 branch to the master branch after the 1.2 > branch is forked off, if we manage to do that

[jira] [Created] (FLINK-5306) Display checkpointing configuration details in web UI "Configuration" tab

2016-12-09 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-5306: - Summary: Display checkpointing configuration details in web UI "Configuration" tab Key: FLINK-5306 URL: https://issues.apache.org/jira/browse/FLINK-5306 Project: Fl

[jira] [Created] (FLINK-5307) Log configuration for every reporter

2016-12-09 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-5307: --- Summary: Log configuration for every reporter Key: FLINK-5307 URL: https://issues.apache.org/jira/browse/FLINK-5307 Project: Flink Issue Type: Bug

Re: Flink survey by data Artisans

2016-12-09 Thread Mike Winters
Hi everyone, A quick heads-up that we'll be closing the Flink user survey to new responses this coming Monday 12 Dec around 9am EST. If you'd still like to respond before Monday, you can do so here: http://www.surveygizmo.com/s3/3166399/181bdb611f22. We've seen more than 100 responses so far. Th

[jira] [Created] (FLINK-5308) download links to previous releases are incomplete

2016-12-09 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-5308: -- Summary: download links to previous releases are incomplete Key: FLINK-5308 URL: https://issues.apache.org/jira/browse/FLINK-5308 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5309) documentation links on the home page point to 1.2-SNAPSHOT

2016-12-09 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-5309: -- Summary: documentation links on the home page point to 1.2-SNAPSHOT Key: FLINK-5309 URL: https://issues.apache.org/jira/browse/FLINK-5309 Project: Flink Issue Ty

[jira] [Created] (FLINK-5310) Harden the RocksDB JNI library loading

2016-12-09 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5310: --- Summary: Harden the RocksDB JNI library loading Key: FLINK-5310 URL: https://issues.apache.org/jira/browse/FLINK-5310 Project: Flink Issue Type: Improvement

Re: 1.2-SNAPSHOT documentation

2016-12-09 Thread Maximilian Michels
Hi Ken, The first issue you reported is a corrupt Ruby configuration we can't do much about. The JavaDocs are not generated correctly because of malformed JavaDoc: https://ci.apache.org/builders/flink-docs-master/builds/551/steps/Java%20%26%20Scala%20docs/logs/stdio We will have to go through the

Re: Reg. custom sinks in Flink

2016-12-09 Thread Shannon Carey
You haven't really added a sink in Flink terminology, you're just performing a side effect within a map operator. So while it may work, if you want to add a sink proper you need have an object that extends SinkFunction or RichSinkFunction. The method call on the stream should be ".addSink(…)".

Reg. custom sinks in Flink

2016-12-09 Thread Meghashyam Sandeep V
Hi there, I have a flink streaming app where my source is Kafka and a custom sink to Cassandra(I can't use standard C* sink that comes with flink as I have customized auth to C*). I'm currently have the following: messageStream .rebalance() .map( s-> { return mapper.readValu

Re: Reg. custom sinks in Flink

2016-12-09 Thread Meghashyam Sandeep V
Thanks a lot for the quick reply Shannon. 1. I will create a class that extends SinkFunction and write my connection logic there. My only question here is- will a dbSession be created for each message/partition which might affect the performance? Thats the reason why I added this line to create a

[jira] [Created] (FLINK-5311) Write user documentation for BipartiteGraph

2016-12-09 Thread Ivan Mushketyk (JIRA)
Ivan Mushketyk created FLINK-5311: - Summary: Write user documentation for BipartiteGraph Key: FLINK-5311 URL: https://issues.apache.org/jira/browse/FLINK-5311 Project: Flink Issue Type: Bug

How to merge messages from all partitions

2016-12-09 Thread Naveen Tirupattur
HI, I am trying to group messages by message name, timestamp and then perform aggregation on message value. My window function looks like below metrics.keyBy("metricName") .keyBy("timeStamp") .timeWindow(Time.seconds(30)) .trigger(ProcessingTimeTrigger.create()) .fold(new Tuple3(

Re: [Discuss] FLIP-13 Side Outputs in Flink

2016-12-09 Thread Chen Qin
Dear Flink community members, Please review and comment on https://github.com/apache/flink/pull/2982. Thanks, Chen -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Discuss-FLIP-13-Side-Outputs-in-Flink-tp14204p14938.html Sent from the Apache Flin