Re: IOException when trying flink-twitter example

2016-02-21 Thread ram kumar
tried running the TwitterFilterSourceExample as java application, works fine. facing issue when submitting as flink. looking into flink libraries On Wed, Feb 17, 2016 at 8:22 PM, Stephan Ewen wrote: > Looks like an issue with the Twitter Client. > > Maybe the log reveals more that can help you f

Re: Use jvm to run flink on single-node machine with many cores

2016-02-21 Thread Márton Balassi
Dear Ana, If you are using a single machine with multiple cores, but need convenient access to the configuration I would personally recommend using the local cluster option in the flink distribution. [1] If you want to avoid having a flink distro on the machine, then Robert's solution is the way t

Re: Use jvm to run flink on single-node machine with many cores

2016-02-21 Thread Robert Metzger
Hi Ana, you can create a StreamExecutionEnvironment also by passing a configuration object. In the configuration, you can also configure the number of network buffers. // set up the execution environmentConfiguration conf = new Configuration(); conf.setBoolean("taskmanager.network.numberOfBuffer

Use jvm to run flink on single-node machine with many cores

2016-02-21 Thread Ana M. Martinez
Hi all, I am trying to run a program using the flink java library with ExecutionEnvironment.getExecutionEnvironment() from the command line using java -jar. If I run the code in my machine (with four cores) or in a multi-node cluster (using yarn) the program runs normally, but if I want to run

Re: Trying to comprehend rolling windows + event time

2016-02-21 Thread Nirmalya Sengupta
Hello Alex , Many thanks for the explanation. '5 different windows' - that's the key. I missed that completely. Thanks for plugging the hole; I think I understand the behaviour better now. I will follow your code-snippet (gist). A lot more thanks for sharing write-up by Tyler Akidau! Those are

Re: Finding the average temperature

2016-02-21 Thread Till Rohrmann
Hi Nirmalya, if you want to calculate the running average over all measurements independent of the probe ID, then you cannot parallelize the computation. In this case you have to use a global window. Cheers, Till On Feb 19, 2016 6:30 PM, "Nirmalya Sengupta" wrote: > Hello Aljoscha , > > My sin

Re: Trying to comprehend rolling windows + event time

2016-02-21 Thread Aljoscha Krettek
Hi, yes in version 0.10.x there is a final implicit Long.MAX_VALUE watermark that flushes out at the end. We are changing this for the 1.0 release because this behaviour can be unexpected. On Sat, Feb 20, 2016, 17:32 lofifnc wrote: > Hi, > > You're right, expect that ("grace", "arctic", 25) is e