Flink timestamps

2016-08-06 Thread Davood Rafiei
Hi, I want to assign timestamps to tuples when they enter source operator , get those timestamps in sink operator and extract them from current time and output. Basically my goal is to measure latency. To set timestamps in source operator I used: * env.setStreamTimeCharacteristic(TimeCharact

Re: Facing Issues while migrating to S3A

2016-08-06 Thread Stefan Richter
Hi, yes, it is only an issue on Windows because the system is using native functions and it seems your classpath lacks the Windows specific binary. Those functions are called from Java through JNI and their implementation for Windows is in some dll file that you need to put on your classpath. I

Flink 1.1 event-time windowing changes from 1.0.3

2016-08-06 Thread Adam Warski
Hello, I have a very simple stream where I window data using event-time. As a data source I’m using a CSV file, sorted by increasing timestamps. Here’s the source: val env = StreamExecutionEnvironment.getExecutionEnvironment env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime) val line

Re: Facing Issues while migrating to S3A

2016-08-06 Thread vinay patil
Hi Stefan, The migration from S3n to S3A is working fine when I try it on cluster (linux box), the issue is only with the local windows machine. I am not clear on this ,Can you please elaborate: *"The code of the native method should be contained in something like a HADOOP_HOME\bin\hadoop.dll"*

Re: Regarding QueryableState

2016-08-06 Thread vinay patil
Thanks Ufuk, will take a look at it. Regards, Vinay Patil On Thu, Aug 4, 2016 at 4:26 PM, Ufuk Celebi [via Apache Flink User Mailing List archive.] wrote: > You can expect it to be merged by the end of this week. > > Note that the APIs are very low level at the moment though. In the PR > branch