RE: StreamSQL procTime granularity

2017-04-06 Thread Stefano Bortoli
procTime granularity Hi Stefano, thanks for starting this discussion. I think treating processing time with a nanosecond resolution might be difficult for a few reasons: - We would need to treat it in all operators as nanotime (joins, etc.) - Flink does not provide tooling for nanotime resolution

Re: StreamSQL procTime granularity

2017-04-06 Thread Fabian Hueske
Hi Stefano, thanks for starting this discussion. I think treating processing time with a nanosecond resolution might be difficult for a few reasons: - We would need to treat it in all operators as nanotime (joins, etc.) - Flink does not provide tooling for nanotime resolution. The internal timer s

StreamSQL procTime granularity

2017-04-04 Thread Stefano Bortoli
Hi guys, Based on the discussion about time management in https://github.com/apache/flink/pull/3641 , does it make sense to use nanoTime for procTime semantic aggregation processing? This way we will not have the possibility of events falling in the same "millisecond" processing bucket and kee