Re: [DISCUSS] Access to Time and Window in Streaming Operations

2015-05-13 Thread Bruno Cadonna
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, Aljoscha originally wanted to discuss whether it is necessary to make information about the event time of an element and information about windows in which it resides accessible to the user. I guess, we all agree that this information is neces

Re: [DISCUSS] Access to Time and Window in Streaming Operations

2015-05-13 Thread Stephan Ewen
Okay, I thought that this thread is about how to make timestamps and window information of a record accessible to the user code. This involves how represent the information in which window a record is, whether to attach it to that records, etc The semantics of what happens if you have multiple win

Re: [DISCUSS] Access to Time and Window in Streaming Operations

2015-05-13 Thread Gyula Fóra
I think this is that thread :) But as I said it is just a matter of what we want to add, and we can already do it. On Wed, May 13, 2015 at 11:37 AM, Stephan Ewen wrote: > This is a pretty central question, actually (timestamping the results of > windows). Let us kick off a separate thread for t

Re: [DISCUSS] Access to Time and Window in Streaming Operations

2015-05-13 Thread Stephan Ewen
This is a pretty central question, actually (timestamping the results of windows). Let us kick off a separate thread for this... On Wed, May 13, 2015 at 9:20 AM, Bruno Cadonna < cado...@informatik.hu-berlin.de> wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > Hi, > > I think timestamp

Re: [DISCUSS] Access to Time and Window in Streaming Operations

2015-05-13 Thread Bruno Cadonna
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, I think timestamping results of a time window operator is essential. Without timestamps in the results, it is not possible to execute two time window operators one after the other. Cheers, Bruno On 12.05.2015 18:30, Aljoscha Krettek wrote: > Hi,

Re: [DISCUSS] Access to Time and Window in Streaming Operations

2015-05-12 Thread Gyula Fóra
Hi, This was the exact need that motivated me to rework the windowing and introduce the StreamWindow abstraction which can hold any metadata that represents the current window. At this moment it only contains a unique id but this could be extended easily. When the user created a windoweddatastrea

[DISCUSS] Access to Time and Window in Streaming Operations

2015-05-12 Thread Aljoscha Krettek
Hi, I'll try to make it quick this time. I think we need to make information about the event time of an element and information about windows in which it resides accessible to the user. A simple example would be the aggregation of some user behaviour, for example: in = clickSource() analysedData