Hi,
If you set your stream to use event time (i.e.
env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime); )
I think you can use all functions in the system without modification. So
there is no need for any custom window assigners.
If you then put microseconds into the timestamp field the y
Thanks for clearing things up, Stephan and Kostas
On Mon, Dec 5, 2016 at 8:08 AM, Kostas Kloudas
wrote:
> Hi Jeff,
>
> As Stephan said the interpretation of the timestamps is up to the logic of
> your job.
> And as for the documentation, thanks for reporting this.
> We should update it.
>
> Chee
Hi Jeff,
As Stephan said the interpretation of the timestamps is up to the logic of your
job.
And as for the documentation, thanks for reporting this.
We should update it.
Cheers,
Kostas
> On Dec 5, 2016, at 1:56 PM, Stephan Ewen wrote:
>
> @Jeff - good point about the docs.
>
> I think Kos
@Jeff - good point about the docs.
I think Kostas is right though - the event timestamps are up to the user's
interpretation.
The built-in window assigners interpret them as "Unix Epoch Millis", but
you can define your own window assigners that interpret the timestamps
differently.
The system int
Thanks Kostas. So if we're comfortable treating timestamps as longs (and
doing conversions to human readable time at our application level), we can
use CEP, ML lib etc. in addition to all basic Flink functions? That's great
news?
To Matthias's point, *why then does the following not read "**Both
t
Hi Jeff,
Actually in Flink timestamps are simple longs.
This means that you can assign anything you want as a timestamp, as long as it
fits in a long.
Hope this helps and if not, we can discuss to see if we can find a solution
that
fits your needs together.
Cheers,
Kostas
> On Dec 4, 2016, a
Wow. Really? Is there a way to do micros? A hack? A Jira story? Most (all?)
U.S. equity and European futures, options, and stock markets timestamp in
microseconds. This makes Flink unusable for a massive industry vertical. To
the extent lower-frequency time-series data is being used (e.g. end of da
Help Matthias
Can you please take a look at my question over at stack overflow and see if
you have an answer
http://stackoverflow.com/questions/40935714/is-it-possible-to-add-new-patterns-in-flink-cep-after-calling-execute
Abdallah.
On Dec 4, 2016 11:27 PM, "Matthias J. Sax" wrote:
> -BEGIN
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA512
Oh. My bad... Did not read your question carefully enough.
Than the answer is no, it does not support microseconds (only
milliseconds).
- -Matthias
On 12/4/16 2:22 PM, jeff jacobson wrote:
> Sorry if I'm missing something. That link mentions mill
Sorry if I'm missing something. That link mentions milliseconds, no? My
question is whether or not I can specify microseconds where
1000microseconds = 1millisecond. Thanks!
On Sun, Dec 4, 2016 at 5:05 PM, Matthias J. Sax wrote:
> Yes. It does.
>
> See:
> https://ci.apache.org/projects/flink/flin
Yes. It does.
See:
https://ci.apache.org/projects/flink/flink-docs-release-1.1/apis/streaming/event_timestamps_watermarks.html#assigning-timestamps
"Both timestamps and watermarks are specified as millliseconds since the
Java epoch of 1970-01-01T00:00:00Z."
-Matthias
On 12/04/2016 10:57 AM,
I've sourced stackoverflow, the docs, and the web but I can't figure out:
does flink support microsecond timestamp resolution? Thanks!
12 matches
Mail list logo
