Re: Time-stamp of output from a window operator

2017-12-22 Thread Eron Wright
That is correct, the window operator happily accepts late elements into the applicable window(s). Though the element is late (with respect to the current watermark) it might still be included in the main firing, or provoke a late firing. Elements occurring downstream of an operator that uses late

Re: Time-stamp of output from a window operator

2017-12-22 Thread Jagadish
Thanks for the super-helpful reply! Would the late-firing from the "hourly" window be considered an on-time arrival for the subsequent "daily" window operator? Since, its windowing duration is much longer (1 day), I'd expect the "on-time/default" result emitted from the "daily" window to include

Re: Flink-Yarn-Kerberos integration

2017-12-22 Thread Eron Wright
I agree that it is reasonable to use Hadoop DTs as you describe. That approach is even recommended in YARN's documentation (see Securing Long-lived YARN Services on the YARN Application Security page). But one of the goals of Kerberos integration is to support Kerberized data access for connecto

[jira] [Created] (FLINK-8311) Flink needs documentation for network access control

2017-12-22 Thread Elias Levy (JIRA)
Elias Levy created FLINK-8311: - Summary: Flink needs documentation for network access control Key: FLINK-8311 URL: https://issues.apache.org/jira/browse/FLINK-8311 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-8310) Flink 1.4 Column 'rowtime' not found in any table

2017-12-22 Thread Xuan Nguyen (JIRA)
Xuan Nguyen created FLINK-8310: -- Summary: Flink 1.4 Column 'rowtime' not found in any table Key: FLINK-8310 URL: https://issues.apache.org/jira/browse/FLINK-8310 Project: Flink Issue Type: Bug

Re: Time-stamp of output from a window operator

2017-12-22 Thread Eron Wright
Each event in the stream has an associated timestamp as metadata. A timestamp assigner simply extracts the timestamp from the user object for that purpose. There is no per-operator watermark, but with `assignTimestampsAndWatermarks` you may insert an operator that overrides upstream watermarks.

[jira] [Created] (FLINK-8309) JVM sigsegv crash when enabling async checkpoints

2017-12-22 Thread Kevin Pullin (JIRA)
Kevin Pullin created FLINK-8309: --- Summary: JVM sigsegv crash when enabling async checkpoints Key: FLINK-8309 URL: https://issues.apache.org/jira/browse/FLINK-8309 Project: Flink Issue Type: Bug

Re: Can I make my contributions to apache flink as a committer now?

2017-12-22 Thread Fabian Hueske
Hi Zhentaowang, no, you have not become a Flink committer. Flink committers are nominated by the Flink PMC (same applies to any Apache project). Before a person is proposed as a committer by a Flink PMC member and accepted by the PMC as a committer, the person should have made valuable contributi

Can I make my contributions to apache flink as a committer now?

2017-12-22 Thread ??????
Hi! I doubt whether I have been a Flink committer. Is there anything else I have to do before I become a Flink committer? I would be grateful if you could help me. Warm Regards, -- zhentaowang Big data r&d engineer, Quantum gold clothing co. LTD -- --

[jira] [Created] (FLINK-8308) Update yajl-ruby dependency to 1.3.1 or higher

2017-12-22 Thread Fabian Hueske (JIRA)
Fabian Hueske created FLINK-8308: Summary: Update yajl-ruby dependency to 1.3.1 or higher Key: FLINK-8308 URL: https://issues.apache.org/jira/browse/FLINK-8308 Project: Flink Issue Type: Task