Re: [DISCUSS] proposal for the User Defined AGGregate (UDAGG)

2017-01-21 Thread Shaoxuan Wang
Hi Fabian, Thanks for the carefully checking on the proposal. Yes, code generation is in my plan. As shown in "2.3 UDAGG interface", the input and return types of the new proposed UDAGG functions are dynamically given by the users ("[user defined xxx inputs/types]"). All embed built-in functions fo

[jira] [Created] (FLINK-5602) Migration with RocksDB job led to NPE for next checkpoint

2017-01-21 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5602: -- Summary: Migration with RocksDB job led to NPE for next checkpoint Key: FLINK-5602 URL: https://issues.apache.org/jira/browse/FLINK-5602 Project: Flink Issue Typ

[jira] [Created] (FLINK-5601) Window operator does not checkpoint watermarks

2017-01-21 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5601: -- Summary: Window operator does not checkpoint watermarks Key: FLINK-5601 URL: https://issues.apache.org/jira/browse/FLINK-5601 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-5600) Improve error message when triggering savepoint without specified directory

2017-01-21 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5600: -- Summary: Improve error message when triggering savepoint without specified directory Key: FLINK-5600 URL: https://issues.apache.org/jira/browse/FLINK-5600 Project: Flink

Re: Unregistering Managed State in Operator Backend

2017-01-21 Thread Paris Carbone
Thank you for the answer Ufuk! To elaborate a bit more, I am not using keyed state, it would be indeed tricky in that case to discard everything. I need that for operator state, in my loop fault tolerance PR [1]. The idea is to tag a ListState (upstream log) per snapshot id. When a concurent s

Re: Taking time off

2017-01-21 Thread Ufuk Celebi
I totally did not see this email. Sorry! Thanks for all your hard work and the great discussions on and offline. I learned a lot from you in the past two years! Looking forward to seeing you again on the mailing lists in the future. – Ufuk On Sat, Jan 21, 2017 at 4:49 PM, Paris Carbone wrote: >

Re: Unregistering Managed State in Operator Backend

2017-01-21 Thread Ufuk Celebi
Hey Paris! As far as I know it's not possible at the moment and not planned. Does not sound to hard to add though. @Stefan: correct? You can currently only clear the state via #clear in the scope of the key for keyed state or the whole operator when used with operator state. In case of keyed stat

[jira] [Created] (FLINK-5599) State interface docs often refer to keyed state only

2017-01-21 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5599: -- Summary: State interface docs often refer to keyed state only Key: FLINK-5599 URL: https://issues.apache.org/jira/browse/FLINK-5599 Project: Flink Issue Type: Im

Re: Taking time off

2017-01-21 Thread Paris Carbone
Thanks for all the cool contributions on Flink and Beam! Keep rockin' in the distr systems space :) Paris > On 21 Jan 2017, at 00:53, Fabian Hueske wrote: > > Hi Max, > > Thanks for all your efforts! > Hope to see you back soon. > > Take care, Fabian > > > 2017-01-16 11:22 GMT+01:00 Vasilik