Re: Taking time off

2017-01-20 Thread Fabian Hueske
Hi Max, Thanks for all your efforts! Hope to see you back soon. Take care, Fabian 2017-01-16 11:22 GMT+01:00 Vasiliki Kalavri : > Hi Max, > > thank you for all your work! Enjoy your time off and hope to have you back > with us soon ^^ > > Cheers, > -Vasia. > > On 14 January 2017 at 09:03, Maxi

Re: [DISCUSS] (Not) tagging reviewers

2017-01-20 Thread Fabian Hueske
Hi Haohui, reviewing pull requests is a great way of contributing to the community! I am not aware of specific instructions for the review process. The are some dos and don'ts on our "contribute code" page [1] that should be considered. Apart from that, I think the best way to start is to become

[jira] [Created] (FLINK-5598) Return jar name when jar is uploaded

2017-01-20 Thread Sendoh (JIRA)
Sendoh created FLINK-5598: - Summary: Return jar name when jar is uploaded Key: FLINK-5598 URL: https://issues.apache.org/jira/browse/FLINK-5598 Project: Flink Issue Type: Improvement Compon

Re: [DISCUSS] proposal for the User Defined AGGregate (UDAGG)

2017-01-20 Thread Fabian Hueske
Hi Shaoxuan, thanks a lot for this great design doc. I think user defined aggregation functions are a very important feature for the Table API and SQL. Have you thought about how the aggregation functions will be embedded in Flink functions? At the moment, we have a generic Flink function which i

Re: [DISCUSS] Improvements to flink's cost based optimizer

2017-01-20 Thread Fabian Hueske
Hi Kurt, thanks for breaking down the overall into smaller tasks and creating the corresponding JIRA issues. Using default estimates for unknown tables can be quite risky, especially for statistics like cardinality. In this cases collecting basic stats while writing the input (i.e., a arbitrary D

Re: [DISCUSS] (Not) tagging reviewers

2017-01-20 Thread jincheng sun
I totally agree with all of your ideas. Best wishes, SunJincheng. Stephan Ewen 于2017年1月16日 周一19:42写道: > Hi! > > > > I have seen that recently many pull requests designate reviews by writing > > "@personA review please" or so. > > > > I am personally quite strongly against that, I thi

Need help on understanding flink runtime and window function

2017-01-20 Thread Fritz Budiyanto
Hi Flink Dev, I’m new to Flink and have a few questions below: 1. I’m trying to understand Flink runtime on the server side, and couldn’t figure out where the code which execute the window function sum below. I wanted to put a break point but got lost in the code base. Could someone shed a ligh

[jira] [Created] (FLINK-5597) Improve the LocalClusteringCoefficient documentation

2017-01-20 Thread Vasia Kalavri (JIRA)
Vasia Kalavri created FLINK-5597: Summary: Improve the LocalClusteringCoefficient documentation Key: FLINK-5597 URL: https://issues.apache.org/jira/browse/FLINK-5597 Project: Flink Issue Type

[jira] [Created] (FLINK-5596) Add padding to nav menu on mobile site

2017-01-20 Thread Mike Winters (JIRA)
Mike Winters created FLINK-5596: --- Summary: Add padding to nav menu on mobile site Key: FLINK-5596 URL: https://issues.apache.org/jira/browse/FLINK-5596 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5595) Add links to sub-sections in the left-hand navigation bar

2017-01-20 Thread Mike Winters (JIRA)
Mike Winters created FLINK-5595: --- Summary: Add links to sub-sections in the left-hand navigation bar Key: FLINK-5595 URL: https://issues.apache.org/jira/browse/FLINK-5595 Project: Flink Issue T

[jira] [Created] (FLINK-5594) Use higher-resolution graphic on Flink project site homepage

2017-01-20 Thread Mike Winters (JIRA)
Mike Winters created FLINK-5594: --- Summary: Use higher-resolution graphic on Flink project site homepage Key: FLINK-5594 URL: https://issues.apache.org/jira/browse/FLINK-5594 Project: Flink Iss

[jira] [Created] (FLINK-5593) Modify current dcos-flink implementation to use runit service

2017-01-20 Thread Vijay Srinivasaraghavan (JIRA)
Vijay Srinivasaraghavan created FLINK-5593: -- Summary: Modify current dcos-flink implementation to use runit service Key: FLINK-5593 URL: https://issues.apache.org/jira/browse/FLINK-5593 Proje

Re: [DISCUSS] (Not) tagging reviewers

2017-01-20 Thread Haohui Mai
Hi, Usually this problem can be well addressed by growing the community. We Just wondering whether there is a wiki to describe how non-committers can help on reviewing the patches? I'm glad to help out on reviewing patches. Regards, Haohui On Fri, Jan 20, 2017 at 7:42 AM Stephan Ewen wrote: >

Unregistering Managed State in Operator Backend

2017-01-20 Thread Paris Carbone
Hi folks, I have a little question regarding the managed store operator backend, in case someone can help. Is there some convenient way (planned or under development) to completely unregister a state entry (e.g. a ListState) with a given id from the backend? It is fairly easy to register new s

Re: [DISCUSS] (Not) tagging reviewers

2017-01-20 Thread Stephan Ewen
@Alexey - Pull Requests backlog is going pretty crazy, I agree. That is not because the committers are not working on pull requests, there is simply so many of them. We are looking for new committers (and discussing in the PMC). Tagging is not going to make this better, I believe. It may make it

[jira] [Created] (FLINK-5592) Wrong number of RowSerializers with nested Rows in Collection mode

2017-01-20 Thread Anton Solovev (JIRA)
Anton Solovev created FLINK-5592: Summary: Wrong number of RowSerializers with nested Rows in Collection mode Key: FLINK-5592 URL: https://issues.apache.org/jira/browse/FLINK-5592 Project: Flink

Re: [DISCUSS] Proposed updates to Flink project site

2017-01-20 Thread Ufuk Celebi
If you like you could also open JIRA issues for these points with a note about the discussion here. That way we make sure that we don't forget about our feedback. – Ufuk On 20 January 2017 at 12:02:14, Mike Winters (mwi...@gmail.com) wrote: > > Yes, thanks to all for helping! There are still so

[jira] [Created] (FLINK-5591) queryable state: request failures failing on the server side do not contain client stack trace

2017-01-20 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-5591: -- Summary: queryable state: request failures failing on the server side do not contain client stack trace Key: FLINK-5591 URL: https://issues.apache.org/jira/browse/FLINK-5591

[jira] [Created] (FLINK-5590) Create a proper internal state hierarchy

2017-01-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5590: --- Summary: Create a proper internal state hierarchy Key: FLINK-5590 URL: https://issues.apache.org/jira/browse/FLINK-5590 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5588) Add a unit scaler based on different norms

2017-01-20 Thread Stavros Kontopoulos (JIRA)
Stavros Kontopoulos created FLINK-5588: -- Summary: Add a unit scaler based on different norms Key: FLINK-5588 URL: https://issues.apache.org/jira/browse/FLINK-5588 Project: Flink Issue Ty

[jira] [Created] (FLINK-5589) Tumbling group windows on batch tables do not consider object reuse

2017-01-20 Thread Timo Walther (JIRA)
Timo Walther created FLINK-5589: --- Summary: Tumbling group windows on batch tables do not consider object reuse Key: FLINK-5589 URL: https://issues.apache.org/jira/browse/FLINK-5589 Project: Flink

[jira] [Created] (FLINK-5587) AsyncWaitOperatorTest timed out on Travis

2017-01-20 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-5587: -- Summary: AsyncWaitOperatorTest timed out on Travis Key: FLINK-5587 URL: https://issues.apache.org/jira/browse/FLINK-5587 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-5586) Extend TableProgramsTestBase for object reuse modes

2017-01-20 Thread Timo Walther (JIRA)
Timo Walther created FLINK-5586: --- Summary: Extend TableProgramsTestBase for object reuse modes Key: FLINK-5586 URL: https://issues.apache.org/jira/browse/FLINK-5586 Project: Flink Issue Type: I

Re: States split over to external storage

2017-01-20 Thread Stephan Ewen
There are works on different approaches of incremental policies underways (more soon in some design proposals), but the point raised here sounded different to me. Maybe Chen Qin can describe in some more detail what he was having in mind... On Fri, Jan 20, 2017 at 12:15 PM, liuxinchun wrote: >

答复: States split over to external storage

2017-01-20 Thread liuxinchun
What's more I make a little change in WindowOperator for ListState in https://issues.apache.org/jira/browse/FLINK-5572 发件人:Stephan Ewen 收件人:dev 抄送:iuxinc...@huawei.com,Aljoscha Krettek,时金魁 时间:2017-01-20 18:35:46 主题:Re: States split over to external storage Hi! This is an interesting suggestion

Re: States split over to external storage

2017-01-20 Thread liuxinchun
I think the current backup strategy checkpoints the while whindow everytime,when the window size is very large, it's time and storage consuming. An increamental policy should be consided. Sent from HUAWEI AnyOffice 发件人:Stephan Ewen 收件人:dev@flink.apache.org, 抄送:iuxinc...@huawei.com,Aljoscha Krett

Re: [DISCUSS] Proposed updates to Flink project site

2017-01-20 Thread Mike Winters
Yes, thanks to all for helping! There are still some comments / ideas from this thread (such as a navigation with sub-menus, a cleaner nav menu on the mobile site, reworking some of the information-dense pages) that I think should be addressed but haven't been yet, and so I'll be making updates on

Re: States split over to external storage

2017-01-20 Thread Fabian Hueske
If I got it correctly, part of the motivation is to move rarely used / cold state to an external storage (please correct me if I'm wrong). 2017-01-20 11:35 GMT+01:00 Stephan Ewen : > Hi! > > This is an interesting suggestion. > Just to make sure I understand it correctly: Do you design this for c

Re: States split over to external storage

2017-01-20 Thread Stephan Ewen
Hi! This is an interesting suggestion. Just to make sure I understand it correctly: Do you design this for cases where the state per machine is larger than that machines memory/disk? And in that case, you cannot solve the problem by scaling out (having more machines)? Stephan On Tue, Jan 17, 20

[jira] [Created] (FLINK-5585) NullPointer Exception in JobManager.updateAccumulators

2017-01-20 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-5585: --- Summary: NullPointer Exception in JobManager.updateAccumulators Key: FLINK-5585 URL: https://issues.apache.org/jira/browse/FLINK-5585 Project: Flink Issue Type

Re: Flink with Yarn on MapR

2017-01-20 Thread Robert Metzger
Hi Aniket, The first error you are reporting is not a big deal. I think there are some whitespaces or so in the default flink config file that cause the parser to print the message. The second one is tougher to fix. It seems that there is an issue with loading the Hadoop configuration correctly.