Re: Creating a slide set for a Flink intro talk

2018-10-12 Thread jincheng sun
@Fabian Hueske Thanks for create the slide. I think it is very important for the construction of the flink ecosystem. The content of the slide outline is very comprehensive. I think these are the things that the user wants to know. I will leave suggestions about detail. We continue to discuss it i

Re: Spreading Tasks across TaskManagers

2018-10-12 Thread Thomas Weise
Hi Till, Thanks for the pointer, glad that this is being worked on. It almost looks like the non deterministic distribution behavior started with 1.5.x (?) and that surprised us. https://issues.apache.org/jira/browse/BEAM-5713 I agree that there is no one strategy that fits every use case. If a

[jira] [Created] (FLINK-10542) Register Hive metastore as an external catalog in TableEnvironment

2018-10-12 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created FLINK-10542: --- Summary: Register Hive metastore as an external catalog in TableEnvironment Key: FLINK-10542 URL: https://issues.apache.org/jira/browse/FLINK-10542 Project: Flink

Re: Creating a slide set for a Flink intro talk

2018-10-12 Thread Shuyi Chen
Thanks a lot, Fabian. That's very useful. I made a quick pass and made a few suggestions. I like the use cases/users section. One general comment I have is that the slides seems emphasizing streaming in the first overview slides, but only mention batch here and there not consistently. In my opinion

Creating a slide set for a Flink intro talk

2018-10-12 Thread Fabian Hueske
Hi everybody, I'm currently creating a slide set for a Flink intro talk [1]. The content will be mostly based on pages of the recently updated website * Main page [2] * What is Apache Flink? [3] * Use cases [4] * Powered By [5] The idea is to have a good set of slides that anybody can use to giv

[jira] [Created] (FLINK-10541) Removed unused code of LocalFlinkMiniCluster

2018-10-12 Thread TisonKun (JIRA)
TisonKun created FLINK-10541: Summary: Removed unused code of LocalFlinkMiniCluster Key: FLINK-10541 URL: https://issues.apache.org/jira/browse/FLINK-10541 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-10540) Remove legacy LocalFlinkMiniCluster

2018-10-12 Thread TisonKun (JIRA)
TisonKun created FLINK-10540: Summary: Remove legacy LocalFlinkMiniCluster Key: FLINK-10540 URL: https://issues.apache.org/jira/browse/FLINK-10540 Project: Flink Issue Type: Sub-task Affects

[jira] [Created] (FLINK-10539) Support specific namespace in QueryableStateClient

2018-10-12 Thread Jiayi Liao (JIRA)
Jiayi Liao created FLINK-10539: -- Summary: Support specific namespace in QueryableStateClient Key: FLINK-10539 URL: https://issues.apache.org/jira/browse/FLINK-10539 Project: Flink Issue Type: Ne

[jira] [Created] (FLINK-10538) standalone-job.sh causes Classpath issues

2018-10-12 Thread Razvan (JIRA)
Razvan created FLINK-10538: -- Summary: standalone-job.sh causes Classpath issues Key: FLINK-10538 URL: https://issues.apache.org/jira/browse/FLINK-10538 Project: Flink Issue Type: Bug Compo

Re: Become a contributor

2018-10-12 Thread Zhang, Xuefu
Thank you very much, Fabian! It seems working for me now. Regards, Xuefu -- Sender:Fabian Hueske Sent at:2018 Oct 12 (Fri) 15:45 Recipient:dev ; Xuefu Subject:Re: Become a contributor Hi Xuefu, I gave (hopefully) your Jira user

[jira] [Created] (FLINK-10537) Network throughput performance regression after broadcast changes

2018-10-12 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-10537: -- Summary: Network throughput performance regression after broadcast changes Key: FLINK-10537 URL: https://issues.apache.org/jira/browse/FLINK-10537 Project: Flink

Re: Spreading Tasks across TaskManagers

2018-10-12 Thread Till Rohrmann
Hi Max, the community is currently working on Flink's scheduler component [1]. One of the things we want to enable in the future is bulk scheduling. With this, it should also be possible to add strategies how to distribute tasks across multiple TMs (spreading vs. co-locating). In general, I'm not

Re: Become a contributor

2018-10-12 Thread Fabian Hueske
Hi Xuefu, I gave (hopefully) your Jira user (xuefuz) Contributor permissions for Flink's Jira. You can now assign issues to yourself. Best, Fabian Am Fr., 12. Okt. 2018 um 01:18 Uhr schrieb Zhang, Xuefu < xuef...@alibaba-inc.com>: > Hi there, > > Could anyone kindly add me as a contributor to F

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-12 Thread Jörn Franke
Thank you very nice , I fully agree with that. > Am 11.10.2018 um 19:31 schrieb Zhang, Xuefu : > > Hi Jörn, > > Thanks for your feedback. Yes, I think Hive on Flink makes sense and in fact > it is one of the two approaches that I named in the beginning of the thread. > As also pointed out the

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-12 Thread Taher Koitawala
Sounds smashing; I think the initial integration will help 60% or so flink sql users and a lot other use cases will emerge when we solve the first one. Thanks, Taher Koitawala On Fri 12 Oct, 2018, 10:13 AM Zhang, Xuefu, wrote: > Hi Taher, > > Thank you for your input. I think you emphasized

[jira] [Created] (FLINK-10536) Flink Kinesis Consumer leading to job failure due to ProvisionedThroughputExceededException

2018-10-12 Thread Ravi Bhushan Ratnakar (JIRA)
Ravi Bhushan Ratnakar created FLINK-10536: - Summary: Flink Kinesis Consumer leading to job failure due to ProvisionedThroughputExceededException Key: FLINK-10536 URL: https://issues.apache.org/jira/browse/