Re: [DISCUSS] Towards a leaner flink-dist

2019-01-25 Thread Hequn Cheng
Hi Chesnay, Thanks a lot for the proposal! +1 for a leaner flink-dist and improve the "Download" page. I think a leaner flink-dist would be very helpful. If we bundle all jars into a single one, this will easily cause class conflict problem. Best, Hequn On Fri, Jan 25, 2019 at 2:48 PM jincheng

Re: Ratelimiting in the Flink Kafka connector

2019-01-25 Thread Ning Shi
> We have a Flink job reading from Kafka (specifically it uses > FlinkKafkaConsumer011). There are instances when the job is processing a > backlog and it ends up reading at a significantly high throughput and > degrades the underlying Kafka cluster. If there was a way to rate limit the > calls to

Re: Ratelimiting in the Flink Kafka connector

2019-01-25 Thread Nagarjun Guraja
Have you looked at Kafka quotas( https://kafka.apache.org/0110/documentation.html#design_quotas) to achieve rate limiting on the consumer side? In your flink app, you should be able to set the client.id and configure kafka to rate limit you. Regards, Nagarjun *Success is not final, failure is not

Ratelimiting in the Flink Kafka connector

2019-01-25 Thread Lakshmi Gururaja Rao
Hey all, We have a Flink job reading from Kafka (specifically it uses FlinkKafkaConsumer011). There are instances when the job is processing a backlog and it ends up reading at a significantly high throughput and degrades the underlying Kafka cluster. If there was a way to rate limit the calls to

Re: [DISCUSS] FLIP-32: Restructure flink-table for future contributions

2019-01-25 Thread fudian . fd
Hi Timo, Thanks a lot for bringing up the discussion and the detailed implementation plan. The implementation plan makes much sense to me. +1 to the FLIP. Regards, Dian > 在 2019年1月25日,下午11:00,Jark Wu 写道: > > Hi Timo, > > Thanks for the detailed design. +1 for the FLIP. > > It's very nice t

Re: [DISCUSS] FLIP-32: Restructure flink-table for future contributions

2019-01-25 Thread Jark Wu
Hi Timo, Thanks for the detailed design. +1 for the FLIP. It's very nice to have Blink planner and runtime as a plugin in the early stages. This will keep flink-table stable as much as possible. Best, Jark On Fri, 25 Jan 2019 at 22:26, Hequn Cheng wrote: > Hi Timo, > > +1 for the FLIP! > > G

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-01-25 Thread Kostas Tzoumas
+1 great idea! On Fri, Jan 25, 2019 at 11:28 AM Till Rohrmann wrote: > +1, I like this idea very much. > > On Fri, Jan 25, 2019 at 5:38 AM Jark Wu wrote: > > > a big +1 to this! > > > > An user-zh mailing list will help more Chinese speaking users and there > > will be more people willing to h

Re: [DISCUSS] FLIP-32: Restructure flink-table for future contributions

2019-01-25 Thread Hequn Cheng
Hi Timo, +1 for the FLIP! Great work and thanks a lot for the detailed document! The task dependency graph is very helpful for teasing out relationships between tasks. Looking forward to the JIRAs and hoping to contribute to it! Best, Hequn On Fri, Jan 25, 2019 at 7:54 PM Piotr Nowojski wrote

Re: [DISCUSS] FLIP-32: Restructure flink-table for future contributions

2019-01-25 Thread Piotr Nowojski
Hi, +1 from my side for this plan. The proposed decoupling TypeSystem and most interface (TableSource/Sinks, UDFs, Catalogs, …) discussions from the of merging MVP Blink's runtime gives us best shot of handling Blink merging as fluently and as painless as possible. I’m also looking forward to t

[jira] [Created] (FLINK-11433) JOIN on a table having a column of type MULTISET gives a NPE

2019-01-25 Thread Elias Saalmann (JIRA)
Elias Saalmann created FLINK-11433: -- Summary: JOIN on a table having a column of type MULTISET gives a NPE Key: FLINK-11433 URL: https://issues.apache.org/jira/browse/FLINK-11433 Project: Flink

Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

2019-01-25 Thread Till Rohrmann
+1, I like this idea very much. On Fri, Jan 25, 2019 at 5:38 AM Jark Wu wrote: > a big +1 to this! > > An user-zh mailing list will help more Chinese speaking users and there > will be more people willing to help answer questions who want to contribute > for Flink. > It's exciting to see the com

Best way to create 1000 patterns programmatically

2019-01-25 Thread dhanuka ranasinghe
Hi All, I tried to do $Subject and end up with with below and it's highly inefficient. Could you please suggest better solution. [image: CEP-loop-multiple-patterns.png] Cheers, Dhanuka -- Nothing Impossible,Creativity is more important than knowledge.