Re: Java library for Flink-Kudu integration

2017-03-28 Thread Jinkui Shi
This make sense. Only one problem, bahir-flink is not very active. Maybe need more committee to pay some time on it, and have some new plan. We also plan to support carbondata[1] in bahir-flink. By the way, to keep the code base thin, can rewrite flink with Scala step by step until Flink 2.0 :))

Re: Java library for Flink-Kudu integration

2017-03-28 Thread Stephan Ewen
We are currently looking into how we can keep the size of the code base under control (because it is growing super large). Part is moving libraries into a dedicated subrepository (there is a separate mailing list thread on that) and some connectors to Bahir. Connectors can move between Flink and B

Re: Java library for Flink-Kudu integration

2017-03-28 Thread Fabian Hueske
No, we do not want to move all connectors to Apache Bahir or replace the connectors by Bahir. The Flink community aims to maintain the most important connectors within Flink. Maintaining all connectors would be a huge effort. So, we decided to move some of the less frequently used connectors to Ba

Re: Java library for Flink-Kudu integration

2017-03-27 Thread shijinkui
Hi, Fabian Do we have plan to replace Flink connectors with bahir-flink[1]? [1] https://github.com/apache/Bahir-flink 在 2017/3/28 上午12:15, "Fabian Hueske" 写入: >Hi Ruben, > >thanks for sharing this! >A Flink Kudu connector is a great contribution and Bahir seems to be the >right place for it. >

Re: Java library for Flink-Kudu integration

2017-03-27 Thread Fabian Hueske
Hi Ruben, thanks for sharing this! A Flink Kudu connector is a great contribution and Bahir seems to be the right place for it. Thanks, Fabian 2017-03-27 15:35 GMT+02:00 : > Hi all, > > I apologize for sending the email to both accounts, but not sure where > this topic fits better. > > In my t

Java library for Flink-Kudu integration

2017-03-27 Thread ruben.casado.tejedor
Hi all, I apologize for sending the email to both accounts, but not sure where this topic fits better. In my team, we have been working in some PoCs and PoVs about new data architectures. As part of this work, we have implemented a library to connect Kudu and Flink. The library allows reading/