Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-31 Thread Zhang, Xuefu
mentations. What do you think? Shuyi On Tue, Oct 30, 2018 at 11:32 AM Zhang, Xuefu wrote: Hi all, I have also shared a design doc on Hive metastore integration that is attached here and also to FLINK-10556[1]. Please kindly review and share your feedback. Thanks, Xuefu [1] https://issues.apach

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-24 Thread Zhang, Xuefu
k with the Calcite community, and a recent effort called babel (https://issues.apache.org/jira/browse/CALCITE-2280) in Calcite might help here. Thanks Shuyi On Wed, Oct 10, 2018 at 8:02 PM Zhang, Xuefu wrote: Hi Fabian/Vno, Thank you very much for your encouragement inquiry. Sorry that I

Re: Java Table API and external catalog bug?

2018-10-22 Thread Zhang, Xuefu
Have you tried "t2" instead of "test.t2"? There is a possibility that catalog name isn't part of the table name in the table API. Thanks, Xuefu -- Sender:Flavio Pompermaier Sent at:2018 Oct 22 (Mon) 23:06 Recipient:user Subject:J

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-15 Thread Zhang, Xuefu
might need to work with the Calcite community, and a recent effort called babel (https://issues.apache.org/jira/browse/CALCITE-2280) in Calcite might help here. Thanks Shuyi On Wed, Oct 10, 2018 at 8:02 PM Zhang, Xuefu wrote: Hi Fabian/Vno, Thank you very much for your encouragement inquiry.

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-15 Thread Zhang, Xuefu
to it to move FlinkSQL's adoption and ecosystem even further. Thanks, Bowen 在 2018年10月12日,下午3:37,Jörn Franke 写道: Thank you very nice , I fully agree with that. Am 11.10.2018 um 19:31 schrieb Zhang, Xuefu : Hi Jörn, Thanks for your feedback. Yes, I think Hive on Flink makes sense

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-11 Thread Zhang, Xuefu
batch; This way we could completely get rid of Flink SQL configuration files. Thanks, Taher Koitawala Integrating On Fri 12 Oct, 2018, 2:35 AM Zhang, Xuefu, wrote: Hi Rong, Thanks for your feedback. Some of my earlier comments might have addressed some of your points, so here I'd like t

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-11 Thread Zhang, Xuefu
eavour as independent projects (hive > engine, connector) to avoid too tight coupling with Flink. Maybe in a more > distant future if the Hive integration is heavily demanded one could then > integrate it more tightly if needed. > > What is meant by 11? >> Am 11.

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-11 Thread Zhang, Xuefu
e Hive integration is heavily demanded one could then > integrate it more tightly if needed. > > What is meant by 11? >> Am 11.10.2018 um 05:01 schrieb Zhang, Xuefu : >> >> Hi Fabian/Vno, >> >> Thank you very much for your encouragement inquiry. Sorry that I d

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-11 Thread Zhang, Xuefu
Endeavour as independent projects (hive engine, connector) to avoid too tight coupling with Flink. Maybe in a more distant future if the Hive integration is heavily demanded one could then integrate it more tightly if needed. What is meant by 11? Am 11.10.2018 um 05:01 schrieb Zhang, Xuefu : Hi Fa

Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-10 Thread Zhang, Xuefu
n you go into details of what you are proposing? I can think of a couple ways to improve Flink in that regard: * Support for Hive UDFs * Support for Hive metadata catalog * Support for HiveQL syntax * ??? Best, Fabian Am Di., 9. Okt. 2018 um 19:22 Uhr schrieb Zhang, Xuefu : Hi all, Along wit

[DISCUSS] Integrate Flink SQL well with Hive ecosystem

2018-10-09 Thread Zhang, Xuefu
Hi all, Along with the community's effort, inside Alibaba we have explored Flink's potential as an execution engine not just for stream processing but also for batch processing. We are encouraged by our findings and have initiated our effort to make Flink's SQL capabilities full-fledged. When c