--
Sender:Shuyi Chen
Sent at:2018 Nov 1 (Thu) 02:47
Recipient:Xuefu
Cc:vino yang ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Xuefu,
Thanks a lot for driving this big effort. I would suggest convert your
01:08
> Recipient:Xuefu ; Shuyi Chen
> Cc:yanghua1127 ; Fabian Hueske ;
> dev ; user
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> Hi all,
>
> To wrap up the discussion, I have attached a PDF describing the proposal,
> which is also attach
://issues.apache.org/jira/browse/FLINK-10556
--
Sender:Xuefu
Sent at:2018 Oct 16 (Tue) 03:40
Recipient:Shuyi Chen
Cc:yanghua1127 ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Shuyi,
Thank
Chen
Sent at:2018 Oct 14 (Sun) 08:30
Recipient:Xuefu
Cc:yanghua1127 ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Welcome to the community and thanks for the great proposal, Xuefu! I think the
proposal can be divided into 2 stages: makin
:Bowen
Sent at:2018 Oct 13 (Sat) 21:55
Recipient:Xuefu ; Fabian Hueske
Cc:dev ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Thank you Xuefu, for bringing up this awesome, detailed proposal! It will
resolve lots of existing pain for users like me.
In general, I tot
ns.
>
> Thanks,
> Xuefu
>
>
>
> --------------
> Sender:vino yang
> Sent at:2018 Oct 11 (Thu) 09:45
> Recipient:Fabian Hueske
> Cc:dev ; Xuefu ; user <
> user@flink.apache.org>
> Subject:Re: [DISC
use to connect to its thrift server
>> 10. Support other user's customizations in Hive, such as Hive Serdes,
>> storage handlers, etc.
>> 11. Better task failure tolerance and task scheduling at Flink runtime.
>>
>> As you can see, achieving all those requires signific
> Sender:Jörn Franke
> Sent at:2018 Oct 11 (Thu) 13:54
> Recipient:Xuefu
> Cc:vino yang ; Fabian Hueske ; dev
> ; user
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> Would it maybe make sense to provide Flink as an engine o
06
> Recipient:Xuefu
> Cc:Rong Rong ; Timo Walther ;
> dev ; jornfranke ; vino yang <
> yanghua1...@gmail.com>; Fabian Hueske ; user <
> user@flink.apache.org>
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
> One other thought on the same
o Walther ; dev
; jornfranke ; vino yang
; Fabian Hueske ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
One other thought on the same lines was to use hive tables to store kafka
information to process streaming tables. Something like
"create table streaming_tabl
at Flink
>> provides. It's usually the servicer owner who provides drivers to their
>> services. We weren't talking about JDBC/ODBC driver to external DB systems.
>>
>> Let me know if you have further questions.
>>
>> Thanks,
>> Xuefu
>>
>> -----
> Sender:Rong Rong
> Sent at:2018 Oct 12 (Fri) 01:52
> Recipient:Timo Walther
> Cc:dev ; jornfranke ; Xuefu <
> xuef...@alibaba-inc.com>; vino yang ; Fabian
> Hueske ; user
> Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
>
>
Sender:Rong Rong
Sent at:2018 Oct 12 (Fri) 01:52
Recipient:Timo Walther
Cc:dev ; jornfranke ; Xuefu
; vino yang ; Fabian Hueske
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Xuefu,
Thanks for putting together the overview. I would like to add some mo
;> all layers in Flink. However, a short-term goal could include only core
>> areas (such as 1, 2, 4, 5, 6, 7) or start at a smaller scope (such as #3,
>> #6).
>>
>> Please share your further thoughts. If we generally agree that this is the
>> right direction, I could come up with a formal proposal quickly and then we
>> can follow up wit
nificant effort and
> across all layers in Flink. However, a short-term goal could include only
> core areas (such as 1, 2, 4, 5, 6, 7) or start at a smaller scope (such as
> #3, #6).
> >>
> >> Please share your further thoughts. If we generally agree that this is
> the rig
feedback.
Thanks,
Xuefu
--
Sender:Jörn Franke
Sent at:2018 Oct 11 (Thu) 13:54
Recipient:Xuefu
Cc:vino yang ; Fabian Hueske ; dev
; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Would it maybe make sense to provide Flink as an engine on Hive
(„flink
irection, I could come up with a formal proposal quickly and then we can
follow up with broader discussions.
Thanks,
Xuefu
--
Sender:vino yang
Sent at:2018 Oct 11 (Thu) 09:45
Recipient:Fabian Hueske
Cc:dev ; Xuefu ; use
n we
> can follow up with broader discussions.
>
> Thanks,
> Xuefu
>
>
>
> ------
> Sender:vino yang
> Sent at:2018 Oct 11 (Thu) 09:45
> Recipient:Fabian Hueske
> Cc:dev ; Xuefu ; user
>
> Subject:R
d then we can
follow up with broader discussions.
Thanks,
Xuefu
--
Sender:vino yang
Sent at:2018 Oct 11 (Thu) 09:45
Recipient:Fabian Hueske
Cc:dev ; Xuefu ; user
Subject:Re: [DISCUSS] Integrate Flink SQL well with Hive ecosystem
Hi Xuefu,
Hi Xuefu,
Appreciate this proposal, and like Fabian, it would look better if you can
give more details of the plan.
Thanks, vino.
Fabian Hueske 于2018年10月10日周三 下午5:27写道：
> Hi Xuefu,
>
> Welcome to the Flink community and thanks for starting this discussion!
> Better Hive integration would be re
Hi Xuefu,
Welcome to the Flink community and thanks for starting this discussion!
Better Hive integration would be really great!
Can you go into details of what you are proposing? I can think of a couple
ways to improve Flink in that regard:
* Support for Hive UDFs
* Support for Hive metadata cat
Hi all,
Along with the community's effort, inside Alibaba we have explored Flink's
potential as an execution engine not just for stream processing but also for
batch processing. We are encouraged by our findings and have initiated our
effort to make Flink's SQL capabilities full-fledged. When c
22 matches
Mail list logo
