Thanks Dawid for the link. I have a glance at the PR. I think we can continue the thrift format based on the PR (would be better to reach out to the author).
Best, Jark On Tue, 21 Jul 2020 at 15:58, Dawid Wysakowicz <dwysakow...@apache.org> wrote: > Hi, > > I've just spotted this PR that might be helpful in the discussion: > https://github.com/apache/flink/pull/8067 > > Best, > > Dawid > > On 20/07/2020 04:30, Benchao Li wrote: > > Hi Chen, > > > > Thanks for bringing up this discussion. We are doing something similar > > internally recently. > > > > Our use case is that many services in our company are built with > > thrift protocol, and we > > want to support accessing these RPC services natively with Flink SQL. > > Currently, there are two ways that we aim to support, they are thrift RPC > > Sink and thrift RPC > > temporal table (dimension table). > > Then our scenario is that we need to support both (de)ser with > > thrift format, and accessing > > the thrift RPC service. > > > > Jeff Zhang <zjf...@gmail.com> 于2020年7月19日周日 上午9:43写道： > > > >> Hi Chen, > >> > >> Right, this is what I mean. Could you provide more details about the > >> desr/ser work ? Giving a concrete example or usage scenario would be > >> helpful. > >> > >> > >> > >> Chen Qin <qinnc...@gmail.com> 于2020年7月18日周六 下午11:09写道： > >> > >>> Jeff, > >>> > >>> Are you referring something like this SPIP? > >>> > >>> > >> > https://docs.google.com/document/d/1ug4K5e2okF5Q2Pzi3qJiUILwwqkn0fVQaQ-Q95HEcJQ/edit#heading=h.x97c6tj78zo0 > >>> Not at this moment, we are working on desr/ser work at the moment. > Would > >> be > >>> good to starts discussion and learn if folks working on related areas > and > >>> align. > >>> > >>> Chen > >>> > >>> On Sat, Jul 18, 2020 at 6:41 AM Jeff Zhang <zjf...@gmail.com> wrote: > >>> > >>>> Hi Chen, > >>>> > >>>> Are building something like hive thrift server ? > >>>> > >>>> Chen Qin <qinnc...@gmail.com> 于2020年7月18日周六 上午8:50写道： > >>>> > >>>>> Hi there, > >>>>> > >>>>> Here in Pinterest, we utilize thrift end to end in our tech stack. As > >>> we > >>>>> have been building Flink as a service platform, the team spent time > >>>> working > >>>>> on supporting Flink jobs with thrift format and successfully > >> launched a > >>>>> good number of important jobs in Production in H1. > >>>>> > >>>>> In H2, we are looking at supporting Flink SQL with native Thrift > >>> support. > >>>>> We have some prototypes already running in development settings and > >>> plan > >>>> to > >>>>> move forward on this approach. > >>>>> > >>>>> In the long run, we thought out of box thrift format support would > >>>> benefit > >>>>> other folks as well. So the question is if there is already some > >> effort > >>>>> around this space we can sync with? > >>>>> > >>>>> Chen > >>>>> Pinterest Data > >>>>> > >>>> > >>>> -- > >>>> Best Regards > >>>> > >>>> Jeff Zhang > >>>> > >> > >> -- > >> Best Regards > >> > >> Jeff Zhang > >> > > > >
