Re: Regarding external metastore like HIVE

2018-07-03 Thread Rong Rong
+1 on this feature, there have been a lot of pains for us trying to connect to external catalog / metastore as well. @shivam can you comment on the tickets regarding the specific use case and the type of external catalogs you are interested ? Thanks, Rong On Tue, Jul 3, 2018 at 3:16 AM Shivam Sh

Re: Regarding external metastore like HIVE

2018-07-03 Thread Shivam Sharma
Thanks Timo, Fabian I will follow this. Best On Tue, Jul 3, 2018 at 3:01 PM Timo Walther wrote: > Hi, > > you can follow the progress here: > https://issues.apache.org/jira/browse/FLINK-9171 > > Regards, > Timo > > > Am 03.07.18 um 10:32 schrieb Fabian Hueske: > > Hi, > > The docs explain that

Re: Regarding external metastore like HIVE

2018-07-03 Thread Timo Walther
Hi, you can follow the progress here: https://issues.apache.org/jira/browse/FLINK-9171 Regards, Timo Am 03.07.18 um 10:32 schrieb Fabian Hueske: Hi, The docs explain that the ExternalCatalog interface *can* be used to implement a catalog for HCatalog or Metastore. However, there is no suc

Re: Regarding external metastore like HIVE

2018-07-03 Thread Fabian Hueske
Hi, The docs explain that the ExternalCatalog interface *can* be used to implement a catalog for HCatalog or Metastore. However, there is no such implementation in Flink yet. You would need to implement such as catalog connector yourself. I think there would be quite a few people interested in su

Re: Regarding external metastore like HIVE

2018-07-03 Thread Shivam Sharma
Hi, Please find the documentation link here: https://ci.apache.org/projects/flink/flink-docs-release-1.5/dev/table/common.html#register-an-external-catalog . Currently, Flink provides an InMemoryExternalCatalog for demo and testing > purposes. However, the ExternalCatalog interface can also be us

Re: Regarding external metastore like HIVE

2018-07-03 Thread Chuanlei Ni
@ashwin I cannot find the documention about `metastore` Could you give the reference? Ashwin Sinha 于2018年7月3日周二 下午4:08写道: > By metastore we mean catalog where table information is stored. > > On Tue 3 Jul, 2018, 13:23 Chesnay Schepler, wrote: > >> What do you mean with "Metastore"? Are you re

Re: Regarding external metastore like HIVE

2018-07-03 Thread Ashwin Sinha
By metastore we mean catalog where table information is stored. On Tue 3 Jul, 2018, 13:23 Chesnay Schepler, wrote: > What do you mean with "Metastore"? Are you referring to state backends > > ? > > On 02.07.20

Re: Regarding external metastore like HIVE

2018-07-03 Thread Chesnay Schepler
What do you mean with "Metastore"? Are you referring to state backends ? On 02.07.2018 18:41, Shivam Sharma wrote: Hi, I have read Flink documentation that Flink supports Metastore which is currently InMemor

Regarding external metastore like HIVE

2018-07-02 Thread Shivam Sharma
Hi, I have read Flink documentation that Flink supports Metastore which is currently InMemory. Is Flink community thinking to implement external Metastore like Hive? Thanks -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of Information Technology, Design and Manufacturing Jabalpur Mob