> By the way, if you want near-real-time tables with Hive, maybe you should
> have a look at this project from Uber: https://uber.github.io/hudi/
> I don't know how mature it is yet, but I think it aims at solving that kind
> of challenge.
Depending on your hive setup, you don't need a differe
Hi Chintan,
Yes, this sounds weird...
"REFRESH TABLES" is the kind of statement required by SQL engines such as
Impala, Presto or Spark-SQL that cache metadata from the Metastore, but
vanilla Hive usually don't cache it and query the metastore every time
(unless some new feature was added recentl
i never experienced such kind of issue. Once data is loaded to HDFS by sink,
the data is available in hive.
Sent from my iPhone
> On Aug 9, 2018, at 10:18, Chintan Patel wrote:
>
> Hello Will Du,
>
> I'm using Kafka connector to create hive database. All the data are stored in
> s3 bucket an
Hello Will Du,
I'm using Kafka connector to create hive database. All the data are stored
in s3 bucket and using mysql database for metastore.
For example If connector add new records in hive table and If I run query
It's not returning latest data and I have to run refresh table {table_name}
to c
any reason to do this?
Sent from my iPhone
> On Aug 9, 2018, at 07:57, Chintan Patel wrote:
>
> Hello,
>
> I want to refresh external type hive table metadata on some regular interval
> without using "refresh table {table_name}".
>
> Thanks & Regards
>
Hello,
I want to refresh external type hive table metadata on some regular
interval without using "refresh table {table_name}".
Thanks & Regards
