Re: insert data into hadoop / hive cluster

2019-01-02 Thread Daniel Takacs
Thanks the tools you pointed to were very interesting but I was hoping to achieve this with very little external dependencies. I was thinking of running a script, what do you think? CREATE TABLE IF NOT EXISTS dbname.finaltable(a string); SET hive.cli.errors.ignore=true; ALTER TABLE dbname.finalt

Re: adding parquet partitions to external table (msck repair table not working)

2019-01-02 Thread Vihang Karajgaonkar
What version of Hive are you using? You should look at the HS2 logs to see if there were any errors from msck command which ignored such partitions. Also, would be worth to take a look at hive.msck.path.validation configuration in case it is set to "ignore" which silently ignores invalidate partiti