rename output error during hive query on AWSs3-external table

2020-02-04 Thread Souvikk Roy
Hello, We are using some external tables backed by aws S3. And we are intermittently getting this error, most likely at the last stage of the reduce, I see some similar posts in net but could not find any solution, Is there any way yo solve it: org.apache.hadoop.hive.ql.metadata.HiveException: Un

msck repair table internally

2020-05-27 Thread Souvikk Roy
Hi all, May be it is a common knowledge. Can anyone tell whether "msck repair table" also spawns multiple mappers like entity (or multiple processes) to perform. We have a large external table to migrate from one hive to another, hence we need to create it in the new hive and then repair it. Bef