Re: Hive Not Returning YARN Application Results Correctly Nor Inserting Into Local Tables

For the problem of not returning the result to the console, I think it occurs because the default file system is set to local file system, not to HDFS. Perhaps hive.exec.scratchdir is already set to /tmp/hive, but if the default file system is local, FileSinkOperator writes the final result to the

Re: INSERT OVERWRITE Failure Saftey

Thanks, Shawn. That was my suspicion but I'm glad to hear it from someone else. Do you have any links or documentation I can give to a manager to help them feel more confident in this? Also, I misspoke, I'm running Hive 1.2.1. Get Outlook for Android

Re: INSERT OVERWRITE Failure Saftey

I’m not sure specific to Hive 1.3 but in other versions the data is written to a temp location and then at the end of the query the previous data is deleted and the new data is renamed/moved. Something to watch out for is if the query returns no rows than the old data isn’t removed. Thanks Shaw

INSERT OVERWRITE Failure Saftey

All, I have a Hive 1.3 cluster running in production, and there was a question about INSERT OVERWRITE queries on tables. If I perform an INSERT OVERWRITE query on a table, and the query fails half way through, will the old data still exist in the table? I'm not completely clear on the exact pro

Hive Not Returning YARN Application Results Correctly Nor Inserting Into Local Tables

Hello all, I'm running a from-scratch cluster on AWS EC2. I have an external table (partitioned) defined with data on S3. I'm able to query this table and receive results to the console with a simple select * statement: ---