Riju Trivedi created HIVE-23058: ----------------------------------- Summary: Compaction task reattempt fails with FileAlreadyExistsException Key: HIVE-23058 URL: https://issues.apache.org/jira/browse/HIVE-23058 Project: Hive Issue Type: Bug Components: Hive Affects Versions: 3.1.0 Reporter: Riju Trivedi Assignee: Riju Trivedi
Issue occurs when compaction attempt is relaunched after first task attempt failure due to preemption by Scheduler or any other reason. Since _tmp directory was created by first attempt and was left uncleaned after task attempt failure. Second attempt of the the task fails with "FileAlreadyExistsException" exception. Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.FileAlreadyExistsException): /warehouse/tablespace/managed/hive/default.db/compaction_test/_tmp_3670bbef-ba7a-4c10-918d-9a2ee17cbd22/base_0000186/bucket_00005 for client 10.xx.xx.xxx already exists -- This message was sent by Atlassian Jira (v8.3.4#803005)