[
https://issues.apache.org/jira/browse/HIVE-26894?focusedWorklogId=836857&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-836857
]
ASF GitHub Bot logged work on HIVE-26894:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Jan/23 10:20
Start Date: 04/Jan/23 10:20
Worklog Time Spent: 10m
Work Description: warriersruthi opened a new pull request, #3909:
URL: https://github.com/apache/hive/pull/3909
###What changes were proposed in this pull request?
moveAcidFiles() method in Hive.java is modified to cater to the case where
the src FS and dest FS are different. Instead of rename() operation, in the
above case, we need to do copy().
###Why are the changes needed?
With the Jira: HIVE-26815, we can change the hive staging directory to be
the same as that of scratchdir. In that case, staging files will be in HDFS
while the target location would be blob or some other FS. In such scenarios,
while creating and updating ACID tables, the final rename operation was not
working fine (throws Wrong FS error) since the src and dest FS are different.
This is fixed in this patch by changing the rename() operation to copy() if FS
are in different encryption zones.
###Does this PR introduce any user-facing change?
Nope.
###How was this patch tested?
Tested with patch on hive 3.1.2
Issue Time Tracking
-------------------
Worklog Id: (was: 836857)
Time Spent: 40m (was: 0.5h)
> After using scratchdir for staging final job, CTAS and IOW on ACID tables are
> failing with wrongFS exception
> ------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-26894
> URL: https://issues.apache.org/jira/browse/HIVE-26894
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
> Affects Versions: 3.1.3
> Reporter: Sruthi M
> Assignee: Sruthi M
> Priority: Major
> Labels: pull-request-available
> Time Spent: 40m
> Remaining Estimate: 0h
>
> ERROR : Failed with exception Wrong FS:
> abfs://xxxxxxxx/hive/warehouse/managed/tpcds_orc.db/test_sales/delta_0000001_0000001_0000,
> expected: hdfs://mycluster
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
