Siddharth Seth created HIVE-10094:
-------------------------------------

             Summary: Investigate static cache instance used in SplitGrouper
                 Key: HIVE-10094
                 URL: https://issues.apache.org/jira/browse/HIVE-10094
             Project: Hive
          Issue Type: Task
    Affects Versions: 1.0.0
            Reporter: Siddharth Seth


{code}
private static final Map<Map<String, PartitionDesc>, Map<String, 
PartitionDesc>> cache =
      new HashMap<>();
{code}

Used by 
HiveFileFormatUtils.getPartitionDescFromPathRecursively(work.getPathToPartitionInfo(),
 path, cache);

Split generation happens in parallel - so this isn't thread safe. HIVE-9976 
moves it to a concurrent map.

Beyond this, a cache of Map to Map seems a little strange. Investigate whether 
this is working as intended.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to