Siddharth Seth created HIVE-10094: ------------------------------------- Summary: Investigate static cache instance used in SplitGrouper Key: HIVE-10094 URL: https://issues.apache.org/jira/browse/HIVE-10094 Project: Hive Issue Type: Task Affects Versions: 1.0.0 Reporter: Siddharth Seth
{code} private static final Map<Map<String, PartitionDesc>, Map<String, PartitionDesc>> cache = new HashMap<>(); {code} Used by HiveFileFormatUtils.getPartitionDescFromPathRecursively(work.getPathToPartitionInfo(), path, cache); Split generation happens in parallel - so this isn't thread safe. HIVE-9976 moves it to a concurrent map. Beyond this, a cache of Map to Map seems a little strange. Investigate whether this is working as intended. -- This message was sent by Atlassian JIRA (v6.3.4#6332)