[jira] [Created] (HIVE-18215) Possible code optimization exists for "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)

[Steve Yeom (JIRA)]

Steve Yeom created HIVE-18215:
---------------------------------

             Summary: Possible code optimization exists for "INSERT OVERWITE on 
MM table. SELECT FROM (SELECT .. UNION ALL SELECT ..)
                 Key: HIVE-18215
                 URL: https://issues.apache.org/jira/browse/HIVE-18215
             Project: Hive
          Issue Type: Bug
          Components: HiveServer2
    Affects Versions: 3.0.0
            Reporter: Steve Yeom
            Priority: Minor
             Fix For: 3.0.0


removeTempOrDuplicateFiles(.) has an opportunity for performance code 
optimization for the 
test case of "INSERT OVERWITE on MM table. SELECT FROM (SELECT .. UNION ALL 
SELECT ..)" from dp_counter_mm.q.

This is MM table specific and we can avoid calling fs.exists() by creating a 
specific mmDirectories
list for the current SELECT statement (out of two SELECTs in our test case from 
the dp_counter_mm.q) from the IOW union all query.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)