SkewJoin should report progress while writing skew keys to HDFS
---------------------------------------------------------------

                 Key: HIVE-2641
                 URL: https://issues.apache.org/jira/browse/HIVE-2641
             Project: Hive
          Issue Type: Improvement
            Reporter: Namit Jain


RowContainer.copyToDFSDirectory is used to write the skew keys to HDFS. But 
this can take a long time, and while it is happening, the MR framework does not 
see progress from the reducer. The code should do the copy in smaller unit and 
report progress to the MR framework

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to