[
https://issues.apache.org/jira/browse/HIVE-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13620992#comment-13620992
]
Ashutosh Chauhan commented on HIVE-4078:
----------------------------------------
[~gopalv] Since other patches on which patch this was based are not
progressing, would you like to rebase this on trunk. Gains are impressive and
patch looks benign to me, so lets get this in.
> Delay the serialize-deserialize pair in CommonJoinTaskDispatcher
> ----------------------------------------------------------------
>
> Key: HIVE-4078
> URL: https://issues.apache.org/jira/browse/HIVE-4078
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Gopal V
> Assignee: Gopal V
> Labels: client, perfomance
> Attachments: HIVE-4078-20130305.2.patch, HIVE-4078-20130305.patch,
> HIVE-4078-20130406.patch
>
>
> CommonJoinProcessor tries to clone a MapredWork while attempting a conversion
> to a map-join
> {code}
> // deep copy a new mapred work from xml
> InputStream in = new ByteArrayInputStream(xml.getBytes("UTF-8"));
> MapredWork newWork = Utilities.deserializeMapRedWork(in,
> physicalContext.getConf());
> {code}
> which is a very heavy operation memory wise & cpu-wise.
> It would be better to do this only if a conditional task is required,
> resulting in a copy of the task.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
