[
https://issues.apache.org/jira/browse/HIVE-1511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13761532#comment-13761532
]
Ashutosh Chauhan commented on HIVE-1511:
----------------------------------------
Thanks Leo for taking a look. As I noted in
https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13713048&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13713048
we see substantial gains in serialization times. Also, apart from performance,
Brock has found that xml based serialization has issues on other platforms.
See,
https://issues.apache.org/jira/browse/HIVE-1511?focusedCommentId=13755143&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13755143
So, in addition to performance we want to move to Kryo for that as well.
For your suggestions w.r.t further improving perf, we will start taking look at
those after this one gets in.
> Hive plan serialization is slow
> -------------------------------
>
> Key: HIVE-1511
> URL: https://issues.apache.org/jira/browse/HIVE-1511
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 0.7.0, 0.11.0
> Reporter: Ning Zhang
> Assignee: Mohammad Kamrul Islam
> Attachments: failedPlan.xml, generated_plan.xml, HIVE-1511.10.patch,
> HIVE-1511.11.patch, HIVE-1511.12.patch, HIVE-1511.13.patch,
> HIVE-1511.14.patch, HIVE-1511.16.patch, HIVE-1511.17.patch,
> HIVE-1511.4.patch, HIVE-1511.5.patch, HIVE-1511.6.patch, HIVE-1511.7.patch,
> HIVE-1511.8.patch, HIVE-1511.9.patch, HIVE-1511.patch, HIVE-1511-wip2.patch,
> HIVE-1511-wip3.patch, HIVE-1511-wip4.patch, HIVE-1511.wip.9.patch,
> HIVE-1511-wip.patch, KryoHiveTest.java, run.sh
>
>
> As reported by Edward Capriolo:
> For reference I did this as a test case....
> SELECT * FROM src where
> key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
> OR key=0 OR key=0 OR key=0 OR
> key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0 OR key=0
> OR key=0 OR key=0 OR key=0 OR
> ...(100 more of these)
> No OOM but I gave up after the test case did not go anywhere for about
> 2 minutes.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
