[
https://issues.apache.org/jira/browse/HIVE-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xuefu Zhang updated HIVE-9492:
------------------------------
Description:
Because of the IOContext problem (HIVE-8920, HIVE-9084), RDD caching is
currently disabled in MapInput. Prototyping shows that the problem can solved.
Thus, we should formalize the prototype and enable the caching. A good query to
test this is:
{code}
from (select * from dec union all select * from dec2) s
insert overwrite table dec3 select s.name, sum(s.value) group by s.name
insert overwrite table dec4 select s.name, s.value order by s.value;
{code}
was:Because of the IOContext problem (HIVE-8920, HIVE-9084), RDD caching is
currently disabled in MapInput. Prototyping shows that the problem can solved.
Thus, we should formalize the prototype and enable the caching.
> Enable caching in MapInput for Spark
> ------------------------------------
>
> Key: HIVE-9492
> URL: https://issues.apache.org/jira/browse/HIVE-9492
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Reporter: Xuefu Zhang
> Assignee: Jimmy Xiang
> Attachments: prototype.patch
>
>
> Because of the IOContext problem (HIVE-8920, HIVE-9084), RDD caching is
> currently disabled in MapInput. Prototyping shows that the problem can
> solved. Thus, we should formalize the prototype and enable the caching. A
> good query to test this is:
> {code}
> from (select * from dec union all select * from dec2) s
> insert overwrite table dec3 select s.name, sum(s.value) group by s.name
> insert overwrite table dec4 select s.name, s.value order by s.value;
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
