Liang-Chi Hsieh created SPARK-19931:
---------------------------------------
Summary: InMemoryTableScanExec should rewrite output partitioning
and ordering when aliasing output attributes
Key: SPARK-19931
URL: https://issues.apache.org/jira/browse/SPARK-19931
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.1.0
Reporter: Liang-Chi Hsieh
Now InMemoryTableScanExec simply takes the outputPartitioning and
outputOrdering from the associated InMemoryRelation's child.outputPartitioning
and outputOrdering.
However, InMemoryTableScanExec can alias the output attributes. In this case,
its outputPartitioning and outputOrdering are not correct and its parent
operators can't correctly determine its data distribution.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]