Anurag Mantripragada created SPARK-59946:
--------------------------------------------
Summary: Render partition transforms in SHOW CREATE TABLE and
DESCRIBE with typed literals and quoted names
Key: SPARK-59946
URL: https://issues.apache.org/jira/browse/SPARK-59946
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 5.0.0
Reporter: Anurag Mantripragada
SPARK-34586 (https://github.com/apache/spark/pull/58153) renders the
write-ordering transforms in SHOW CREATE TABLE and DESCRIBE with
type-preserving literals and quoted transform names. PARTITIONED BY in SHOW
CREATE TABLE (ShowCreateTableExec.showTablePartitioning) and the `Part N` rows
of DESCRIBE still use Transform.describe, which prints a literal's internal
value and does not quote names.
For PARTITIONED BY (truncate(s, 10L)) ORDERED BY truncate(s, 10L), SHOW CREATE
TABLE prints PARTITIONED BY (truncate(s, 10)) next to ORDERED BY (truncate(s,
10L) ASC NULLS FIRST), and replaying it turns the partition literal into an INT.
Share one renderer between the partitioning and the ordering, and add a
round-trip test for a typed literal in PARTITIONED BY.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
