Jacek Laskowski created SPARK-20937:
---------------------------------------
Summary: Describe spark.sql.parquet.writeLegacyFormat property in
Spark SQL, DataFrames and Datasets Guide
Key: SPARK-20937
URL: https://issues.apache.org/jira/browse/SPARK-20937
Project: Spark
Issue Type: Improvement
Components: Documentation, SQL
Affects Versions: 2.3.0
Reporter: Jacek Laskowski
Priority: Trivial
As a follow-up to SPARK-20297 (and SPARK-10400) in which
{{spark.sql.parquet.writeLegacyFormat}} property was recommended for Impala and
Hive, Spark SQL docs for [Parquet
Files|https://spark.apache.org/docs/latest/sql-programming-guide.html#configuration]
should have it documented.
p.s. It's also covered in [[email protected]]'s "High Performance Spark:
Best Practices for Scaling and Optimizing Apache Spark" book (in Table 3-10.
Parquet data source options) that gives the option some wider publicity.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
