Robert Kruszewski created SPARK-16623:
-----------------------------------------
Summary: Datasources should expose ability to define schema
conversions they're performing to save data
Key: SPARK-16623
URL: https://issues.apache.org/jira/browse/SPARK-16623
Project: Spark
Issue Type: New Feature
Reporter: Robert Kruszewski
See issue on spark avro https://github.com/databricks/spark-avro/issues/142
This should be a first class concept since otherwise the user has no way of
knowing that the data is undergoing a conversion on save
JsonFileFormat on the other had will throw exception on unsupported types. It
would be preferable to unify and codify the behaviour.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]