I've posted a design doc on SPARK-12297, which builds on what Zoltan posted
here earlier. It addresses the parquet issues and also considers current
inconsistencies in timestamp behavior for spark across data formats and
versions. I believe this incorporates all of the prior concerns and
feedback
Dear Spark Community,
Based on earlier feedback from the Spark community, we would like to
suggest a short-term fix for the timestamp interoperability problem[1]
between different SQL-on-Hadoop engines. I created a design document[2] and
would like to ask you to review it and let me know of any co