Re: Timestamp interoperability design doc available for review

2017-09-11 Thread Imran Rashid
I've posted a design doc on SPARK-12297, which builds on what Zoltan posted here earlier. It addresses the parquet issues and also considers current inconsistencies in timestamp behavior for spark across data formats and versions. I believe this incorporates all of the prior concerns and feedback

Timestamp interoperability design doc available for review

2017-08-16 Thread Zoltan Ivanfi
Dear Spark Community, Based on earlier feedback from the Spark community, we would like to suggest a short-term fix for the timestamp interoperability problem[1] between different SQL-on-Hadoop engines. I created a design document[2] and would like to ask you to review it and let me know of any co