Re: Moving forward with the timestamp proposal

2019-02-21 Thread Zoltan Ivanfi
Hi, We can add these new SQL types by adding support to the file formats first. But the most important and immediate goal is reserving these types for their desired meaning and that can already be done without such support. Of course, eventually the new types need to be implemented as well, and f

Re: Moving forward with the timestamp proposal

2019-02-20 Thread Wenchen Fan
I think this is the right direction to go, but I'm wondering how can Spark support these new types if the underlying data sources(like parquet files) do not support them yet. I took a quick look at the new doc for file formats, but not sure what's the proposal. Are we going to implement these new