Thanks all for the discussion!
I agree that we first need to reach a consensus on adding the
TIMESTAMP(nanosecond) data type to Apache Spark. It's a standard data type
supported by major databases like Oracle and IBM DB2, making it a necessary
inclusion in Spark to align with industry practices.
Hi Jia
Yea I think the SPIP was trying to be concise and focused, but definitely was
chatting yesterday with Menelaus on how to mention Sedona here but still keep
it concise and focused :)
It makes sense to collect feedbacks before the vote, thanks for the comments
and collaboration here, and
Hey Angel,
I am glad that you asked these questions. Please see my answers below.
*1. Domain types evolve quickly. - It has taken years for Parquet to
include these new types in its format... We could evolve alongside Parquet.
Unfortunately, Spark is not known for upgrading its dependencies quic
