Re: Re: [Discuss] SPIP: Support NanoSecond Timestamps

2025-03-24 Thread Qi Tan
Hello team, I have already updated the google doc: https://docs.google.com/document/d/1wjFsBdlV2YK75x7UOk2HhDOqWVA0yC7iEiqOMnNnxlA/edit?usp=sharing. If all looks good, I will raise a vote later this week. Thank you! Qi Tan 于2025年3月18日周二 21:39写道： > Hello Reynold, I truly appreciate your time and

RE: Re: [Discuss] SPIP: Support NanoSecond Timestamps

2025-03-18 Thread Qi Tan
Hello Reynold, I truly appreciate your time and attention to this feature. For the performance, here are my thoughts: * As Serge mentioned above, Apache Spark needs to be aligned with other competitive products. We should not overlook potential benefits just because of performance regression.

RE: Re: [Discuss] SPIP: Support NanoSecond Timestamps

2025-03-17 Thread 谭琦
Thank you all for your comments and suggestions! Let me rewrite the document. On 2025/03/17 22:28:35 Gengliang Wang wrote: > Hi Qi, > > Thanks for the proposal. I am generally +1 with the idea. Could you clarify > which option is preferred in “Q1. What are you trying to do?”? > Understanding this

Re: Re: [Discuss] SPIP: Support NanoSecond Timestamps

2025-03-15 Thread Wenchen Fan
In general, I think it's good for Spark to support the common data types in the ecosystem, as it's the only way to fully integrate with the ecosystem. So +1. On Fri, Mar 14, 2025 at 8:56 AM 谭琦 wrote: > Updated. Thanks. > > On 2025/03/13 23:56:20 Jungtaek Lim wrote: > > Hi, would you mind allowin

RE: Re: [Discuss] SPIP: Support NanoSecond Timestamps

2025-03-15 Thread 谭琦
Updated. Thanks. On 2025/03/13 23:56:20 Jungtaek Lim wrote: > Hi, would you mind allowing comments on the doc? Thanks! > > On Fri, Mar 14, 2025 at 8:50 AM Qi Tan wrote: > > > Hello everybody, > > > > I would like to start a discussion on SPARK-50532 > >

Re: Re: [Discuss] SPIP: Support NanoSecond Timestamps

2025-03-14 Thread Szehon Ho
+1 to the idea as well, as Iceberg V3 is coming with time with nanos, and Spark would not be able to read this type without this. Thanks Szehon On Fri, Mar 14, 2025 at 3:34 PM Wenchen Fan wrote: > In general, I think it's good for Spark to support the common data types > in the ecosystem, as it