Re: [DISCUSS] Handling spark.databricks.* config being exposed in 3.5.4 in Spark 4.0.0+

2025-03-06 Thread Jungtaek Lim
I have to cast -1 (despite non-binding) for every single RC for Spark 4.0.0 till this is settled, since I don't agree with the current status (Dongjoon's proposal is as-is). On the other hand, I want to unblock this and stop bugging the RC phase. Again, I could be only persuaded if this is mandato

Re: [VOTE] Release Spark 4.0.0 (RC2)

2025-03-06 Thread Wenchen Fan
RC2 fails and I'll cut RC3 next week. Thanks for the feedback! On Thu, Mar 6, 2025 at 6:44 AM Chris Nauroth wrote: > Here is one more problem I found during RC2 verification: > > https://github.com/apache/spark/pull/50173 > > This one is just a test issue. > > Chris Nauroth > > > On Tue, Mar 4,

Re: Contribution to Spark SQL: new data type TIME

2025-03-06 Thread Sakthi
This is great, Max! I would like to pick up the following two tasks: - https://issues.apache.org/jira/browse/SPARK-51420 (Get Minutes of time) [Starter] - https://issues.apache.org/jira/browse/SPARK-51423 (Add the current_time() function) Regards, Sakthi On Thu, Mar 6, 2025 at 8:33 AM Rob Reeves

Re: Contribution to Spark SQL: new data type TIME

2025-03-06 Thread Rob Reeves
Hi Max, I'll work on Add the make_time() function . Thanks, Rob On Thu, Mar 6, 2025 at 3:16 AM Max Gekk wrote: > Hi Spark devs, > > I would like to invite you to develop the new data type TIME in Spark > SQL. At the moment, there are > 10 sub-