Thanks, Dongjon,
I pined two long-standing issues to the umbrella.
https://issues.apache.org/jira/browse/SPARK-28895
https://issues.apache.org/jira/browse/SPARK-28992
This helps fix some problems of running Spark on k8s application with
HDFS.
Hoping to get reviewed soon
Best
Congrats and welcome!!!
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
+1 (non-binding)
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
-1
Do not release this package because v3.0.0 is the 3rd major release since we
added Spark On Kubernetes. Can we make it more production-ready as it has
been experimental for more than 2 years?
The main practical adoption of Spark on Kubernetes is to take on the role of
other cluster managers(ma
Following ANSI might be a good option but also a serious user behavior change
to introduce two different interval types, so I also agree with Reynold to
follow what we have done since version 1.5.0, just like Snowflake and
Redshift.
Perhaps, we can make some efforts for the current interval type t
Hi, Devs
I’d like to propose to add two new interval types which are year-month and
day-time intervals for better ANSI support and future improvements. We will
keep the current CalenderIntervalType but mark it as deprecated until we
find the right time to remove it completely. The backward compati
Hi all,
For better SQL standard support, I recently opened a pull request
https://github.com/apache/spark/pull/26537 to support real type as float and
numeric as decimal. We have researched a bit and discussed it among several
contributors/committers. Sending the email to the dev list to welc
Applying this fix https://github.com/apache/spark/pull/19663
Or
Using --files or --jars /local/path/to/hive-site.xml may works
Thanks,
Kent
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
-
To unsubs
