Share more details on error to help suggesting solutions
On Wed, Nov 16, 2022, 22:13 Artemis User wrote:
> What problems did you encounter? Most likely your problem may be
> related to saving the model object in different partitions. If that the
> case, just apply the dataframe's coalesce(1) m
What problems did you encounter? Most likely your problem may be
related to saving the model object in different partitions. If that the
case, just apply the dataframe's coalesce(1) method before saving the
model to a shared disk drive...
On 11/16/22 1:51 AM, Vajiha Begum S A wrote:
Hi,
Thi
Hi There,
I have installed Spark 3.3.1 and tried to use the following configuration
in Spark Submit for a spark job to run in Kubernetes Cluster and I have got
class not found exception for the reference "VolcanoFeatureStep"
--conf
spark.kubernetes.driver.pod.featureSteps=org.apache.spark.deploy.
Hi all,
The Apache Kyuubi (Incubating) community is pleased to announce that
Apache Kyuubi (Incubating) 1.6.1-incubating has been released!
Apache Kyuubi (Incubating) is a distributed multi-tenant JDBC server for
large-scale data processing and analytics, built on top of Apache Spark
and designed
I've created a native UDF extending UnaryExpression and can use it in Scala
just fine. How do I make available in PySpark?
Hi,
This is Vajiha, Senior Research Analyst. I'm working for Predictive
Analysis with Pyspark ML models. It's quite good working with the features
of spark in python. Though I'm having issues saving the pyspark trained ML
models. I have read many articles,stack overflow and spark forum comments
and
