ve actually. Particularly,
> in spark-3.5.2.
>
> Just download the `spark-connect` maven jar and place it in
> `$SPARK_HOME/jars`. Then rebuild the docker image. I saw that I had posted
> a comment on this Jira as well. I could fix this up for standalone cluster
> at least this way.
n actually get the executors to run on
> kubernetes itself. That is pretty straightforward, but the driver continues
> to run on a local machine. But yeah, I agree as well, making the driver to
> run on k8s itself would be slick.
>
> Thank you.
>
>
> On Mon, Sep 9, 202
Hi All,
Why is it not possible to specify cluster as the deploy mode for Spark
Connect?
As discussed in the following thread, it appears that there is an
"arbitrary decision" within spark-submit that "Cluster mode is not
applicable" to Spark Connect.
GitHub Issue Comment:
https://github.com/kube
Hi Spark Community,
I have a question regarding the support for User-Defined Functions (UDFs)
in Spark Connect, specifically when using Kubernetes as the Cluster Manager.
According to the Spark documentation, UDFs are supported by default for the
shell and in standalone applications with addition
----
> eabour
>
>
> *From:* eab...@163.com
> *Date:* 2023-10-19 14:28
> *To:* Nagatomi Yasukazu ; user @spark
>
> *Subject:* Re: Re: Running Spark Connect Server in Cluster Mode on
> Kubernetes
> Hi all,
>
> Has the spark connect server running on k8s functiona
Hi Sanket,
While migrating to Hive 3.1.3 may resolve many issues, the link below
suggests that there might still be some vulnerabilities present.
Do you think the specific vulnerability you're concerned about can be
addressed with Hive 3.1.3?
https://mvnrepository.com/artifact/org.apache.hive/hiv
117
Any thoughts, updates, or references to similar conversations or
initiatives would be greatly appreciated.
Thank you for your time and expertise!
Best regards,
Yasukazu
2023年9月5日(火) 12:09 Nagatomi Yasukazu :
> Hello Mich,
> Thank you for your questions. Here are my responses:
>
>
bility for any
> loss, damage or destruction of data or any other property which may arise
> from relying on this email's technical content is explicitly disclaimed.
> The author will in no case be liable for any monetary damages arising from
> such loss, damage or destruction.
>
>
helps.
> Have a nice day :)
> Cley
>
> Nagatomi Yasukazu escreveu no dia sábado,
> 2/09/2023 à(s) 15:37:
>
>> Hello Apache Spark community,
>>
>> I'm currently trying to run Spark Connect Server on Kubernetes in Cluster
>> Mode and facing some challenges. Any g
Hello Apache Spark community,
I'm currently trying to run Spark Connect Server on Kubernetes in Cluster
Mode and facing some challenges. Any guidance or hints would be greatly
appreciated.
## Environment:
Apache Spark version: 3.4.1
Kubernetes version: 1.23
Command executed:
/opt/spark/sbin/sta
Hello Apache Spark community,
I'm currently trying to run Spark Connect Server on Kubernetes in Cluster
Mode and facing some challenges.
Any guidance or hints would be greatly appreciated.
## Environment:
Apache Spark version: 3.4.1
Kubernetes version: 1.23
Command executed:
/opt/spark/sbin/sta
11 matches
Mail list logo
