Maybe try
--conf spark.driver.memory=4g
On Tue, Oct 15, 2024 at 1:46 AM Yunhui Han <langchao...@gmail.com> wrote:
> Hi, all
>
> I am using spark connect server on version 3.4.0 & 3.5.3.
>
> I can't set driver memory as follows,
>
> ${SPARK_HOME}/sbin/start-connect-server.sh \
> --packages org.apache.spark:spark-connect_2.12:${SPARK_VERSION} \
> --master yarn \
> --deploy-mode client \
> --name spark_connect_server \
> --driver-memory 4G \
> --executor-memory 4G
>
> Can anyone help me with this?
>
> Best
>
