Re: 【Spark ML】How to get access of the MLlib's LogisticRegressionWithSGD after 3.0.0?

-dev See the migration guide: https://spark.apache.org/docs/3.0.0/ml-migration-guide.html Use ml.LogisticRegression, which should still let you use SGD On Tue, Sep 22, 2020 at 12:54 AM Lyx <1181245...@qq.com> wrote: > > Hi, > I have updated my Spark to the version of 3.0.0, > and it seems th

Spark Submit processes hanging & leaking memory

Exactly 3 spark submit processes are hanging from the first 3 jobs that were submitted to the standalone cluster using client mode. Example from the client: root 1517 0.3 4.7 8412728 1532876 ? Sl 18:49 0:38 /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java -cp /usr/local/spark/conf/:/usr/local/spark/