Hi,
I have updated my Spark to the version of 3.0.0,
and it seems that the LogisticRegressionWithSGD's constructor is private
within the mllib package,
So i can't initialize an instance of this class.
How can i still use this class rather than switch to the
LogisticRegressionWithLBFGS ?
Thanks Amit, I was referring to dynamic partition pruning (
https://issues.apache.org/jira/browse/SPARK-11150) & adaptive query
execution (https://issues.apache.org/jira/browse/SPARK-31412) in Sparkk 3 -
where it would figure out right partitions & pushes the filters to input
before applying the jo
I'm new to spark.
Trying to export spark (2.4.0) custom metrics in prometheus format.
I found this guide https://argus-sec.com/monitoring-spark-prometheus/
Running on my local pc (windows) I am able to see my metrics in visualVM and
in spark's json http://localhost:4040/metrics/json/
My issue is