Do we have one-hot encoding in spark MLLib 1.1.1 or 1.2.0 ? It wasn't
available in 1.1.0.
Thanks.
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
We are trying to call spark through an osgi service (with osgifyed
version of assembly.jar). Spark does not work (due to the way spark
reads akka reference.conf) unless we switch the class loader as follows.
Thread.currentThread().setContextClassLoader(JavaSparkContext.class.getClassLoader());
ache-spark-user-list.1001560.n3.nabble.com/Packaging-a-spark-job-using-maven-td5615.html
On Mon, Dec 1, 2014 at 4:28 PM, Lochana Menikarachchi
mailto:locha...@gmail.com>> wrote:
I have spark core and mllib as dependencies for a spark based osgi
service. When I call the model
using-maven-td5615.html
On Mon, Dec 1, 2014 at 4:28 PM, Lochana Menikarachchi
mailto:locha...@gmail.com>> wrote:
I have spark core and mllib as dependencies for a spark based osgi
service. When I call the model building method through a unit test
(without osgi) it works OK. Whe
I have spark core and mllib as dependencies for a spark based osgi
service. When I call the model building method through a unit test
(without osgi) it works OK. When I call it through the osgi service,
nothing happens. I tried adding spark assembly jar. Now it throws
following error..
An err
Figured constructor can be used for this purpose..
On 10/24/14 7:57 AM, Lochana Menikarachchi wrote:
SparkConf conf = new
SparkConf().setAppName("LogisticRegression").setMaster("local[4]");
JavaSparkContext sc = new JavaSparkContext(conf);
JavaRDD lines = s
SparkConf conf = new
SparkConf().setAppName("LogisticRegression").setMaster("local[4]");
JavaSparkContext sc = new JavaSparkContext(conf);
JavaRDD lines = sc.textFile("some.csv");
JavaRDD lPoints = lines.map(new CSVLineParser());
Is there anyway to parse an index to a function.
Found this thread from April..
http://mail-archives.apache.org/mod_mbox/spark-user/201404.mbox/%3ccabjxkq6b7sfaxie4+aqtcmd8jsqbznsxsfw6v5o0wwwouob...@mail.gmail.com%3E
Wondering what the status of this.. We are thinking about implementing
these algorithms.. Would be a waste if they are already
Hi,
Is there anyone who works on hyper parameter optimization algorithms? If
not, is there any interest on the subject. We are thinking about
implementing some of these algorithms and contributing to spark? thoughts?
Lochana
---
