I'm doing a talk this week at the Philly ETE conference on Spark. I'll compare the Hadoop Java API and Spark Scala API for implemented the *inverted index* algorithm. I'm going to make the case that the Spark API, like many functional-programming APIs, is so powerful that it's well worth your time to learn it. The Spark Java API certainly strives for this goal, too.
Another nice thing about the Scala API, which is also true of the APIs for Scalding and Summingbird, is that you don't have to learn a lot of Scala to use them (at least for a while...). I'll post a link to the slides afterwards. Dean Wampler Typesafe, Inc. @deanwampler On Mon, Apr 21, 2014 at 8:46 AM, Pulasthi Supun Wickramasinghe < pulasthi...@gmail.com> wrote: > Hi, > > I think you can do just fine with your Java knowledge. There is a Java API > that you can use [1]. I am also new to Spark and i have got around with > just my Java knowledge. And Scala is easy to learn if you are good with > Java. > > [1] http://spark.apache.org/docs/latest/java-programming-guide.html > > Regards, > Pulasthi > > > On Mon, Apr 21, 2014 at 7:10 PM, arpan57 <arpanraj...@gmail.com> wrote: > >> Hi guys, >> I read Spark is pretty faster than Hadoop and that inspires me to learn >> it. >> I've hands on exp. with Hadoop (MR-1). And pretty good with java >> programming. >> Do I need to learn Scala in order to learn Spark ? >> Can I go ahead and write my jobs in Java and run on spark ? >> How much dependency is there on Scala to learn spark ? >> >> Thanks in advance. >> >> Regards, >> Arpan >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Do-I-need-to-learn-Scala-for-spark-tp4528.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> > > > > -- > Pulasthi Supun > Undergraduate > Dpt of Computer Science & Engineering > University of Moratuwa > Blog : http://pulasthisupun.blogspot.com/ > Git hub profile: > <http://pulasthisupun.blogspot.com/>https://github.com/pulasthi > <https://github.com/pulasthi> > -- Dean Wampler, Ph.D. Typesafe @deanwampler http://typesafe.com http://polyglotprogramming.com
