Re: Python to Scala

2016-06-18 Thread Sivakumaran S
If you can identify a suitable java example in the spark directory, you can use that as a template and convert it to scala code using http://javatoscala.com/ Siva > On 18-Jun-2016, at 6:27 AM, Aakash Basu wrote: > > I don't have a sound knowledge in Python and on the

Re: Python to Scala

2016-06-18 Thread Marco Mistroni
Hi Post the code. I code in python and Scala on spark..I can give u help though api for Scala and python are practically sameonly difference is in the python lambda vs Scala inline functions Hth On 18 Jun 2016 6:27 am, "Aakash Basu" wrote: > I don't have a sound knowledge in Python and on

Re: Python to Scala

2016-06-18 Thread ayan guha
Post the code..some one would be able to help (your truly included) On Sat, Jun 18, 2016 at 4:13 PM, Yash Sharma wrote: > Couple of things that can work- > - If you know the logic- just forget the python script and write it in > java/scala from scratch > - If you have python functions and li

Re: Python to Scala

2016-06-17 Thread Yash Sharma
Couple of things that can work- - If you know the logic- just forget the python script and write it in java/scala from scratch - If you have python functions and libraries used- Pyspark is probably the best bet. - If you have specific questions on how to solve a particular implementation issue you

Re: Python to Scala

2016-06-17 Thread Aakash Basu
I don't have a sound knowledge in Python and on the other hand we are working on Spark on Scala, so I don't think it will be allowed to run PySpark along with it, so the requirement is to convert the code to scala and use it. But I'm finding it difficult. Did not find a better forum for help than

Re: Python to Scala

2016-06-17 Thread Stephen Boesch
What are you expecting us to do? Yash provided a reasonable approach - based on the info you had provided in prior emails. Otherwise you can convert it from python to spark - or find someone else who feels comfortable to do it. That kind of inquiry would likelybe appropriate on a job board. 2

Re: Python to Scala

2016-06-17 Thread Aakash Basu
Hey, Our complete project is in Spark on Scala, I code in Scala for Spark, though am new, but I know it and still learning. But I need help in converting this code to Scala. I've nearly no knowledge in Python, hence, requested the experts here. Hope you get me now. Thanks, Aakash. On 18-Jun-2016

Re: Python to Scala

2016-06-17 Thread Yash Sharma
You could use pyspark to run the python code on spark directly. That will cut the effort of learning scala. https://spark.apache.org/docs/0.9.0/python-programming-guide.html - Thanks, via mobile, excuse brevity. On Jun 18, 2016 2:34 PM, "Aakash Basu" wrote: > Hi all, > > I've a python code, wh