Thank you Debasish. I am fine with either Scala or Java. I would like to get a quick evaluation on the performance gain, e.g., ALS on GPU. I would like to try whichever library does the business :)
Best regards, Wei --------------------------------- Wei Tan, PhD Research Staff Member IBM T. J. Watson Research Center http://researcher.ibm.com/person/us-wtan From: Debasish Das <debasish.da...@gmail.com> To: Frank van Lankvelt <f.vanlankv...@onehippo.com>, Cc: Matei Zaharia <matei.zaha...@gmail.com>, user <user@spark.apache.org>, Antonio Jesus Navarro <ajnava...@stratio.com>, Chen He <airb...@gmail.com>, Wei Tan/Watson/IBM@IBMUS Date: 08/28/2014 12:20 PM Subject: Re: CUDA in spark, especially in MLlib? Breeze author David also has a github project on cuda binding in scala....do you prefer using java or scala ? On Aug 27, 2014 2:05 PM, "Frank van Lankvelt" <f.vanlankv...@onehippo.com> wrote: you could try looking at ScalaCL[1], it's targeting OpenCL rather than CUDA, but that might be close enough? cheers, Frank 1. https://github.com/ochafik/ScalaCL On Wed, Aug 27, 2014 at 7:33 PM, Wei Tan <w...@us.ibm.com> wrote: Thank you all. Actually I was looking at JCUDA. Function wise this may be a perfect solution to offload computation to GPU. Will see how performance it will be, especially with the Java binding. Best regards, Wei --------------------------------- Wei Tan, PhD Research Staff Member IBM T. J. Watson Research Center http://researcher.ibm.com/person/us-wtan From: Chen He <airb...@gmail.com> To: Antonio Jesus Navarro <ajnava...@stratio.com>, Cc: Matei Zaharia <matei.zaha...@gmail.com>, user@spark.apache.org, Wei Tan/Watson/IBM@IBMUS Date: 08/27/2014 11:03 AM Subject: Re: CUDA in spark, especially in MLlib? JCUDA can let you do that in Java http://www.jcuda.org On Wed, Aug 27, 2014 at 1:48 AM, Antonio Jesus Navarro < ajnava...@stratio.com> wrote: Maybe this would interest you: CPU and GPU-accelerated Machine Learning Library: https://github.com/BIDData/BIDMach 2014-08-27 4:08 GMT+02:00 Matei Zaharia <matei.zaha...@gmail.com>: You should try to find a Java-based library, then you can call it from Scala. Matei On August 26, 2014 at 6:58:11 PM, Wei Tan (w...@us.ibm.com) wrote: Hi I am trying to find a CUDA library in Scala, to see if some matrix manipulation in MLlib can be sped up. I googled a few but found no active projects on Scala+CUDA. Python is supported by CUDA though. Any suggestion on whether this idea makes any sense? Best regards, Wei -- Amsterdam - Oosteinde 11, 1017 WT Amsterdam Boston - 1 Broadway, Cambridge, MA 02142 US +1 877 414 4776 (toll free) Europe +31(0)20 522 4466 www.onehippo.com
