Thank you Debasish. I am fine with either Scala or Java. I would like to get a quick evaluation on the performance gain, e.g., ALS on GPU. I would like to try whichever library does the business :)
Best regards, Wei --------------------------------- Wei Tan, PhD Research Staff Member IBM T. J. Watson Research Center http://researcher.ibm.com/person/us-wtan From: Debasish Das <[email protected]> To: Frank van Lankvelt <[email protected]>, Cc: Matei Zaharia <[email protected]>, user <[email protected]>, Antonio Jesus Navarro <[email protected]>, Chen He <[email protected]>, Wei Tan/Watson/IBM@IBMUS Date: 08/28/2014 12:20 PM Subject: Re: CUDA in spark, especially in MLlib? Breeze author David also has a github project on cuda binding in scala....do you prefer using java or scala ? On Aug 27, 2014 2:05 PM, "Frank van Lankvelt" <[email protected]> wrote: you could try looking at ScalaCL[1], it's targeting OpenCL rather than CUDA, but that might be close enough? cheers, Frank 1. https://github.com/ochafik/ScalaCL On Wed, Aug 27, 2014 at 7:33 PM, Wei Tan <[email protected]> wrote: Thank you all. Actually I was looking at JCUDA. Function wise this may be a perfect solution to offload computation to GPU. Will see how performance it will be, especially with the Java binding. Best regards, Wei --------------------------------- Wei Tan, PhD Research Staff Member IBM T. J. Watson Research Center http://researcher.ibm.com/person/us-wtan From: Chen He <[email protected]> To: Antonio Jesus Navarro <[email protected]>, Cc: Matei Zaharia <[email protected]>, [email protected], Wei Tan/Watson/IBM@IBMUS Date: 08/27/2014 11:03 AM Subject: Re: CUDA in spark, especially in MLlib? JCUDA can let you do that in Java http://www.jcuda.org On Wed, Aug 27, 2014 at 1:48 AM, Antonio Jesus Navarro < [email protected]> wrote: Maybe this would interest you: CPU and GPU-accelerated Machine Learning Library: https://github.com/BIDData/BIDMach 2014-08-27 4:08 GMT+02:00 Matei Zaharia <[email protected]>: You should try to find a Java-based library, then you can call it from Scala. Matei On August 26, 2014 at 6:58:11 PM, Wei Tan ([email protected]) wrote: Hi I am trying to find a CUDA library in Scala, to see if some matrix manipulation in MLlib can be sped up. I googled a few but found no active projects on Scala+CUDA. Python is supported by CUDA though. Any suggestion on whether this idea makes any sense? Best regards, Wei -- Amsterdam - Oosteinde 11, 1017 WT Amsterdam Boston - 1 Broadway, Cambridge, MA 02142 US +1 877 414 4776 (toll free) Europe +31(0)20 522 4466 www.onehippo.com
