Re: Spark R - Loading Third Party R Library in YARN Executors

2016-08-17 Thread Shivaram Venkataraman
load the R package from HDFS onto the worker node first. > > > _ > From: Senthil Kumar > Sent: Wednesday, August 17, 2016 2:23 AM > Subject: Spark R - Loading Third Party R Library in YARN Executors > To: Senthil kumar , , > , > > > &

Re: Spark R - Loading Third Party R Library in YARN Executors

2016-08-17 Thread Felix Cheung
the worker node first. _ From: Senthil Kumar mailto:senthilec...@gmail.com>> Sent: Wednesday, August 17, 2016 2:23 AM Subject: Spark R - Loading Third Party R Library in YARN Executors To: Senthil kumar mailto:senthilec...@gmail.com>>, mailto:du

Spark R - Loading Third Party R Library in YARN Executors

2016-08-17 Thread Senthil Kumar
Hi All , We are using Spark 1.6 Version R library .. Below is our code which Loads the THIRD Party Library . library("BreakoutDetection", lib.loc = "*hdfs://xx/BreakoutDetection/*") : library("BreakoutDetection", lib.loc = "*//xx/BreakoutDetection/*") : When i try to execute the code u