Could you include the code where it fails?
Generally the best way to use gf is to use the --packages options with 
spark-submit command

________________________________
From: Imran Rajjad <raj...@gmail.com>
Sent: Wednesday, September 20, 2017 5:47:27 AM
To: user @spark
Subject: graphframes on cluster

Trying to run graph frames on a spark cluster. Do I need to include the package 
in spark context settings? or the only the driver program is suppose to have 
the graphframe libraries in its class path? Currently the job is crashing when 
action function is invoked on graphframe classes.

regards,
Imran

--
I.R

Reply via email to