I have tested my python script by using the pyspark shell. I run into an error because of memory limits on the name node.
I am wondering how I run the script no spark yarn. I am not familiar with this at all. Any help would be greatly appreciated. Thanks, -- *MAGNE**+**I**C* *Sam Flint* | *Lead Developer, Data Analytics*