Have you tryied with ssh? It will be much secure (only 1 port open),
and you'll be able to run spark-shell over the networ. I'm using that
way in my project (https://github.com/data-tsunami/smoke) with good
results.
I can't make a try now, but something like this should work:
ssh -tt ec2-user@YOU
oped in Python, uses Celery/Redis to stream the job logs to
the web and is easy to install.
The project is on GitHub: https://github.com/data-tsunami/smoke
(install instructions, screenshots, etc.). It's in an early
development stage, but very usable.
Thanks!
Horacio
--
Horacio G. de Or
