Using Spark with a SOCKS proxy

2015-03-17 Thread Kelly, Jonathan
I'm trying to figure out how I might be able to use Spark with a SOCKS proxy. That is, my dream is to be able to write code in my IDE then run it without much trouble on a remote cluster, accessible only via a SOCKS proxy between the local development machine and the master node of the cluster

Re: Unable to use dynamicAllocation if spark.executor.instances is set in spark-defaults.conf

2015-07-15 Thread Kelly, Jonathan
I haven't gotten a response on user@ yet for these questions, but these are probably better questions for dev@ anyway, aren't they? Could somebody on dev@ please respond? Thanks, Jonathan From: Jonathan Kelly mailto:jonat...@amazon.com>> Date: Wednesday, July 15, 2015 at 12:18 PM To: "u...@spar