Re: [DISCUSS] Remove multiple workers on the same host support from Standalone backend

Hi Prashant, I guess you are referring to the local-cluster mode? AFAIK the local-cluster mode has not been mentioned at all in the user guide, thus it should only be used in Spark tests. Also, there are a few differences between having multiple workers on the same node and having one worker on ea

Re: [Proposal] Modification to Spark's Semantic Versioning Policy

Xiao, thanks for the proposal and willingness to lead the effort! I feel that it's still a bit different from what I've proposed. What I'm proposing is closer to enforce discussion if the change proposes new public API or brings breaking change. It's good that we add the section "Does this PR intr

Re: Keytab, Proxy User & Principal

On Fri, Feb 28, 2020 at 6:21 AM Lars Francke wrote: > Can we not allow specifying a keytab and principal together with proxy > user but those are only used for the initial login to submit the job and > are not shipped to the cluster? This way jobs wouldn't need to rely on the > operating system.

Re: Running Spark through a debugger

Finally revisiting this issue. I can now build Spark through IntelliJ (I had to delete `.idea/` and reload the project, making sure to import the Maven config), but am struggling to get the breakpoint/debugging to work. I setup IntelliJ per the instructions under Debug Spark Remotely