I had tried that option to launch/debug UDF from scala and using Intellij with remote breakpoints. However it was getting challenge triggering the breakpoint in the driver for me. I was using my OSX/Mac as one of the master nodes and launch a fat JAR or all inclusive JAR and the other node was a real spark server at the backend. But due to VPN/slow network etc...things weren't going as expected. Nothing on the net seemed very helpful to point in that direction...
--Sachin On Sat, Feb 17, 2018 at 9:04 PM, Michael Artz <michaelea...@gmail.com> wrote: > Would anyone be willing to quickly share what they are doing if they are > using the build/sbt -jvm-debug option from within IntelliJ? Meaning they > are setting breakpoints, etc in the IDE, and running ScalaTests. I'm > looking into SPARK-23039 > <https://issues.apache.org/jira/projects/SPARK/issues/SPARK-23039?filter=allopenissues> > because > it affects something I am doing, and I was trying to leverage the > debugger. I can run specfific spark tests fine. It seems build/sbt script > and the spark build file is making it more more cumbersone for me than when > I have used the debugger before with IntelliJ and SBT and ScalaTest. > > Thanks in advance for any pointers, > Mike > -- --Sachin Naik