Re: Spark development with IntelliJ

This was little bit of frustration to get this working with Intellij IDEA 14.1 Clearing the Additional Compiler option was not fixing the issueI had to add following to Settings->Build Execution, Deployment-> S

Re: Spark development with IntelliJ

Nice! - Feel the sparking Spark! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-development-with-IntelliJ-tp10032p10167.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. ---

Re: Spark development with IntelliJ

btw, I updated the wiki to include instructions on making the macro-paradise jar a compiler plugin for Intellij: https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-IntelliJ On Sat, Jan 17, 2015 at 12:16 PM, Chunnan Yao wrote: > Followed is the discussion

Re: Spark development with IntelliJ

Followed is the discussion between Imran and me. 2015-01-18 4:12 GMT+08:00 Chunnan Yao : > Thank you for your patience! Im now not so familiar with the mailing list. > I just clicked "reply" in Gmail, thinking it would be automatically > attached to the list. I will later post the missed informat

Re: Spark development with IntelliJ

Yes I've seen that error in the past too, and was just talking to Imran the other day about it. I thought it only occurred when the hive module was enabled, which I don't enable. The problem is that the plugin that causes an error in IntelliJ for scalac is what parses these values.* I think he got

Re: Spark development with IntelliJ

*I followed the procedures instructed by https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-IntelliJ. But problems still occurs which has made me a little bit annoyed. My environment settings are:JAVA 1.7.0 Scala: 2.10.4 Spark:1.2.0, Intellij Idea 14.0.2

Re: Spark development with IntelliJ

Actually I went ahead and did it. On Thu, Jan 8, 2015 at 10:25 PM, Patrick Wendell wrote: > Nick - yes. Do you mind moving it? I should have put it in the > "Contributing to Spark" page. > > On Thu, Jan 8, 2015 at 3:22 PM, Nicholas Chammas > wrote: >> Side question: Should this section >>

Re: Spark development with IntelliJ

Nick - yes. Do you mind moving it? I should have put it in the "Contributing to Spark" page. On Thu, Jan 8, 2015 at 3:22 PM, Nicholas Chammas wrote: > Side question: Should this section > > in >

Re: Spark development with IntelliJ

That worked, thx On Thu, Jan 8, 2015 at 6:17 PM, Sean Owen wrote: > I remember seeing this too, but it seemed to be transient. Try > compiling again. In my case I recall that IJ was still reimporting > some modules when I tried to build. I don't see this error in general. > > On Thu, Jan 8, 2015

Re: Spark development with IntelliJ

Side question: Should this section in the wiki link to Useful Developer Tools ? On Thu Jan 08 2015 at 6:19:55 PM Sean Owe

Re: Spark development with IntelliJ

I remember seeing this too, but it seemed to be transient. Try compiling again. In my case I recall that IJ was still reimporting some modules when I tried to build. I don't see this error in general. On Thu, Jan 8, 2015 at 10:38 PM, Bill Bejeck wrote: > I was having the same issue and that helpe

Re: Spark development with IntelliJ

d documentation should be on wiki > and linked, > > Jakub > > > -- Původní zpráva -- > Od: Sean Owen > Komu: Jakub Dubovsky > Datum: 8. 1. 2015 11:29:22 > Předmět: Re: Spark development with IntelliJ > > "Yeah, I hit this too. IntelliJ picks this

Re: Spark development with IntelliJ

Thanks that helped. I vote for wiki as well. More fine graned documentation should be on wiki and linked, Jakub -- Původní zpráva -- Od: Sean Owen Komu: Jakub Dubovsky Datum: 8. 1. 2015 11:29:22 Předmět: Re: Spark development with IntelliJ "Yeah, I hit this too. Int

Re: Spark development with IntelliJ

Yeah, I hit this too. IntelliJ picks this up from the build but then it can't run its own scalac with this plugin added. Go to Preferences > Build, Execution, Deployment > Scala Compiler and clear the "Additional compiler options" field. It will work then although the option will come back when th

Re: Spark development with IntelliJ

This helped me: http://stackoverflow.com/questions/26995023/errorscalac-bad-option-p-intellij-idea On 8.1.2015. 11:00, Jakub Dubovsky wrote: Hi devs, I'd like to ask if anybody has experience with using intellij 14 to step into spark code. Whatever I try I get compilation error: Error:sc