Re: Spark development with IntelliJ

eployment-> Scala CompilerAdditional compiler option -P:/Your home directory/.m2/repository/org/scalamacros/ > paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-development-with-IntelliJ-tp10032p

Re: Spark development with IntelliJ

Nice! - Feel the sparking Spark! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-development-with-IntelliJ-tp10032p10167.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com

Re: Spark development with IntelliJ

HiveShim.getDecimalWritableConstantObjectInspector(value) >>>>>>>> > ^ >>>>>>>> > Error:(307, 7) not found: value HiveShim >>>>>>>>

Re: Spark development with IntelliJ

^ >>>>>>> > Error:(393, 30) not found: value HiveShim >>>>>>> > case d: DecimalType => HiveShim.decimalTypeInfo(d) >>>>>>> >

Re: Spark development with IntelliJ

e/execution/HiveTableScan.scala > Error:(89, 5) not found: value HiveShim > HiveShim.appendReadColumns(hiveConf, neededColumnIDs, > attributes.map(_.name)) > ^ > /home/yaochunnan/workspace/spark_source/spark-1.2.0/sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveWriterCon

Re: Spark development with IntelliJ

akeParquetSerDe.scala Warning:(34, 2) @deprecated now takes two arguments; see the scaladoc. @deprecated("No code should depend on FakeParquetHiveSerDe as it is only intended as a " + ^ *I thought

Re: Spark development with IntelliJ

Actually I went ahead and did it. On Thu, Jan 8, 2015 at 10:25 PM, Patrick Wendell wrote: > Nick - yes. Do you mind moving it? I should have put it in the > "Contributing to Spark" page. > > On Thu, Jan 8, 2015 at 3:22 PM, Nicholas Chammas > wrote: >> Side question: Should this section >>

Re: Spark development with IntelliJ

Nick - yes. Do you mind moving it? I should have put it in the "Contributing to Spark" page. On Thu, Jan 8, 2015 at 3:22 PM, Nicholas Chammas wrote: > Side question: Should this section > > in >

Re: Spark development with IntelliJ

That worked, thx On Thu, Jan 8, 2015 at 6:17 PM, Sean Owen wrote: > I remember seeing this too, but it seemed to be transient. Try > compiling again. In my case I recall that IJ was still reimporting > some modules when I tried to build. I don't see this error in general. > > On Thu, Jan 8, 2015

Re: Spark development with IntelliJ

Side question: Should this section in the wiki link to Useful Developer Tools ? On Thu Jan 08 2015 at 6:19:55 PM Sean Owe

Re: Spark development with IntelliJ

I remember seeing this too, but it seemed to be transient. Try compiling again. In my case I recall that IJ was still reimporting some modules when I tried to build. I don't see this error in general. On Thu, Jan 8, 2015 at 10:38 PM, Bill Bejeck wrote: > I was having the same issue and that helpe

Re: Spark development with IntelliJ

d documentation should be on wiki > and linked, > > Jakub > > > -- Původní zpráva -- > Od: Sean Owen > Komu: Jakub Dubovsky > Datum: 8. 1. 2015 11:29:22 > Předmět: Re: Spark development with IntelliJ > > "Yeah, I hit this too. IntelliJ picks this

Re: Spark development with IntelliJ

Thanks that helped. I vote for wiki as well. More fine graned documentation should be on wiki and linked, Jakub -- Původní zpráva -- Od: Sean Owen Komu: Jakub Dubovsky Datum: 8. 1. 2015 11:29:22 Předmět: Re: Spark development with IntelliJ "Yeah, I hit this too. Int

Re: Spark development with IntelliJ

Yeah, I hit this too. IntelliJ picks this up from the build but then it can't run its own scalac with this plugin added. Go to Preferences > Build, Execution, Deployment > Scala Compiler and clear the "Additional compiler options" field. It will work then although the option will come back when th

Re: Spark development with IntelliJ

This helped me: http://stackoverflow.com/questions/26995023/errorscalac-bad-option-p-intellij-idea On 8.1.2015. 11:00, Jakub Dubovsky wrote: Hi devs, I'd like to ask if anybody has experience with using intellij 14 to step into spark code. Whatever I try I get compilation error: Error:sc

Spark development with IntelliJ

Hi devs,   I'd like to ask if anybody has experience with using intellij 14 to step into spark code. Whatever I try I get compilation error: Error:scalac: bad option: -P:/home/jakub/.m2/repository/org/scalamacros/ paradise_2.10.4/2.0.1/paradise_2.10.4-2.0.1.jar   Project is set up by Patrick's

Spark development with IntelliJ

Hi All, I noticed people sometimes struggle to get Spark set up in IntelliJ. I'd like to maintain comprehensive instructions on our Wiki to make this seamless for future developers. Due to some nuances of our build, getting to the point where you can build + test every module from within the IDE i