Thanks Patrick for the heads up. I have not been successful to discover a combination of profiles (i.e. enabling hive or hive-0.12.0 or hive-13.0) that works in Intellij with maven. Anyone who knows how to handle this - a quick note here would be appreciated.
2014-10-28 20:20 GMT-07:00 Patrick Wendell <pwend...@gmail.com>: > Hey Stephen, > > In some cases in the maven build we now have pluggable source > directories based on profiles using the maven build helper plug-in. > This is necessary to support cross building against different Hive > versions, and there will be additional instances of this due to > supporting scala 2.11 and 2.10. > > In these cases, you may need to add source locations explicitly to > intellij if you want the entire project to compile there. > > Unfortunately as long as we support cross-building like this, it will > be an issue. Intellij's maven support does not correctly detect our > use of the maven-build-plugin to add source directories. > > We should come up with a good set of instructions on how to import the > pom files + add the few extra source directories. Off hand I am not > sure exactly what the correct sequence is. > > - Patrick > > On Tue, Oct 28, 2014 at 7:57 PM, Stephen Boesch <java...@gmail.com> wrote: > > Hi Matei, > > Until my latest pull from upstream/master it had not been necessary to > > add the hive profile: is it now?? > > > > I am not using sbt gen-idea. The way to open in intellij has been to Open > > the parent directory. IJ recognizes it as a maven project. > > > > There are several steps to do surgery on the yarn-parent / yarn projects > , > > then do a full rebuild. That was working until one week ago. > > Intellij/maven is presently broken in two ways: this hive shim (which > may > > yet hopefully be a small/simple fix - let us see) and (2) the > > "NoClassDefFoundError > > on ThreadFactoryBuilder" from my prior emails -and which is quite a > serious > > problem . > > > > 2014-10-28 19:46 GMT-07:00 Matei Zaharia <matei.zaha...@gmail.com>: > > > >> Hi Stephen, > >> > >> How did you generate your Maven workspace? You need to make sure the > Hive > >> profile is enabled for it. For example sbt/sbt -Phive gen-idea. > >> > >> Matei > >> > >> > On Oct 28, 2014, at 7:42 PM, Stephen Boesch <java...@gmail.com> > wrote: > >> > > >> > I have run on the command line via maven and it is fine: > >> > > >> > mvn -Dscalastyle.failOnViolation=false -DskipTests -Pyarn > -Phadoop-2.3 > >> > compile package install > >> > > >> > > >> > But with the latest code Intellij builds do not work. Following is > one of > >> > 26 similar errors: > >> > > >> > > >> > Error:(173, 38) not found: value HiveShim > >> > > >> Option(tableParameters.get(HiveShim.getStatsSetupConstTotalSize)) > >> > ^ > >> > >> >