I was curious if any one was able to get CDH 5.4.1 or 5.4.2 compiling with
the v1.4.0 tag out of git? SparkSQL keeps dying on me and not 100% why.
I modified the pom.xml to mak a simple profile to help:
<profile>
<id>cdh542</id>
<properties>
<java.version>1.7</java.version>
<flume.version>1.5.0-cdh5.4.2</flume.version>
<hadoop.version>2.6.0-cdh5.4.2</hadoop.version>
<yarn.version>${hadoop.version}</yarn.version>
<hive.version>1.1.0-cdh5.4.2</hive.version>
<hive.version.short>1.1.0-cdh5.4.2</hive.version.short>
<hbase.version>1.0.0-cdh5.4.2</hbase.version>
<zookeeper.version>3.4.5-cdh5.4.2</zookeeper.version>
<avro.version>1.7.6-cdh5.4.2</avro.version>
<parquet.version>1.5.0-cdh5.4.2</parquet.version>
</properties>
<modules>
<module>yarn</module>
<module>network/yarn</module>
<module>sql/hive-thriftserver</module>
</modules>
</profile>
I have tried removing the "hive" properties, and let it use the default
0.13, but, fails in the same place.
mvn clean package -DskipTests -Pcdh542
Using the standard,
mvn clean package -Phadoop-2.6 -Pyarn -Phive-thriftserver
works great..so, it's got to be something with CDH's JARs..just not sure
what. And doing a mvn -X didn't lead me anywhere....thoughts? help? URLs
to read?
Thanks in advance.
Cheers,
Aaron