Thanks a lot Bob. Unfortunately this wont help me since I am trying to set it up in my local machine. I had tried the version Hadoop (2.3.0), PIG (12.0) and HBase (0.98.1) combination. It doesnt work out of the box. And I am not able to debug it either.
I also tried the combination that EMR offers. Again, doesnt work. The one that worked was the Debianised version - Apache Bigtop. But the versions are too old. On Sat, Oct 4, 2014 at 1:28 AM, Bob Metelsky <[email protected]> wrote: > Hi - I just installed CDH 5.3 with hadoop 2.3 with cloudera manager on a 4 > node cluster - here is the output of the latest & greatest > > Version Summary > *Cluster 1 — CDH 5*Hostsdn[776-778].hadoop.lab; nn775.hadoop.lab*Component* > VersionReleaseCDH VersionBigtop-Tomcat (CDH 5 only)0.7.0+cdh5.1.3+0 > 1.cdh5.1.3.p0.12CDH 5Crunch (CDH 5 > only)0.10.0+cdh5.1.3+181.cdh5.1.3.p0.10CDH > 5Flume NG1.5.0+cdh5.1.3+151.cdh5.1.3.p0.9CDH 5MapReduce 12.3.0+cdh5.1.3+824 > 1.cdh5.1.3.p0.13CDH 5HDFS2.3.0+cdh5.1.3+8241.cdh5.1.3.p0.13CDH 5HttpFS > 2.3.0+cdh5.1.3+8241.cdh5.1.3.p0.13CDH 5MapReduce 22.3.0+cdh5.1.3+824 > 1.cdh5.1.3.p0.13CDH 5YARN2.3.0+cdh5.1.3+8241.cdh5.1.3.p0.13CDH 5Hadoop > 2.3.0+cdh5.1.3+8241.cdh5.1.3.p0.13CDH 5Lily HBase Indexer1.5+cdh5.1.3+16 > 1.cdh5.1.3.p0.9CDH 5HBase0.98.1+cdh5.1.3+821.cdh5.1.3.p0.12CDH 5HCatalog > 0.12.0+cdh5.1.3+3811.cdh5.1.3.p0.11CDH 5Hive0.12.0+cdh5.1.3+381 > 1.cdh5.1.3.p0.11CDH 5Hue3.6.0+cdh5.1.3+1081.cdh5.1.3.p0.9CDH 5Impala > 1.4.2+cdh5.1.3+01.cdh5.1.3.p0.14CDH 5Kite (CDH 5 only)0.10.0+cdh5.1.3+124 > 1.cdh5.1.3.p0.9CDH 5Llama (CDH 5 only)1.0.0+cdh5.1.3+01.cdh5.1.3.p0.12CDH 5 > Mahout0.9+cdh5.1.3+151.cdh5.1.3.p0.13CDH 5Oozie4.0.0+cdh5.1.3+255 > 1.cdh5.1.3.p0.9CDH 5Parquet1.2.5+cdh5.1.3+1381.cdh5.1.3.p0.11CDH 5Pig > 0.12.0+cdh5.1.3+371.cdh5.1.3.p0.10CDH 5sentry1.3.0+cdh5.1.3+162 > 1.cdh5.1.3.p0.9CDH 5Solr4.4.0+cdh5.1.3+2351.cdh5.1.3.p0.10CDH 5spark > 1.0.0+cdh5.1.3+451.cdh5.1.3.p0.10CDH > 5Sqoop1.4.4+cdh5.1.3+591.cdh5.1.3.p0.9CDH > 5Sqoop21.99.3+cdh5.1.3+301.cdh5.1.3.p0.9CDH 5Whirr0.9.0+cdh5.1.3+13 > 1.cdh5.1.3.p0.9CDH 5Zookeeper3.4.5+cdh5.1.3+331.cdh5.1.3.p0.14CDH 5Cloudera > Manager Management Daemons5.1.31.cm513.p0.155Not applicableJava 6java > version "1.6.0_32" OpenJDK Runtime Environment (IcedTea6 1.13.4) > (rhel-7.1.13.4.el6_5-x86_64) OpenJDK 64-Bit Server VM (build 23.25-b01, > mixed mode)UnavailableNot applicableJava 7java version "1.7.0_55" Java(TM) > SE Runtime Environment (build 1.7.0_55-b13) Java HotSpot(TM) 64-Bit Server > VM (build 24.55-b03, mixed mode)UnavailableNot applicableCloudera Manager > Agent5.1.3 > > On Fri, Oct 3, 2014 at 3:39 PM, Mahesh M <[email protected]> wrote: > > > Hi guys, > > > > It will be great if someone could help me with the compatibility issues > (I > > am assuming that I am stuck because of that). Which combination of the > > latest versions should be used to get PIG, HBase and Hadoop up and > running > > and what are the steps that are required to be done so that they all can > > talk to each other? > > > > I would be happy to document the same somewhere and make it available for > > public. > > > > I think it will be great if we could have a place where in the > > compatibility of various versions of Hadoop, HBase and PIG are > maintained. > > This will help people like me who assume that the latest version of all > > should give a system that is up and running in least time. > > > > -- > > Regards, > > > > Mahesh M > > > -- Regards, Mahesh M
