Hi *Siddharth,
*Did you also install the PHD (Pentaho Distribution for Hadoop) on the cluster side? On my cluster (with PHD installed) there are a lot of Pentaho specific jars in /usr/lib/hadoop-0.20/lib for instance: hive-exec-0.7.0-pentaho-1.0.0.jar hive-jdbc-0.7.0-pentaho-1.0.0.jar hive-metastore-0.7.0-pentaho-1.0.0.jar hive-serde-0.7.1-cdh3u1.jar hive-service-0.7.0-pentaho-1.0.0. I guess these play a role in connecting Pentaho to the Hive server. Cheers Jasper 2011/9/12 Ashutosh Chauhan <[email protected]> > >> Caused by: java.lang.ClassNotFoundException: > org.apache.hadoop.io.Writable > Seems like you have classpath issues. Make sure hadoop-core.jar (or > whatever is the name of your hadoop jars) are in classpath > > Hope it helps, > Ashutosh > > On Mon, Sep 12, 2011 at 09:20, Siddharth Tiwari <[email protected] > > wrote: > >> Hi Jasper >> I am on Pentaho BI suite 4.0 and Hive 0.7.1 ... please help >> >> >> **------------------------** >> *Cheers !!!* >> *Siddharth Tiwari* >> Have a refreshing day !!! >> >> >> ------------------------------ >> Date: Mon, 12 Sep 2011 11:47:06 +0200 >> Subject: Re: Pentaho issue with hive >> From: [email protected] >> To: [email protected] >> >> >> Hi Siddharth, >> >> What versions of Hive and Pentaho are you on ? >> >> GR. Jasper >> >> 2011/9/12 Siddharth Tiwari <[email protected]> >> >> Hi users,I face this issue while connecting to hive >> started hive using: HIVE_PORT=10000 hive --service hiveserver >> Starting hive thrift server >> >> No information after it >> netstat shows: >> sudo netstat -anltp|grep :10000 >> [sudo] password for hduser: >> tcp 0 0 0.0.0.0:10000 0.0.0.0:* >> LISTEN 13631/java >> >> jps output: >> >> 2200 DataNode >> 14386 Jps >> 9361 HRegionServer >> 9180 HMaster >> 13631 RunJar >> 2460 JobTracker >> 14220 Launcher >> 9127 HQuorumPeer >> 2622 TaskTracker >> 2009 NameNode >> 2377 SecondaryNameNode >> >> Following is pentaho error reported by report-designer, pls help >> >> Error connecting to database [hive] : >> org.pentaho.di.core.exception.KettleDatabaseException: >> Error occured while trying to connect to the database >> >> Error connecting to database: (using class >> org.apache.hadoop.hive.jdbc.HiveDriver) >> org/apache/hadoop/io/Writable >> >> >> org.pentaho.di.core.exception.KettleDatabaseException: >> Error occured while trying to connect to the database >> >> Error connecting to database: (using class >> org.apache.hadoop.hive.jdbc.HiveDriver) >> org/apache/hadoop/io/Writable >> >> >> at org.pentaho.di.core.database.Database.normalConnect(Database.java:374) >> at org.pentaho.di.core.database.Database.connect(Database.java:323) >> at org.pentaho.di.core.database.Database.connect(Database.java:285) >> at org.pentaho.di.core.database.Database.connect(Database.java:275) >> at >> org.pentaho.di.core.database.DatabaseFactory.getConnectionTestReport(DatabaseFactory.java:76) >> at >> org.pentaho.di.core.database.DatabaseMeta.testConnection(DatabaseMeta.java:2455) >> at >> org.pentaho.ui.database.event.DataHandler.testDatabaseConnection(DataHandler.java:511) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329) >> at >> org.pentaho.ui.xul.swing.tags.SwingButton$OnClickRunnable.run(SwingButton.java:58) >> at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:226) >> at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:647) >> at java.awt.EventQueue.access$000(EventQueue.java:96) >> at java.awt.EventQueue$1.run(EventQueue.java:608) >> at java.awt.EventQueue$1.run(EventQueue.java:606) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:105) >> at java.awt.EventQueue.dispatchEvent(EventQueue.java:617) >> at >> java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:275) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:200) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:194) >> at java.awt.Dialog$1.run(Dialog.java:1072) >> at java.awt.Dialog$3.run(Dialog.java:1126) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.awt.Dialog.show(Dialog.java:1124) >> at java.awt.Component.show(Component.java:1551) >> at java.awt.Component.setVisible(Component.java:1503) >> at java.awt.Window.setVisible(Window.java:881) >> at java.awt.Dialog.setVisible(Dialog.java:1011) >> at org.pentaho.ui.xul.swing.tags.SwingDialog.show(SwingDialog.java:234) >> at >> org.pentaho.reporting.ui.datasources.jdbc.ui.XulDatabaseDialog.open(XulDatabaseDialog.java:256) >> at >> org.pentaho.reporting.ui.datasources.jdbc.ui.ConnectionPanel$AddDataSourceAction.actionPerformed(ConnectionPanel.java:255) >> at >> javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2012) >> at >> javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2335) >> at >> javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:404) >> at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259) >> at >> javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:253) >> at >> java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289) >> at >> java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289) >> at java.awt.Component.processMouseEvent(Component.java:6268) >> at javax.swing.JComponent.processMouseEvent(JComponent.java:3267) >> at java.awt.Component.processEvent(Component.java:6033) >> at java.awt.Container.processEvent(Container.java:2045) >> at java.awt.Component.dispatchEventImpl(Component.java:4629) >> at java.awt.Container.dispatchEventImpl(Container.java:2103) >> at java.awt.Component.dispatchEvent(Component.java:4455) >> at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4633) >> at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4297) >> at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4227) >> at java.awt.Container.dispatchEventImpl(Container.java:2089) >> at java.awt.Window.dispatchEventImpl(Window.java:2517) >> at java.awt.Component.dispatchEvent(Component.java:4455) >> at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:649) >> at java.awt.EventQueue.access$000(EventQueue.java:96) >> at java.awt.EventQueue$1.run(EventQueue.java:608) >> at java.awt.EventQueue$1.run(EventQueue.java:606) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:105) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:116) >> at java.awt.EventQueue$2.run(EventQueue.java:622) >> at java.awt.EventQueue$2.run(EventQueue.java:620) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:105) >> at java.awt.EventQueue.dispatchEvent(EventQueue.java:619) >> at >> java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:275) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:200) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:194) >> at java.awt.Dialog$1.run(Dialog.java:1072) >> at java.awt.Dialog$3.run(Dialog.java:1126) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.awt.Dialog.show(Dialog.java:1124) >> at java.awt.Component.show(Component.java:1551) >> at java.awt.Component.setVisible(Component.java:1503) >> at java.awt.Window.setVisible(Window.java:881) >> at java.awt.Dialog.setVisible(Dialog.java:1011) >> at >> org.pentaho.reporting.ui.datasources.jdbc.ui.SimpleJdbcDataSourceDialog.performConfiguration(SimpleJdbcDataSourceDialog.java:152) >> at >> org.pentaho.reporting.ui.datasources.jdbc.SimpleJdbcDataSourcePlugin.performEdit(SimpleJdbcDataSourcePlugin.java:70) >> at >> org.pentaho.reporting.engine.classic.wizard.ui.xul.steps.DataSourceAndQueryStep.editOrCreateDataFactory(DataSourceAndQueryStep.java:429) >> at >> org.pentaho.reporting.engine.classic.wizard.ui.xul.steps.DataSourceAndQueryStep.createDataFactory(DataSourceAndQueryStep.java:409) >> at >> org.pentaho.reporting.engine.classic.wizard.ui.xul.steps.DataSourceAndQueryStep$DatasourceAndQueryStepHandler.doCreateDataFactory(DataSourceAndQueryStep.java:169) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:616) >> at >> org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329) >> at >> org.pentaho.ui.xul.swing.tags.SwingButton$OnClickRunnable.run(SwingButton.java:58) >> at java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:226) >> at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:647) >> at java.awt.EventQueue.access$000(EventQueue.java:96) >> at java.awt.EventQueue$1.run(EventQueue.java:608) >> at java.awt.EventQueue$1.run(EventQueue.java:606) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:105) >> at java.awt.EventQueue.dispatchEvent(EventQueue.java:617) >> at >> java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:275) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:200) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:194) >> at java.awt.Dialog$1.run(Dialog.java:1072) >> at java.awt.Dialog$3.run(Dialog.java:1126) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.awt.Dialog.show(Dialog.java:1124) >> at java.awt.Component.show(Component.java:1551) >> at java.awt.Component.setVisible(Component.java:1503) >> at java.awt.Window.setVisible(Window.java:881) >> at java.awt.Dialog.setVisible(Dialog.java:1011) >> at org.pentaho.ui.xul.swing.tags.SwingDialog.show(SwingDialog.java:234) >> at >> org.pentaho.reporting.engine.classic.wizard.ui.xul.EmbeddedWizard.run(EmbeddedWizard.java:145) >> at >> org.pentaho.reporting.designer.extensions.wizard.NewWizardReportAction.actionPerformed(NewWizardReportAction.java:79) >> at >> javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2012) >> at >> javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2335) >> at >> javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:404) >> at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259) >> at >> javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:253) >> at java.awt.Component.processMouseEvent(Component.java:6268) >> at javax.swing.JComponent.processMouseEvent(JComponent.java:3267) >> at java.awt.Component.processEvent(Component.java:6033) >> at java.awt.Container.processEvent(Container.java:2045) >> at java.awt.Component.dispatchEventImpl(Component.java:4629) >> at java.awt.Container.dispatchEventImpl(Container.java:2103) >> at java.awt.Component.dispatchEvent(Component.java:4455) >> at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4633) >> at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4297) >> at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4227) >> at java.awt.Container.dispatchEventImpl(Container.java:2089) >> at java.awt.Window.dispatchEventImpl(Window.java:2517) >> at java.awt.Component.dispatchEvent(Component.java:4455) >> at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:649) >> at java.awt.EventQueue.access$000(EventQueue.java:96) >> at java.awt.EventQueue$1.run(EventQueue.java:608) >> at java.awt.EventQueue$1.run(EventQueue.java:606) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:105) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:116) >> at java.awt.EventQueue$2.run(EventQueue.java:622) >> at java.awt.EventQueue$2.run(EventQueue.java:620) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> java.security.AccessControlContext$1.doIntersectionPrivilege(AccessControlContext.java:105) >> at java.awt.EventQueue.dispatchEvent(EventQueue.java:619) >> at >> java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:275) >> at >> java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:200) >> at >> java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:190) >> at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:185) >> at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:177) >> at java.awt.EventDispatchThread.run(EventDispatchThread.java:138) >> Caused by: org.pentaho.di.core.exception.KettleDatabaseException: >> Error connecting to database: (using class >> org.apache.hadoop.hive.jdbc.HiveDriver) >> org/apache/hadoop/io/Writable >> >> at >> org.pentaho.di.core.database.Database.connectUsingClass(Database.java:514) >> at org.pentaho.di.core.database.Database.normalConnect(Database.java:358) >> ... 146 more >> Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/io/Writable >> at >> org.apache.hadoop.hive.jdbc.HiveStatement.executeQuery(HiveStatement.java:196) >> at >> org.apache.hadoop.hive.jdbc.HiveStatement.execute(HiveStatement.java:130) >> at >> org.apache.hadoop.hive.jdbc.HiveConnection.configureConnection(HiveConnection.java:107) >> at >> org.apache.hadoop.hive.jdbc.HiveConnection.<init>(HiveConnection.java:102) >> at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104) >> at java.sql.DriverManager.getConnection(DriverManager.java:620) >> at java.sql.DriverManager.getConnection(DriverManager.java:222) >> at >> org.pentaho.di.core.database.Database.connectUsingClass(Database.java:496) >> ... 147 more >> Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.io.Writable >> at java.net.URLClassLoader$1.run(URLClassLoader.java:217) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:205) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:321) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:266) >> ... 155 more >> >> Hostname : >> Port : 1521 >> Database name : >> >> >> **------------------------** >> *Cheers !!!* >> *Siddharth Tiwari* >> >> >> >> > > --
