The error in log is 'java.lang.ClassNotFoundException: org.postgresql.Driver', not can't connect or user name or password error.
On Wed, Aug 17, 2011 at 3:53 PM, Jander g <jande...@gmail.com> wrote: > Hi,wd > > You should configure "hive.stats.dbconnectionstring" as follows. > > > <property> > <name>hive.stats.dbconnectionstring</name> > > > <value>jdbc:postgresql://localhost/hive_statsdb?createDatabaseIfNotExist=true&user=hive&password=pwd</value> > > <description>The default connection string for the database that > stores temporary hive statistics.</description> > </property> > > Regards, > > Jander. > > > On Mon, Aug 15, 2011 at 3:09 PM, wd <w...@wdicc.com> wrote: > >> hi, >> >> I'm try to use postgres as stats database. And made following settings >> in hive-site.xml >> >> >> <property> >> <name>hive.stats.dbclass</name> >> <value>jdbc:postgresql</value> >> <description>The default database that stores temporary hive >> statistics.</description> >> </property> >> >> <property> >> <name>hive.stats.autogather</name> >> <value>true</value> >> <description>A flag to gather statistics automatically during the >> INSERT OVERWRITE command.</description> >> </property> >> >> <property> >> <name>hive.stats.jdbcdriver</name> >> <value>org.postgresql.Driver</value> >> <description>The JDBC driver for the database that stores temporary >> hive statistics.</description> >> </property> >> >> <property> >> <name>hive.stats.dbconnectionstring</name> >> >> >> <value>jdbc:postgresql://localhost/hive_statsdb?createDatabaseIfNotExist=true;user=hive;password=pwd</value> >> <description>The default connection string for the database that >> stores temporary hive statistics.</description> >> </property> >> >> I use postgres as hive meta database, so there is a >> postgresql-9.0-801.jdbc4.jar file in lib. >> >> After run 'analyse table t1 partitions(dt) comput statistics;' in hive >> cli, it will output some stats info in cli, but nothing in db. And I >> can found there is the flowing errors >> >> 1-08-15 14:54:54,767 INFO >> org.apache.hadoop.hive.ql.exec.TableScanOperator: Stats Gathering >> found a new partition spec = dt=20110805 >> 2011-08-15 14:54:54,767 INFO >> org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 forwarding 1 rows >> 2011-08-15 14:54:54,767 INFO ExecMapper: ExecMapper: processing 1 >> rows: used memory = 39953640 >> 2011-08-15 14:54:54,768 INFO >> org.apache.hadoop.hive.ql.exec.MapOperator: 1 finished. closing... >> 2011-08-15 14:54:54,768 INFO >> org.apache.hadoop.hive.ql.exec.MapOperator: 1 forwarded 2 rows >> 2011-08-15 14:54:54,768 INFO >> org.apache.hadoop.hive.ql.exec.MapOperator: DESERIALIZE_ERRORS:0 >> 2011-08-15 14:54:54,768 INFO >> org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 finished. >> closing... >> 2011-08-15 14:54:54,768 INFO >> org.apache.hadoop.hive.ql.exec.TableScanOperator: 0 forwarded 2 rows >> 2011-08-15 14:54:54,772 ERROR >> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher: Error during >> JDBC connection to >> >> jdbc:postgresql://localhost/hive_statsdb?createDatabaseIfNotExist=true;user=hive;password=pwd. >> java.lang.ClassNotFoundException: org.postgresql.Driver >> at java.net.URLClassLoader$1.run(URLClassLoader.java:202) >> at java.security.AccessController.doPrivileged(Native Method) >> at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:307) >> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> at java.lang.ClassLoader.loadClass(ClassLoader.java:248) >> at java.lang.Class.forName0(Native Method) >> at java.lang.Class.forName(Class.java:169) >> at >> org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.connect(JDBCStatsPublisher.java:55) >> at >> org.apache.hadoop.hive.ql.exec.TableScanOperator.publishStats(TableScanOperator.java:202) >> at >> org.apache.hadoop.hive.ql.exec.TableScanOperator.closeOp(TableScanOperator.java:164) >> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:557) >> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:566) >> at >> org.apache.hadoop.hive.ql.exec.ExecMapper.close(ExecMapper.java:193) >> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57) >> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:358) >> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:307) >> at org.apache.hadoop.mapred.Child.main(Child.java:170) >> 2011-08-15 14:54:54,774 INFO >> org.apache.hadoop.hive.ql.exec.TableScanOperator: StatsPublishing >> error: cannot connect to database. >> 2011-08-15 14:54:54,774 INFO >> org.apache.hadoop.hive.ql.exec.MapOperator: 1 Close done >> > > > > -- > Thanks, > Jander > >
