It just stays stuck when I try to connect using http transport mode. [hiveclient]# hive --service beeline -u jdbc:hive2://hiveservice:11000/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice scan complete in 3ms Connecting to jdbc:hive2://hiveservice:11000/default?hive.server2.transport.mode=http
Telnet works for me. [hiveclient]# telnet hiveservice 11000 Trying 192.168.1.167... Connected to hiveservice (192.168.1.167). Escape character is '^]'. On the thrift server, it is listening on port 11000. I see some sessions in CLOSE_WAIT from my client. [hiveservice]# netstat -pan | grep 11000 tcp 0 0 :::11000 :::* LISTEN 21978/java tcp 0 0 ::ffff:192.168.1.167:11000 ::ffff:192.168.1.133:51548 CLOSE_WAIT 21978/java tcp 0 0 ::ffff:192.168.1.167:11000 ::ffff:192.168.1.133:35499 CLOSE_WAIT 21978/java [hiveservice]# ps -ef | grep hive root 21976 1 0 Jul02 ? 00:00:00 /sbin/runuser -s /bin/sh -c /usr/bin/hive --service hiveserver2 hadoop hadoop 21978 21976 0 Jul02 ? 00:00:07 /usr/java/latest/bin/java -Xmx2000m -Dhadoop.log.dir=/opt/hadoop-0.20.2-shell-dev/bin/../logs -Dhadoop.log.file=hadoop.log -Dhadoop.home.dir=/opt/hadoop-0.20.2-shell-dev/bin/.. -Dhadoop.id.str= -Dhadoop.root.logger=INFO,console -Djava.library.path=/opt/hadoop-0.20.2-shell-dev/bin/../lib/native/Linux-amd64-64 -Dhadoop.policy.file=hadoop-policy.xml -classpath /opt/hadoop-0.20.2-shell-dev/bin/../conf:/usr/java/latest/lib/tools.jar:/opt/hadoop-0.20.2-shell-dev/bin/../hadoop-0.20.2-core.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-cli-1.2.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-codec-1.3.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-el-1.0.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-httpclient-3.0.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-logging-1.0.4.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-logging-api-1.0.4.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-net-1.4.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/core-3.1.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/hadoop-lib-1.5.8.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/hadoop-snappy-0.0.1-SNAPSHOT.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/hsqldb-1.8.0.10.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jasper-compiler-5.5.12.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jasper-runtime-5.5.12.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jets3t-0.6.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jetty-6.1.14.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jetty-util-6.1.14.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/junit-3.8.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/kfs-0.2.2.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/log4j-1.2.15.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/mockito-all-1.8.0.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/mysql-connector-java-5.0.8-bin.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/oro-2.0.8.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/servlet-api-2.5-6.1.14.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/slf4j-api-1.4.3.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/slf4j-log4j12-1.4.3.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/xmlenc-0.52.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jsp-2.1/jsp-2.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jsp-2.1/jsp-api-2.1.jar::/opt/hive-conf/dev:/opt/hive-0.12.0/lib/antlr-runtime-3.4.jar:/opt/hive-0.12.0/lib/avro-1.7.1.jar:/opt/hive-0.12.0/lib/avro-mapred-1.7.1.jar:/opt/hive-0.12.0/lib/bonecp-0.7.1.RELEASE.jar:/opt/hive-0.12.0/lib/commons-cli-1.2.jar:/opt/hive-0.12.0/lib/commons-codec-1.4.jar:/opt/hive-0.12.0/lib/commons-codec-1.6.jar:/opt/hive-0.12.0/lib/commons-collections-3.2.1.jar:/opt/hive-0.12.0/lib/commons-compress-1.4.1.jar:/opt/hive-0.12.0/lib/commons-configuration-1.6.jar:/opt/hive-0.12.0/lib/commons-io-2.4.jar:/opt/hive-0.12.0/lib/commons-lang-2.4.jar:/opt/hive-0.12.0/lib/commons-logging-1.1.1.jar:/opt/hive-0.12.0/lib/commons-logging-api-1.0.4.jar:/opt/hive-0.12.0/lib/commons-pool-1.5.4.jar:/opt/hive-0.12.0/lib/datanucleus-api-jdo-3.2.1.jar:/opt/hive-0.12.0/lib/datanucleus-core-3.2.2.jar:/opt/hive-0.12.0/lib/datanucleus-rdbms-3.2.1.jar:/opt/hive-0.12.0/lib/derby-10.4.2.0.jar:/opt/hive-0.12.0/lib/guava-11.0.2.jar:/opt/hive-0.12.0/lib/hbase-0.94.6.1.jar:/opt/hive-0.12.0/lib/hbase-0.94.6.1-tests.jar:/opt/hive-0.12.0/lib/hive-beeline-0.12.0.jar:/opt/hive-0.12.0/lib/hive-cli-0.12.0.jar:/opt/hive-0.12.0/lib/hive-common-0.12.0.jar:/opt/hive-0.12.0/lib/hive-contrib-0.12.0.jar:/opt/hive-0.12.0/lib/hive-exec-0.12.0.jar:/opt/hive-0.12.0/lib/hive-hbase-handler-0.12.0.jar:/opt/hive-0.12.0/lib/hive-hwi-0.12.0.jar:/opt/hive-0.12.0/lib/hive-jdbc-0.12.0.jar:/opt/hive-0.12.0/lib/hive-metastore-0.12.0.jar:/opt/hive-0.12.0/lib/hive-serde-0.12.0.jar:/opt/hive-0.12.0/lib/hive-service-0.12.0.jar:/opt/hive-0.12.0/lib/hive-shims-0.12.0.jar:/opt/hive-0.12.0/lib/httpclient-4.2.5.jar:/opt/hive-0.12.0/lib/httpcore-4.2.4.jar:/opt/hive-0.12.0/lib/jackson-core-asl-1.8.8.jar:/opt/hive-0.12.0/lib/jackson-jaxrs-1.8.8.jar:/opt/hive-0.12.0/lib/jackson-mapper-asl-1.8.8.jar:/opt/hive-0.12.0/lib/jackson-xc-1.8.8.jar:/opt/hive-0.12.0/lib/JavaEWAH-0.3.2.jar:/opt/hive-0.12.0/lib/javolution-5 On Wed, Jul 2, 2014 at 11:48 PM, Andre Araujo <ara...@pythian.com> wrote: > Does this work? > > > jdbc:hive2://hiveservice:11000/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice > > Are you certain that HiveServer2 daemon is running on hiveservice AND > listening on port 11000? > > > > On 3 July 2014 13:12, Hang Chan <h...@needsystem.com> wrote: > >> hive.server.read.socket.timeout=10 >> hive.server.tcp.keepalive=true >> hive.server2.async.exec.shutdown.timeout=10 >> hive.server2.async.exec.threads=50 >> hive.server2.authentication=NONE >> hive.server2.enable.doAs=true >> hive.server2.table.type.mapping=CLASSIC >> hive.server2.thrift.http.max.worker.threads=500 >> hive.server2.thrift.http.min.worker.threads=5 >> hive.server2.thrift.http.path=cliservice >> hive.server2.thrift.http.port=10001 >> hive.server2.thrift.max.worker.threads=500 >> hive.server2.thrift.min.worker.threads=5 >> hive.server2.thrift.port=11000 >> hive.server2.thrift.sasl.qop=auth >> hive.server2.transport.mode=binary >> >> >> On Wed, Jul 2, 2014 at 10:55 PM, Andre Araujo <ara...@pythian.com> wrote: >> >>> Did you explicitly change the HiveServer2 port to 11000? The default is >>> 10000. >>> >>> Can you provide the output of the following ? >>> >>> hive -e set | grep hive.server >>> >>> >>> >>> On 3 July 2014 11:08, Hang Chan <h...@needsystem.com> wrote: >>> >>>> It's not a dns problem. I just substituted my real server name with >>>> "hiveservice". I confirmed that the hostname is indeed resolvable in dns. >>>> I also tried using the ip address in place of the hostname and I still get >>>> the same error. >>>> >>>> >>>> On Wed, Jul 2, 2014 at 5:36 PM, Andre Araujo <ara...@pythian.com> >>>> wrote: >>>> >>>>> If the name "hiveserver" is not resolved correctly, that's the exact >>>>> error you'd getting. >>>>> Does "nslookup hiveservice" resolve the name successfully? >>>>> >>>>> Try using the fully qualified name instead. >>>>> >>>>> >>>>> On 3 July 2014 07:01, Szehon Ho <sze...@cloudera.com> wrote: >>>>> >>>>>> I believe you should be able to put in anything by default. The hive >>>>>> jdbc url is of the form jdbc:hive2://<host>:<port>, is the url correct? >>>>>> >>>>>> Thanks, >>>>>> Szehon >>>>>> >>>>>> >>>>>> On Wed, Jul 2, 2014 at 10:16 AM, Hang Chan <h...@needsystem.com> >>>>>> wrote: >>>>>> >>>>>>> beeline does not seem to be connecting remotely. It works if I >>>>>>> connect using the embedded client. I am using all the default >>>>>>> configurations, except I configured my hiveserver2 thrift port to 11000. >>>>>>> If I put in the database name after the port number, it will prompt me >>>>>>> for >>>>>>> a username and password. I just put in anything, but that doesn't seem >>>>>>> to >>>>>>> work. I thought that by default there should be no authentication. >>>>>>> >>>>>>> [hiveclient]# hive --service beeline -u >>>>>>> jdbc:hive2://hiveservice:11000 >>>>>>> scan complete in 2ms >>>>>>> Connecting to jdbc:hive2://hiveservice:11000 >>>>>>> Error: Invalid URL: jdbc:hive2://hiveservice:11000 >>>>>>> (state=08S01,code=0) >>>>>>> -hiveconf (No such file or directory) >>>>>>> hive.aux.jars.path=file:............................. >>>>>>> Beeline version 0.12.0 by Apache Hive >>>>>>> 0: jdbc:hive2://hiveservice:11000> show tables; >>>>>>> No current connection >>>>>>> >>>>>>> [hiveclient]# hive --service beeline -u jdbc:hive2:// >>>>>>> scan complete in 3ms >>>>>>> Connecting to jdbc:hive2:// >>>>>>> 14/07/02 12:37:47 INFO service.CompositeService: HiveServer2: Async >>>>>>> execution pool size50 >>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>> Service:OperationManager is inited. >>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>> Service:SessionManager is inited. >>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: Service:CLIService >>>>>>> is inited. >>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>> Service:OperationManager is started. >>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>> Service:SessionManager is started. >>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: Service:CLIService >>>>>>> is started. >>>>>>> 14/07/02 12:37:47 INFO hive.metastore: Trying to connect to >>>>>>> metastore with URI thrift://hiveservice:9083 >>>>>>> 14/07/02 12:37:47 INFO hive.metastore: Waiting 1 seconds before next >>>>>>> connection attempt. >>>>>>> 14/07/02 12:37:48 INFO hive.metastore: Connected to metastore. >>>>>>> 14/07/02 12:37:48 INFO cli.CLIService: SessionHandle >>>>>>> [7e1279d9-4342-48f1-9c49-1377734062e5]: openSession() >>>>>>> 14/07/02 12:37:48 INFO cli.CLIService: SessionHandle >>>>>>> [7e1279d9-4342-48f1-9c49-1377734062e5]: getInfo() >>>>>>> Connected to: Hive (version 0.12.0) >>>>>>> Driver: Hive (version 0.12.0) >>>>>>> Transaction isolation: TRANSACTION_REPEATABLE_READ >>>>>>> -hiveconf (No such file or directory) >>>>>>> hive.aux.jars.path=file:...... >>>>>>> Beeline version 0.12.0 by Apache Hive >>>>>>> 0: jdbc:hive2://> show tables; >>>>>>> +--------------------------------------------------------+ >>>>>>> | tab_name | >>>>>>> +--------------------------------------------------------+ >>>>>>> | abc | >>>>>>> >>>>>>> 731 rows selected (2.345 seconds) >>>>>>> 14/07/02 12:38:05 INFO exec.ListSinkOperator: 0 finished. closing... >>>>>>> 14/07/02 12:38:05 INFO exec.ListSinkOperator: 0 forwarded 0 rows >>>>>>> 14/07/02 12:38:05 INFO ql.Driver: <PERFLOG method=releaseLocks> >>>>>>> 14/07/02 12:38:05 INFO ql.Driver: </PERFLOG method=releaseLocks >>>>>>> start=1404319085209 end=1404319085209 duration=0> >>>>>>> 14/07/02 12:38:05 INFO zookeeper.ZooKeeper: Session: >>>>>>> 0x245f6924c200129 closed >>>>>>> 14/07/02 12:38:05 INFO zookeeper.ClientCnxn: EventThread shut down >>>>>>> 14/07/02 12:38:05 INFO cli.CLIService: OperationHandle >>>>>>> [opType=EXECUTE_STATEMENT, >>>>>>> getHandleIdentifier()=c05a98eb-1077-4732-9b18-c638e0b0a402]: >>>>>>> closeOperation >>>>>>> 0: jdbc:hive2://> >>>>>>> >>>>>>> Thanks, >>>>>>> Hang >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> André Araújo >>>>> Big Data Consultant/Solutions Architect >>>>> The Pythian Group - Australia - www.pythian.com >>>>> >>>>> Office (calls from within Australia): 1300 366 021 x1270 >>>>> Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 >>>>> x1270 >>>>> Mobile: +61 410 323 559 >>>>> Fax: +61 2 9805 0544 >>>>> IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk >>>>> >>>>> “Success is not about standing at the top, it's the steps you leave >>>>> behind.” — Iker Pou (rock climber) >>>>> >>>>> -- >>>>> >>>>> >>>>> >>>>> >>>> >>> >>> >>> -- >>> André Araújo >>> Big Data Consultant/Solutions Architect >>> The Pythian Group - Australia - www.pythian.com >>> >>> Office (calls from within Australia): 1300 366 021 x1270 >>> Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 >>> x1270 >>> Mobile: +61 410 323 559 >>> Fax: +61 2 9805 0544 >>> IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk >>> >>> “Success is not about standing at the top, it's the steps you leave >>> behind.” — Iker Pou (rock climber) >>> >>> -- >>> >>> >>> >>> >> > > > -- > André Araújo > Big Data Consultant/Solutions Architect > The Pythian Group - Australia - www.pythian.com > > Office (calls from within Australia): 1300 366 021 x1270 > Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 x1270 > Mobile: +61 410 323 559 > Fax: +61 2 9805 0544 > IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk > > “Success is not about standing at the top, it's the steps you leave behind.” > — Iker Pou (rock climber) > > -- > > > >
