How about try this? hive --service beeline -u jdbc:hive2://hiveservice:10001/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice
In your previous response I see that you have "hive.server2.thrift.http.port=10001" On Thu, Jul 3, 2014 at 5:15 AM, Hang Chan <h...@needsystem.com> wrote: > It just stays stuck when I try to connect using http transport mode. > > [hiveclient]# hive --service beeline -u > jdbc:hive2://hiveservice:11000/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice > scan complete in 3ms > Connecting to > jdbc:hive2://hiveservice:11000/default?hive.server2.transport.mode=http > > Telnet works for me. > > [hiveclient]# telnet hiveservice 11000 > Trying 192.168.1.167... > Connected to hiveservice (192.168.1.167). > Escape character is '^]'. > > On the thrift server, it is listening on port 11000. I see some sessions > in CLOSE_WAIT from my client. > > [hiveservice]# netstat -pan | grep 11000 > tcp 0 0 :::11000 :::* > LISTEN 21978/java > tcp 0 0 ::ffff:192.168.1.167:11000 ::ffff: > 192.168.1.133:51548 CLOSE_WAIT 21978/java > tcp 0 0 ::ffff:192.168.1.167:11000 ::ffff: > 192.168.1.133:35499 CLOSE_WAIT 21978/java > > [hiveservice]# ps -ef | grep hive > root 21976 1 0 Jul02 ? 00:00:00 /sbin/runuser -s /bin/sh > -c /usr/bin/hive --service hiveserver2 hadoop > hadoop 21978 21976 0 Jul02 ? 00:00:07 /usr/java/latest/bin/java > -Xmx2000m -Dhadoop.log.dir=/opt/hadoop-0.20.2-shell-dev/bin/../logs > -Dhadoop.log.file=hadoop.log > -Dhadoop.home.dir=/opt/hadoop-0.20.2-shell-dev/bin/.. -Dhadoop.id.str= > -Dhadoop.root.logger=INFO,console > -Djava.library.path=/opt/hadoop-0.20.2-shell-dev/bin/../lib/native/Linux-amd64-64 > -Dhadoop.policy.file=hadoop-policy.xml -classpath > /opt/hadoop-0.20.2-shell-dev/bin/../conf:/usr/java/latest/lib/tools.jar:/opt/hadoop-0.20.2-shell-dev/bin/../hadoop-0.20.2-core.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-cli-1.2.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-codec-1.3.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-el-1.0.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-httpclient-3.0.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-logging-1.0.4.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-logging-api-1.0.4.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/commons-net-1.4.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/core-3.1.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/hadoop-lib-1.5.8.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/hadoop-snappy-0.0.1-SNAPSHOT.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/hsqldb-1.8.0.10.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jasper-compiler-5.5.12.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jasper-runtime-5.5.12.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jets3t-0.6.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jetty-6.1.14.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jetty-util-6.1.14.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/junit-3.8.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/kfs-0.2.2.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/log4j-1.2.15.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/mockito-all-1.8.0.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/mysql-connector-java-5.0.8-bin.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/oro-2.0.8.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/servlet-api-2.5-6.1.14.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/slf4j-api-1.4.3.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/slf4j-log4j12-1.4.3.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/xmlenc-0.52.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jsp-2.1/jsp-2.1.jar:/opt/hadoop-0.20.2-shell-dev/bin/../lib/jsp-2.1/jsp-api-2.1.jar::/opt/hive-conf/dev:/opt/hive-0.12.0/lib/antlr-runtime-3.4.jar:/opt/hive-0.12.0/lib/avro-1.7.1.jar:/opt/hive-0.12.0/lib/avro-mapred-1.7.1.jar:/opt/hive-0.12.0/lib/bonecp-0.7.1.RELEASE.jar:/opt/hive-0.12.0/lib/commons-cli-1.2.jar:/opt/hive-0.12.0/lib/commons-codec-1.4.jar:/opt/hive-0.12.0/lib/commons-codec-1.6.jar:/opt/hive-0.12.0/lib/commons-collections-3.2.1.jar:/opt/hive-0.12.0/lib/commons-compress-1.4.1.jar:/opt/hive-0.12.0/lib/commons-configuration-1.6.jar:/opt/hive-0.12.0/lib/commons-io-2.4.jar:/opt/hive-0.12.0/lib/commons-lang-2.4.jar:/opt/hive-0.12.0/lib/commons-logging-1.1.1.jar:/opt/hive-0.12.0/lib/commons-logging-api-1.0.4.jar:/opt/hive-0.12.0/lib/commons-pool-1.5.4.jar:/opt/hive-0.12.0/lib/datanucleus-api-jdo-3.2.1.jar:/opt/hive-0.12.0/lib/datanucleus-core-3.2.2.jar:/opt/hive-0.12.0/lib/datanucleus-rdbms-3.2.1.jar:/opt/hive-0.12.0/lib/derby-10.4.2.0.jar:/opt/hive-0.12.0/lib/guava-11.0.2.jar:/opt/hive-0.12.0/lib/hbase-0.94.6.1.jar:/opt/hive-0.12.0/lib/hbase-0.94.6.1-tests.jar:/opt/hive-0.12.0/lib/hive-beeline-0.12.0.jar:/opt/hive-0.12.0/lib/hive-cli-0.12.0.jar:/opt/hive-0.12.0/lib/hive-common-0.12.0.jar:/opt/hive-0.12.0/lib/hive-contrib-0.12.0.jar:/opt/hive-0.12.0/lib/hive-exec-0.12.0.jar:/opt/hive-0.12.0/lib/hive-hbase-handler-0.12.0.jar:/opt/hive-0.12.0/lib/hive-hwi-0.12.0.jar:/opt/hive-0.12.0/lib/hive-jdbc-0.12.0.jar:/opt/hive-0.12.0/lib/hive-metastore-0.12.0.jar:/opt/hive-0.12.0/lib/hive-serde-0.12.0.jar:/opt/hive-0.12.0/lib/hive-service-0.12.0.jar:/opt/hive-0.12.0/lib/hive-shims-0.12.0.jar:/opt/hive-0.12.0/lib/httpclient-4.2.5.jar:/opt/hive-0.12.0/lib/httpcore-4.2.4.jar:/opt/hive-0.12.0/lib/jackson-core-asl-1.8.8.jar:/opt/hive-0.12.0/lib/jackson-jaxrs-1.8.8.jar:/opt/hive-0.12.0/lib/jackson-mapper-asl-1.8.8.jar:/opt/hive-0.12.0/lib/jackson-xc-1.8.8.jar:/opt/hive-0.12.0/lib/JavaEWAH-0.3.2.jar:/opt/hive-0.12.0/lib/javolution-5 > > > > > On Wed, Jul 2, 2014 at 11:48 PM, Andre Araujo <ara...@pythian.com> wrote: > >> Does this work? >> >> >> jdbc:hive2://hiveservice:11000/default?hive.server2.transport.mode=http;hive.server2.thrift.http.path=cliservice >> >> Are you certain that HiveServer2 daemon is running on hiveservice AND >> listening on port 11000? >> >> >> >> On 3 July 2014 13:12, Hang Chan <h...@needsystem.com> wrote: >> >>> hive.server.read.socket.timeout=10 >>> hive.server.tcp.keepalive=true >>> hive.server2.async.exec.shutdown.timeout=10 >>> hive.server2.async.exec.threads=50 >>> hive.server2.authentication=NONE >>> hive.server2.enable.doAs=true >>> hive.server2.table.type.mapping=CLASSIC >>> hive.server2.thrift.http.max.worker.threads=500 >>> hive.server2.thrift.http.min.worker.threads=5 >>> hive.server2.thrift.http.path=cliservice >>> hive.server2.thrift.http.port=10001 >>> hive.server2.thrift.max.worker.threads=500 >>> hive.server2.thrift.min.worker.threads=5 >>> hive.server2.thrift.port=11000 >>> hive.server2.thrift.sasl.qop=auth >>> hive.server2.transport.mode=binary >>> >>> >>> On Wed, Jul 2, 2014 at 10:55 PM, Andre Araujo <ara...@pythian.com> >>> wrote: >>> >>>> Did you explicitly change the HiveServer2 port to 11000? The default is >>>> 10000. >>>> >>>> Can you provide the output of the following ? >>>> >>>> hive -e set | grep hive.server >>>> >>>> >>>> >>>> On 3 July 2014 11:08, Hang Chan <h...@needsystem.com> wrote: >>>> >>>>> It's not a dns problem. I just substituted my real server name with >>>>> "hiveservice". I confirmed that the hostname is indeed resolvable in dns. >>>>> I also tried using the ip address in place of the hostname and I still >>>>> get >>>>> the same error. >>>>> >>>>> >>>>> On Wed, Jul 2, 2014 at 5:36 PM, Andre Araujo <ara...@pythian.com> >>>>> wrote: >>>>> >>>>>> If the name "hiveserver" is not resolved correctly, that's the exact >>>>>> error you'd getting. >>>>>> Does "nslookup hiveservice" resolve the name successfully? >>>>>> >>>>>> Try using the fully qualified name instead. >>>>>> >>>>>> >>>>>> On 3 July 2014 07:01, Szehon Ho <sze...@cloudera.com> wrote: >>>>>> >>>>>>> I believe you should be able to put in anything by default. The >>>>>>> hive jdbc url is of the form jdbc:hive2://<host>:<port>, is the url >>>>>>> correct? >>>>>>> >>>>>>> Thanks, >>>>>>> Szehon >>>>>>> >>>>>>> >>>>>>> On Wed, Jul 2, 2014 at 10:16 AM, Hang Chan <h...@needsystem.com> >>>>>>> wrote: >>>>>>> >>>>>>>> beeline does not seem to be connecting remotely. It works if I >>>>>>>> connect using the embedded client. I am using all the default >>>>>>>> configurations, except I configured my hiveserver2 thrift port to >>>>>>>> 11000. >>>>>>>> If I put in the database name after the port number, it will prompt >>>>>>>> me for >>>>>>>> a username and password. I just put in anything, but that doesn't >>>>>>>> seem to >>>>>>>> work. I thought that by default there should be no authentication. >>>>>>>> >>>>>>>> [hiveclient]# hive --service beeline -u >>>>>>>> jdbc:hive2://hiveservice:11000 >>>>>>>> scan complete in 2ms >>>>>>>> Connecting to jdbc:hive2://hiveservice:11000 >>>>>>>> Error: Invalid URL: jdbc:hive2://hiveservice:11000 >>>>>>>> (state=08S01,code=0) >>>>>>>> -hiveconf (No such file or directory) >>>>>>>> hive.aux.jars.path=file:............................. >>>>>>>> Beeline version 0.12.0 by Apache Hive >>>>>>>> 0: jdbc:hive2://hiveservice:11000> show tables; >>>>>>>> No current connection >>>>>>>> >>>>>>>> [hiveclient]# hive --service beeline -u jdbc:hive2:// >>>>>>>> scan complete in 3ms >>>>>>>> Connecting to jdbc:hive2:// >>>>>>>> 14/07/02 12:37:47 INFO service.CompositeService: HiveServer2: Async >>>>>>>> execution pool size50 >>>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>>> Service:OperationManager is inited. >>>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>>> Service:SessionManager is inited. >>>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: Service:CLIService >>>>>>>> is inited. >>>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>>> Service:OperationManager is started. >>>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: >>>>>>>> Service:SessionManager is started. >>>>>>>> 14/07/02 12:37:47 INFO service.AbstractService: Service:CLIService >>>>>>>> is started. >>>>>>>> 14/07/02 12:37:47 INFO hive.metastore: Trying to connect to >>>>>>>> metastore with URI thrift://hiveservice:9083 >>>>>>>> 14/07/02 12:37:47 INFO hive.metastore: Waiting 1 seconds before >>>>>>>> next connection attempt. >>>>>>>> 14/07/02 12:37:48 INFO hive.metastore: Connected to metastore. >>>>>>>> 14/07/02 12:37:48 INFO cli.CLIService: SessionHandle >>>>>>>> [7e1279d9-4342-48f1-9c49-1377734062e5]: openSession() >>>>>>>> 14/07/02 12:37:48 INFO cli.CLIService: SessionHandle >>>>>>>> [7e1279d9-4342-48f1-9c49-1377734062e5]: getInfo() >>>>>>>> Connected to: Hive (version 0.12.0) >>>>>>>> Driver: Hive (version 0.12.0) >>>>>>>> Transaction isolation: TRANSACTION_REPEATABLE_READ >>>>>>>> -hiveconf (No such file or directory) >>>>>>>> hive.aux.jars.path=file:...... >>>>>>>> Beeline version 0.12.0 by Apache Hive >>>>>>>> 0: jdbc:hive2://> show tables; >>>>>>>> +--------------------------------------------------------+ >>>>>>>> | tab_name | >>>>>>>> +--------------------------------------------------------+ >>>>>>>> | abc | >>>>>>>> >>>>>>>> 731 rows selected (2.345 seconds) >>>>>>>> 14/07/02 12:38:05 INFO exec.ListSinkOperator: 0 finished. closing... >>>>>>>> 14/07/02 12:38:05 INFO exec.ListSinkOperator: 0 forwarded 0 rows >>>>>>>> 14/07/02 12:38:05 INFO ql.Driver: <PERFLOG method=releaseLocks> >>>>>>>> 14/07/02 12:38:05 INFO ql.Driver: </PERFLOG method=releaseLocks >>>>>>>> start=1404319085209 end=1404319085209 duration=0> >>>>>>>> 14/07/02 12:38:05 INFO zookeeper.ZooKeeper: Session: >>>>>>>> 0x245f6924c200129 closed >>>>>>>> 14/07/02 12:38:05 INFO zookeeper.ClientCnxn: EventThread shut down >>>>>>>> 14/07/02 12:38:05 INFO cli.CLIService: OperationHandle >>>>>>>> [opType=EXECUTE_STATEMENT, >>>>>>>> getHandleIdentifier()=c05a98eb-1077-4732-9b18-c638e0b0a402]: >>>>>>>> closeOperation >>>>>>>> 0: jdbc:hive2://> >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Hang >>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> André Araújo >>>>>> Big Data Consultant/Solutions Architect >>>>>> The Pythian Group - Australia - www.pythian.com >>>>>> >>>>>> Office (calls from within Australia): 1300 366 021 x1270 >>>>>> Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 >>>>>> x1270 >>>>>> Mobile: +61 410 323 559 >>>>>> Fax: +61 2 9805 0544 >>>>>> IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk >>>>>> >>>>>> “Success is not about standing at the top, it's the steps you leave >>>>>> behind.” — Iker Pou (rock climber) >>>>>> >>>>>> -- >>>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>> >>>> >>>> -- >>>> André Araújo >>>> Big Data Consultant/Solutions Architect >>>> The Pythian Group - Australia - www.pythian.com >>>> >>>> Office (calls from within Australia): 1300 366 021 x1270 >>>> Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 >>>> x1270 >>>> Mobile: +61 410 323 559 >>>> Fax: +61 2 9805 0544 >>>> IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk >>>> >>>> “Success is not about standing at the top, it's the steps you leave >>>> behind.” — Iker Pou (rock climber) >>>> >>>> -- >>>> >>>> >>>> >>>> >>> >> >> >> -- >> André Araújo >> Big Data Consultant/Solutions Architect >> The Pythian Group - Australia - www.pythian.com >> >> Office (calls from within Australia): 1300 366 021 x1270 >> Office (international): +61 2 8016 7000 x270 *OR* +1 613 565 8696 >> x1270 >> Mobile: +61 410 323 559 >> Fax: +61 2 9805 0544 >> IM: pythianaraujo @ AIM/MSN/Y! or ara...@pythian.com @ GTalk >> >> “Success is not about standing at the top, it's the steps you leave >> behind.” — Iker Pou (rock climber) >> >> -- >> >> >> >> >