Hi just chipping in here real quick. java.net.ConnectException: Connection refused
is a pretty good indicator that Zookeeper is not running or at least not listening on the port you are expecting ZK connect seems to be localhost:2181 Do you have zookeeper running and is it listening on 2181? Or any fancy firewall rules on the box preventing the connection? Best Jan Am Mo., 6. Sept. 2021 um 10:04 Uhr schrieb Antoine DUBOIS <antoine.dub...@cc.in2p3.fr>: > > Hello Alan, > Thank you for your answer, > I'm pretty sure I've respected the guide provided and did not set any > discovery service. > However I'm trying to setup ranger as well and though I didn't though it > could cause the issue, after futher investigation I suspect ranger might be > causing the issue. > Hadoop 3.1.4 > Hive 3.1.2 > Ranger 2.1.0 > Tez 0.9.2 > It might come from imcompatibles version but I cannot find a proper > compatibility matrix for all hadoop ecosystem. > Thank you very much. > > Antoine > > ________________________________ > De: "Alan Gates" <alanfga...@gmail.com> > À: user@hive.apache.org > Envoyé: Vendredi 3 Septembre 2021 17:51:41 > Objet: Re: Question regarding lock manager > > You do not need ZooKeeper to use ACID in Hive. The first thing I would check > is that you have configured your system as described on this page: > https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions. Also, > make sure you have not set hive.lock.manager to zookeeper. > > There are other features in Hive that can optionally use ZK, such as the > discovery service for HiveServer2, you'll want to make sure this isn't coming > from there rather than from the transaction system. > > Alan. > > On Thu, Sep 2, 2021 at 7:46 AM Antoine DUBOIS <antoine.dub...@cc.in2p3.fr> > wrote: >> >> >> Hello, >> I'm trying to configure ACID hive in a kerberos environment with : >> Hadoop 3.1.4 deployed in HA considered working >> and now I'm trying to setup hive with remote metastore and ACID >> configuration. >> I may misunderstand what is written in documentation >> https://cwiki.apache.org/confluence/display/Hive/Hive+Transactions , but to >> me it's cleary stated that DbTxnManager do not need zookeeper to run >> properly, >> However it seems it in fact needs a zookeeper running somewhere as I have >> several attempt to connect to a local zookeeper instance: >> 2021-09-02T15:22:21,708 INFO [main-SendThread(localhost:2181)] >> client.ZooKeeperSaslClient: Client will use GSSAPI as SASL mechanism. >> 2021-09-02T15:22:21,708 DEBUG [main-SendThread(localhost:2181)] >> client.ZooKeeperSaslClient: creating sasl client: >> client=h*******;service=zookeeper;serviceHostname=localhost >> 2021-09-02T15:22:21,709 INFO [main-SendThread(localhost:2181)] >> zookeeper.ClientCnxn: Opening socket connection to server >> localhost/127.0.0.1:2181. Will attempt to SASL-authenticate using Login >> Context section 'HiveZooKeeperClient' >> 2021-09-02T15:22:21,710 WARN [main-SendThread(localhost:2181)] >> zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing >> socket connection and attempting reconnect >> java.net.ConnectException: Connection refused >> >> Could you please help me to understand properly the documentation ? Do I >> need or not a zookeeper instance if using DbTxnManager and if so, why it >> isn't stated precisely and explicitely in the documentation ? >> I hope you have the best of day. >> >> Antoine DUBOIS > >
