How to enable log of jdk library called by namenode

2018-12-08 Thread ZongtianHou
Hi, everyone I am writing a hdfs client to access hdfs and need to look up the log of namenode. The log of namenode is turned to DEBUG and is ok, However, the log of method called by namenode in jdk can not be seen, like dohandshake2 in GssKrb5Server.class, I have turned the logging level to FIN

RPC connect error when using kerberos Auth

2018-11-28 Thread ZongtianHou
Hi,everyone I am using a hdfs client API to access a secured hdfs cluster. The kerberos have been set up successfully. When the configuration of hadoop.rpc.protection in core-site.xml is set to authentication, it works well. However, when it is set to integration or privacy, the namenode can not

Re: datanode hostname has different expression

2018-10-16 Thread ZongtianHou
Does anyone know about this? > On 11 Oct 2018, at 11:46 AM, ZongtianHou > wrote: > > Hi, everyone: > I use libhdfs3 API to access the hdfs, the hostnames of data block > locations I get from namenode are not consistent, In my local host, it may be > “localhost"

Re: datanode hostname has different expression

2018-10-11 Thread ZongtianHou
By the way, if the datanode host have mutiple IP address, which one the getBlockLocation function will return? > On 11 Oct 2018, at 11:46 AM, ZongtianHou > wrote: > > Hi, everyone: > I use libhdfs3 API to access the hdfs, the hostnames of data block > locations I get

datanode hostname has different expression

2018-10-10 Thread ZongtianHou
Hi, everyone: I use libhdfs3 API to access the hdfs, the hostnames of data block locations I get from namenode are not consistent, In my local host, it may be “localhost", or name of the host, ip may be 127.0.0.1 or actual ip address of the host, I wonder what is the principle, how can I

Libhdfs question

2018-07-06 Thread ZongtianHou
Hi, everyone: I used a libhdfs3 client to access the secure hdfs. When I get data from it, occasionally there will be an error, below is the log. It seems the the rpc use the token 775 which has been canceled to access the hdfs, but I already create a token 776 and use it to do the hdfs filesyst