Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-26 Thread John Zhuge
Please go ahead. On Thu, Oct 26, 2017 at 6:12 PM, Xie Gang wrote: > Shall I create the jira directly? > > On Thu, Oct 26, 2017 at 12:34 PM, Xie Gang wrote: > > > Hi, > > > > We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain > > socket is disabled when datanode throw block inv

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-26 Thread Xie Gang
Shall I create the jira directly? On Thu, Oct 26, 2017 at 12:34 PM, Xie Gang wrote: > Hi, > > We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain > socket is disabled when datanode throw block invalid exception. > > The block is invalidated for some reason on datanote and it's O

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-25 Thread John Zhuge
Hi Xie Gang, Thanks for reporting the issue. How was the block invalidated on DN? I recently created a unit test that might trigger a somewhat similar symptom: 1. Read a 4000-byte file in MiniDFS. It should go thru domain socket. 2. Call input stream unbuffer. It will close the block reade