Re: Hadoop v1.8 data transfer protocol

2014-04-07 Thread Dhaivat Pandya
Hi Harsh, I did mean 0.18 - sorry about the typo. I read through the BlockSender.sendChunks method once again and noticed that I wasn't reading the checksum byte array correctly in my code. Thanks for the help, Dhaivat Pandya On Sun, Apr 6, 2014 at 8:59 PM, Harsh J wrote: > There's been no

Re: Hadoop v1.8 data transfer protocol

2014-04-06 Thread Harsh J
There's been no Apache Hadoop release versioned v1.8 historically, nor is one upcoming. Do you mean 0.18? Either way, can you point to the specific code lines in BlockSender which have you confused? The sendBlock and sendPacket methods would interest you I assume, but they appear to be well constr

Hadoop v1.8 data transfer protocol

2014-04-06 Thread Dhaivat Pandya
Hi, I'm trying to figure out how data is transferred between client and DataNode in Hadoop v1.8. This is my understanding so far: The client first fires an OP_READ_BLOCK request. The DataNode responds with a status code, checksum header, chunk offset, packet length, sequence number, the last pac