Re: non-local map task input

2013-07-25 Thread Colin Patrick McCabe
Try looking at DFSOutputStream / DFSInputStream. Sent from a mobile device Colin On Jul 21, 2013 8:41 PM, "Grandl Robert" wrote: > Hi guys, > > I am trying to figure out all the points in hdfs code where hdfs traffic > is read/written. As far as I can tell, it seems most of the traffic goes > t

Re: non-local map task input

2013-07-22 Thread Grandl Robert
Can anyone help me with this please ? Thanks, Robert From: Grandl Robert To: "hdfs-dev@hadoop.apache.org" Sent: Sunday, July 21, 2013 8:41 PM Subject: non-local map task input Hi guys, I am trying to figure out all the points in hdfs code

non-local map task input

2013-07-21 Thread Grandl Robert
Hi guys, I am trying to figure out all the points in hdfs code where hdfs traffic is read/written. As far as I can tell, it seems most of the traffic goes through BlockSender/BlockReceiver, right ? However, when a client do a copyFromLocal, or read a file, or for a map task whose input is not