I agree, distcp is the way to go here, you can specify down to the individual directory on HDFS. Also, you can add some flags to overwrite/not overwrite. It's pretty flexible IMO.
On Thu, Nov 24, 2011 at 6:15 AM, Uma Maheswara Rao G <mahesw...@huawei.com>wrote: > Why con't you use distcp command here? > > Regards, > Uma > ________________________________________ > From: arindam choudhury [arindam732...@gmail.com] > Sent: Thursday, November 24, 2011 4:38 PM > To: common-dev@hadoop.apache.org > Subject: Copying data between Hadoop > > HI, > > I want to copy some files from one HDFS to another. is it possible to do it > split by split like split a1 from node a go to node b? > > -Arindam > -- Linden Hillenbrand Customer Operations Engineer Phone: 650.644.3900 x4946 Email: lin...@cloudera.com Twitter: @lhillenbrand Data: http://www.cloudera.com
