Re: Latency and speed of HDFS

2011-01-28 Thread Harsh J
Moving discussion to hdfs-user mailing list: hdfs-u...@hadoop.apache.com On Sat, Jan 29, 2011 at 5:06 AM, Pei HE wrote: > Hi all, > I want to know the detailed performance of Hadoop. > > I am writing a client code to test the latency, transfer speed of > HDFS, and the time of initiating a JVM for

Re: Latency and speed of HDFS

2011-01-28 Thread Da Zheng
Have you tried TestDFSIO? I think it's quite a good benchmark to measure the performance of HDFS. If you want to know how to write data to HDFS directly, you can read its code. Da On 1/28/11 6:36 PM, Pei HE wrote: > Hi all, > I want to know the detailed performance of Hadoop. > > I am writing a

Latency and speed of HDFS

2011-01-28 Thread Pei HE
Hi all, I want to know the detailed performance of Hadoop. I am writing a client code to test the latency, transfer speed of HDFS, and the time of initiating a JVM for a task. Does anyone know that which classes can be called without running a whole map/reduce job to find out the performance of H