Moving discussion to hdfs-user mailing list: hdfs-u...@hadoop.apache.com
On Sat, Jan 29, 2011 at 5:06 AM, Pei HE wrote:
> Hi all,
> I want to know the detailed performance of Hadoop.
>
> I am writing a client code to test the latency, transfer speed of
> HDFS, and the time of initiating a JVM for
Have you tried TestDFSIO? I think it's quite a good benchmark to measure the
performance of HDFS. If you want to know how to write data to HDFS directly, you
can read its code.
Da
On 1/28/11 6:36 PM, Pei HE wrote:
> Hi all,
> I want to know the detailed performance of Hadoop.
>
> I am writing a
Hi all,
I want to know the detailed performance of Hadoop.
I am writing a client code to test the latency, transfer speed of
HDFS, and the time of initiating a JVM for a task.
Does anyone know that which classes can be called without running a
whole map/reduce job to find out the performance of H