U can check

TestDFSIO,
TerraGen ,TerraSort,TerraValidate
NNBench,
MRBench(For MapReduce)

Above are very well known tools.

Run 
bin/hadoop jar hadoop-*test*.jar
# change to your Hadoop installation directory;
# if you followed my Hadoop tutorials, this is /usr/local/hadoop
$ cd /usr/local/hadoop
$ bin/hadoop jar hadoop-*test*.jar
An example program must be given as the first argument.
Valid program names are:
  DFSCIOTest: Distributed i/o benchmark of libhdfs.
  DistributedFSCheck: Distributed checkup of the file system consistency.
  MRReliabilityTest: A program that tests the reliability of the MR framework 
by injecting faults/failures
  TestDFSIO: Distributed i/o benchmark.
  dfsthroughput: measure hdfs throughput
  filebench: Benchmark SequenceFile(Input|Output)Format (block,record 
compressed and uncompressed), Text(Input|Output)Format (compressed and 
uncompressed)
  loadgen: Generic map/reduce load generator
  mapredtest: A map/reduce test check.
  mrbench: A map/reduce benchmark that can create many small jobs
  nnbench: A benchmark that stresses the namenode.
  testarrayfile: A test for flat files of binary key/value pairs.
  testbigmapoutput: A map/reduce program that works on a very big 
non-splittable file and does identity map/reduce
  testfilesystem: A test for FileSystem read/write.
  testipc: A test for ipc.
  testmapredsort: A map/reduce program that validates the map-reduce 
framework's sort.
  testrpc: A test for rpc.
  testsequencefile: A test for flat files of binary key value pairs.
  testsequencefileinputformat: A test for sequence file input format.
  testsetfile: A test for flat files of binary key/value pairs.
  testtextinputformat: A test for text input format.
  threadedmapbench: A map/reduce benchmark that compares the performance of 
maps with multiple spills over maps with 1 spill


Thanks and Regards
Amith
________________________________________
From: Joe Bounour [jboun...@ddn.com]
Sent: Tuesday, April 24, 2012 2:30 PM
To: hdfs-dev@hadoop.apache.org; chengyao
Subject: RE: test HDFS

Hello
Have you looked at TestDFSIO benchmark
http://answers.oreilly.com/topic/460-how-to-benchmark-a-hadoop-cluster/


-----Original Message-----
From: chengyao [mailto:cheng...@inspur.com]
Sent: Monday, April 23, 2012 11:22 PM
To: hdfs-dev
Subject: test HDFS

HI.
I want to test hdfs. what tools should i choose? can you tell me ? thank you.




程瑶
       软件技术评估组
       浪潮(北京)电子信息产业有限公司

       地址:山东省济南市高新区浪潮路1036号浪潮集团院内5号楼
       邮编:250101
       电话:0531-85106427
       mail: cheng...@inspur.com

Reply via email to