logo
Virtual Institute
for
I/O

User Tools

Site Tools

You are here: Virtual Institute for I/O » Tools » Benchmarks » MDTest

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
tools:benchmarks:mdtest [2016/12/02 11:29] – [Usage] kunkeltools:benchmarks:mdtest [2021/09/03 11:22] (current) – [MDTest] kunkel
Line 1: Line 1:
-====== MDTEST ======+====== MDTest ======
 ---- dataentry benchmark ---- ---- dataentry benchmark ----
-name           : mdtest +name           : MDTest #  
-layers_ttags   : POSIX, S3 +layers_ttags   : POSIX, S3 #  
-webpage_url    : https://github.com/llnl/mdtest +features_ttags : metadata #  
-license_ttag   : GPL +parallel_ttags : MPI #  
-type_ttags     : synthetic+type_ttags     : synthetic #  
 +license_ttag   : GPL #  
 +webpage_url    : https://github.com/hpc/ior # 
 ---- ----
  
-mdtest is a synthetic MPI parallel benchmark for testing the metadata performance of filesystems.+ 
 +MDTest is a synthetic MPI parallel benchmark for testing the metadata performance of filesystems.
 Each thread operates on its own working set.  Each thread operates on its own working set. 
  
Line 29: Line 32:
   * ''-e'' Read this number of bytes from each file in the read phase   * ''-e'' Read this number of bytes from each file in the read phase
  
-To print the internal operations of the benchmark add ''-v -v -v -v'' to the tool.+To print the internal operations of the benchmark for rank 0 add the option ''-V3''.
 ===== Example Output ===== ===== Example Output =====
 For example runnning ''mpiexec -n 2 ./mdtest -d /tmp/ -b 10 -z 2 -i 1 -I 100'' (using mdtest version 1.9.3) results in the following output  For example runnning ''mpiexec -n 2 ./mdtest -d /tmp/ -b 10 -z 2 -i 1 -I 100'' (using mdtest version 1.9.3) results in the following output 
Line 58: Line 61:
 </code> </code>
  
 +
 +==== Results on an HDD ====
 +
 +  * CPU: Intel(R) Core(TM) i7-6700 CPU @ 3.40GHz
 +  * HDD:  HGST HTS721010A9 A3P0
 +
 +$ mpiexec -n 8 ./mdtest -z 1 -L -u -n -N 1 -b 10 -d /hdd/local/benchmark/ -I 1000 -w 3900 -e 3900 
 +
 +<code>
 +-- started at 12/02/2016 15:35:49 --
 +
 +mdtest-1.9.3 was launched with 8 total task(s) on 1 node(s)
 +Command line used: ./mdtest -z 1 -L -u -n -N 1 -b 10 -d /hdd/local/benchmark/ -I 1000 -w 3900 -e 3900
 +Path: /hdd/local/benchmark
 +FS: 916.8 GiB   Used FS: 17.1%   Inodes: 58.2 Mi   Used Inodes: 0.8%
 +
 +8 tasks, 88000 files/directories
 +
 +SUMMARY: (of 1 iterations)
 +   Operation                      Max            Min           Mean        Std Dev
 +   ---------                      ---            ---           ----        -------
 +   Directory creation:       6927.308       6927.308       6927.308          0.000
 +   Directory stat    :    4238519.464    4238519.464    4238519.464          0.000
 +   Directory removal :     730975.466     730975.466     730975.466          0.000
 +   File creation     :      48177.549      48177.549      48177.549          0.000
 +   File stat         :    3944079.074    3944079.074    3944079.074          0.000
 +   File read         :    1853445.039    1853445.039    1853445.039          0.000
 +   File removal      :     977343.745     977343.745     977343.745          0.000
 +   Tree creation     :      98373.868      98373.868      98373.868          0.000
 +   Tree removal      :        569.562        569.562        569.562          0.000
 +
 +-- finished at 12/02/2016 15:36:04 --
 +</code>
 +
 +Here is a longer run:
 +$ mpiexec -n 8 ./mdtest -z 1 -L -b 10 -d /hdd/local/benchmark/ -I 10000 -w 3900 -e 3900
 +<code>
 +-- started at 12/02/2016 15:55:59 --
 +
 +mdtest-1.9.3 was launched with 8 total task(s) on 1 node(s)
 +Command line used: ./mdtest -z 1 -L -b 10 -d /hdd/local/benchmark/ -I 10000 -w 3900 -e 3900
 +Path: /hdd/local/benchmark
 +FS: 916.8 GiB   Used FS: 17.1%   Inodes: 58.2 Mi   Used Inodes: 0.8%
 +
 +8 tasks, 880000 files/directories
 +                                                                                         
 +mpiexec -n 8 ./mdtest -z 1 -L -b 10 -d /hdd/local/benchmark/ -I 30000 -w 3900 -e 3900
 +
 +SUMMARY: (of 1 iterations)
 +   Operation                      Max            Min           Mean        Std Dev
 +   ---------                      ---            ---           ----        -------
 +   Directory creation:       5027.549       5027.549       5027.549          0.000
 +   Directory stat    :    4453443.823    4453443.823    4453443.823          0.000
 +   Directory removal :       9901.782       9901.782       9901.782          0.000
 +   File creation     :      23445.425      23445.425      23445.425          0.000
 +   File stat         :    2970635.216    2970635.216    2970635.216          0.000
 +   File read         :      55775.043      55775.043      55775.043          0.000
 +   File removal      :      22110.331      22110.331      22110.331          0.000
 +   Tree creation     :      90112.000      90112.000      90112.000          0.000
 +   Tree removal      :         25.082         25.082         25.082          0.000
 +
 +-- finished at 12/02/2016 16:01:57 --
 +</code>
tools/benchmarks/mdtest.1480674559.txt.gz · Last modified: 2016/12/02 11:29 by kunkel
Impressum Privacy Driven by DokuWiki CC Attribution-Share Alike 4.0 International