User Tools

Site Tools


Table of Contents

MACSio

name:
MACSio
layers:
exodusII, HDF5, MPI-IO
features:
data
parallel:
MPI
type:
synthetic
license:
GPL
webpage:
https://github.com/LLNL/MACSio

MACSio was designed to be a flexible benchmarking application that allows the user to simulate complex I/O-Loads. The application is extensible via plugins and comes with built-in plugins for the I/O-APIs: STDIO (via mmap), HDF5, SILO and EXODUS.

Usage

Compile MACSio with the third party libraries you desire as per the instructions in the INSTALLING file. Run the application using mpirun.

Note that we use the miftmpl interface, which is the default interface that benchmarks the use of the multiple, independent files. Other Interfaces for hdf5, exodusII and silo can be enabled if MACSio was compiled with support for them.

mpirun -np 4 ./macsio --interface miftmpl --part_size 1M

Example Output

The resulting output in macsio-log.log will look like this.

--------------------------------------------------------Processor 000000-------------------------------------------------------
Info:"macsio_main.c":680:Dump 00 BW:  18.9479 Mi/  1.0418 secs =  18.1872 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 01 BW:  18.9479 Mi/  1.0315 secs =  18.3692 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 02 BW:  18.9479 Mi/  1.0292 secs =  18.4098 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 03 BW:  18.9479 Mi/  1.0288 secs =  18.4170 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 04 BW:  18.9479 Mi/  1.0768 secs =  17.5961 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 05 BW:  18.9479 Mi/  1.0598 secs =  17.8789 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 06 BW:  18.9479 Mi/  1.0421 secs =  18.1818 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 07 BW:  18.9479 Mi/  1.0410 secs =  18.2019 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 08 BW:  18.9479 Mi/  1.1636 secs =  16.2844 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 09 BW:  18.9479 Mi/  1.0548 secs =  17.9642 Mi/sec:::                                            
Info:"macsio_main.c":688:Overall BW: 189.4786 Mi/ 10.5694 secs =  17.9271 Mi/sec:::                                            
Info:"macsio_main.c":706:Summed  BW:  71.7761 Mi/sec:::                                                                        
Info:"macsio_main.c":710:Total Bytes: 757.9146 Mi; Last finisher - First starter =  10.5741 secs; BW =  71.6767 Mi/sec:::      
                                                                                                                               
                                                                                                                                                                                                                                                          
--------------------------------------------------------Processor 000001-------------------------------------------------------
Info:"macsio_main.c":680:Dump 00 BW:  18.9479 Mi/  1.0148 secs =  18.6710 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 01 BW:  18.9479 Mi/  1.0315 secs =  18.3693 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 02 BW:  18.9479 Mi/  1.0292 secs =  18.4098 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 03 BW:  18.9479 Mi/  1.0390 secs =  18.2368 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 04 BW:  18.9479 Mi/  1.0667 secs =  17.7639 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 05 BW:  18.9479 Mi/  1.0598 secs =  17.8789 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 06 BW:  18.9479 Mi/  1.0421 secs =  18.1816 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 07 BW:  18.9479 Mi/  1.0410 secs =  18.2019 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 08 BW:  18.9479 Mi/  1.1636 secs =  16.2843 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 09 BW:  18.9479 Mi/  1.0592 secs =  17.8886 Mi/sec:::                                            
Info:"macsio_main.c":688:Overall BW: 189.4786 Mi/ 10.5469 secs =  17.9654 Mi/sec:::                                            
                                                                                                                               
                                                                                                                                                                                                                                                        
--------------------------------------------------------Processor 000002-------------------------------------------------------
Info:"macsio_main.c":680:Dump 00 BW:  18.9479 Mi/  1.0228 secs =  18.5262 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 01 BW:  18.9479 Mi/  1.0315 secs =  18.3694 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 02 BW:  18.9479 Mi/  1.0292 secs =  18.4098 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 03 BW:  18.9479 Mi/  1.0390 secs =  18.2368 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 04 BW:  18.9479 Mi/  1.0667 secs =  17.7638 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 05 BW:  18.9479 Mi/  1.0598 secs =  17.8789 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 06 BW:  18.9479 Mi/  1.0421 secs =  18.1817 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 07 BW:  18.9479 Mi/  1.0410 secs =  18.2019 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 08 BW:  18.9479 Mi/  1.1636 secs =  16.2844 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 09 BW:  18.9479 Mi/  1.0592 secs =  17.8886 Mi/sec:::                                            
Info:"macsio_main.c":688:Overall BW: 189.4786 Mi/ 10.5548 secs =  17.9519 Mi/sec:::                                            
                                                                                                                                                                                                                                                             
                                                                                                                               
--------------------------------------------------------Processor 000003-------------------------------------------------------
Info:"macsio_main.c":680:Dump 00 BW:  18.9479 Mi/  1.0346 secs =  18.3150 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 01 BW:  18.9479 Mi/  1.0315 secs =  18.3694 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 02 BW:  18.9479 Mi/  1.0292 secs =  18.4098 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 03 BW:  18.9479 Mi/  1.0390 secs =  18.2368 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 04 BW:  18.9479 Mi/  1.0667 secs =  17.7637 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 05 BW:  18.9479 Mi/  1.0598 secs =  17.8789 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 06 BW:  18.9479 Mi/  1.0421 secs =  18.1817 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 07 BW:  18.9479 Mi/  1.0410 secs =  18.2018 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 08 BW:  18.9479 Mi/  1.1636 secs =  16.2844 Mi/sec:::                                            
Info:"macsio_main.c":680:Dump 09 BW:  18.9479 Mi/  1.0592 secs =  17.8885 Mi/sec:::                                            
Info:"macsio_main.c":688:Overall BW: 189.4786 Mi/ 10.5666 secs =  17.9318 Mi/sec:::                                            

Output has been created using the commit 8dd75c.