This shows you the differences between two versions of the page.
— | hpsl:2018:aut:vsc:binfs [2020/08/13 17:09] (current) – created - external edit 127.0.0.1 | ||
---|---|---|---|
Line 1: | Line 1: | ||
+ | ====== FS: BINFS ====== | ||
+ | |||
+ | ===== Characteristics ===== | ||
+ | < | ||
+ | name:BINFS | ||
+ | </ | ||
+ | |||
+ | |||
+ | ===== Description ===== | ||
+ | |||
+ | The BINFS (short for Bioinformatics small) storage system was procured in late 2016 consisting of 64 x Intel P3600 2 TB SSDs distributed on 16 nodes. Running 8 metadata servers (buddy-mirrored) and 16 OSTs. The nodes are used as storage and compute nodes, therefore they are connected via Intel Omnipath. Each Node also has a Mellanox Infiniband Adapter to connect the Nodes to the rest of the VSC-3. | ||
+ | |||
+ | ===== Measurement protocols ===== | ||
+ | |||
+ | ==== Peak performance ==== | ||
+ | |||
+ | The peak performance was achieved with [[tools: | ||
+ | |||
+ | ==== Sustained metadata performance ==== | ||
+ | |||
+ | The metadata performance was measured with mdtest, running 128 processes distributed over 8 nodes. | ||
+ | < | ||
+ | mdtest-1.9.3 was launched with 128 total task(s) on 8 node(s) | ||
+ | Command line used: mdtest ./mdtest -I 5 -z 5 -b 5 -u -d / | ||
+ | Path: / | ||
+ | FS: 105.9 TiB Used FS: 60.2% | ||
+ | |||
+ | 128 tasks, 2499840 files/ | ||
+ | |||
+ | SUMMARY: (of 1 iterations) | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | | ||
+ | File creation | ||
+ | File stat : | ||
+ | File read : | ||
+ | File removal | ||
+ | Tree creation | ||
+ | Tree removal | ||
+ | </ | ||
+ | |||
+ | ==== Sustained performance ==== | ||
+ | |||
+ | Performance of the system has been measured with [[tools: | ||
+ | |||
+ | The used BeeGFS configuration was: | ||
+ | |||
+ | * BeeGFS 6.7 | ||
+ | |||
+ | * Striping 4 OSTs per File | ||
+ | |||
+ | * Chunksize 8MiB | ||
+ | |||