UK/HPS

• Scientific Compression Library (SCIL) SCIL
  This library decouples the definition of required accuracy from algorithms that compress data – allowing to choose data intelligently.
• MD-Workbench
  This is an HPC metadata benchmark allowing to investigate concurrent activity and latency.
• XPD-IO-Driver
  This is an MPI agnostic driver for the Kove XPD.
• Statistical-File-Scanner for Data Centers (SFS)
  This tool allows to collect file statistics of data centers using methods from statistics. Therefore, by scanning only a fraction of data, it is possible to estimate the fraction/performance/compression ratio of tools.
• HDTrace + PIOsimHD
  This is a tracing library and simulator focused on HPC I/O but also covers MPI.
• SIOX
  Is a flexible tracing/analysis library allowing to experiment and mutate I/O likewise.

See also the products page.

This also includes bigger contributions to shared products.

In the following projects the research group is involved.

• AIMES
  • Lossy compression of icosahedral semi-structured data
• ESiWACE
  • Understanding the business of storing and exploiting high volume Earth system data
  • Developing a new storage layout for Earth system data/advancing the I/O middleware for NetCDF and GRIB
  • Developing new tape access strategies and software customized for Earth system data

See also: Projects