User Tools

Site Tools


UK/HPS

name:
High Performance Storage
nationality:
UK
institution:
Unversity of Reading
group head:
Dr. Julian Kunkel
homepage:
https://hps.vi4io.org
publications:
https://hps.vi4io.org/research/publications
location:
Polly+Vacher+Building/@51.4380541,-0.9465873
layers:
middleware, file systems, FUSE, HDF5, NetCDF4, MPIIO, Lustre, PVFS2
knowledge:
modeling, compression, simulation, energy-efficiency, monitoring
products:
HDTrace, PIOsim, md-workbench, scil

Products

  • Scientific Compression Library (SCIL) SCIL
    This library decouples the definition of required accuracy from algorithms that compress data – allowing to choose data intelligently.
  • MD-Workbench
    This is an HPC metadata benchmark allowing to investigate concurrent activity and latency.
  • XPD-IO-Driver
    This is an MPI agnostic driver for the Kove XPD.
  • Statistical-File-Scanner for Data Centers (SFS)
    This tool allows to collect file statistics of data centers using methods from statistics. Therefore, by scanning only a fraction of data, it is possible to estimate the fraction/performance/compression ratio of tools.
  • HDTrace + PIOsimHD
    This is a tracing library and simulator focused on HPC I/O but also covers MPI.
  • SIOX
    Is a flexible tracing/analysis library allowing to experiment and mutate I/O likewise.

See also the products page.

This also includes bigger contributions to shared products.

Projects

In the following projects the research group is involved.

  • AIMES
    • Lossy compression of icosahedral semi-structured data
  • ESiWACE
    • Understanding the business of storing and exploiting high volume Earth system data
    • Developing a new storage layout for Earth system data/advancing the I/O middleware for NetCDF and GRIB
    • Developing new tape access strategies and software customized for Earth system data

See also: Projects

Similar groups