====== UK/HPS ======

---- dataentry groups ----
name             : High Performance Storage
nationality_gtag : UK
institution      : Unversity of Reading
group head       : Dr. Julian Kunkel
type_hidden      : research
homepage_url     : https://hps.vi4io.org
publications_url : https://hps.vi4io.org/research/publications
location_map     : Polly+Vacher+Building/@51.4380541,-0.9465873
layers_gtags     : middleware, file systems, FUSE, HDF5, NetCDF4, MPIIO, Lustre, PVFS2
knowledge_gtags  : modeling, compression, simulation, energy-efficiency, monitoring
products_gtags   : HDTrace, PIOsim, md-workbench, scil
----







===== Products =====

  * Scientific Compression Library (SCIL) [[https://github.com/JulianKunkel/scil|SCIL]] \\ This library decouples the definition of required accuracy from algorithms that compress data -- allowing to choose data intelligently.
  * [[https://github.com/JulianKunkel/md-workbench|MD-Workbench]] \\ This is an HPC metadata benchmark allowing to investigate concurrent activity and latency.
  * [[https://github.com/JulianKunkel/XPD-MPIIO-driver|XPD-IO-Driver]] \\ This is an MPI agnostic driver for the Kove XPD.
  * [[https://github.com/JulianKunkel/statistical-file-scanner|Statistical-File-Scanner for Data Centers (SFS)]] \\ This tool allows to collect file statistics of data centers using methods from statistics. Therefore, by scanning only a fraction of data, it is possible to estimate the fraction/performance/compression ratio of tools.
  * [[https://github.com/JulianKunkel/hdtrace-piosim|HDTrace + PIOsimHD]] \\ This is a tracing library and simulator focused on HPC I/O but also covers MPI.
  * [[https://github.com/JulianKunkel/siox|SIOX]] \\ Is a flexible tracing/analysis library allowing to experiment and mutate I/O likewise.

See also the [[https://hps.vi4io.org/products/start|products]] page.

This also includes bigger contributions to shared products.
===== Projects =====

In the following projects the research group is involved.

  * AIMES
    * Lossy compression of icosahedral semi-structured data
  * ESiWACE
    * Understanding the business of storing and exploiting high volume Earth system data
    * Developing a new storage layout for Earth system data/advancing the I/O middleware for NetCDF and GRIB
    * Developing new tape access strategies and software customized for Earth system data 


See also: [[https://hps.vi4io.org/research/projects/start|Projects]]

===== Similar groups =====

---- datarelated ----
cols  : knowledge, layers
max   : 5
sort  : ^name 
----