Parallel IO and in situ analytics : High-performance data handling @ Exascale

Table of content

Abstract

Maison de la Simulation, together with the Exa-DoST and Exa-DI projects of NumPEx organize a free Parallel IO and in situ analytics: High-performance data handling @ Exascale training.

Over 3.5 days, from Tuesday, June the 4th 1PM to Friday, June the 7th, learn about the must-know tools for high-performance input-output on supercomputers and discover the latest tools for in situ data analytics. From ADIOS to PDI, meet the developers of the leading tools in their category as well as IO administrators of the top French national super-computing facility.

Context

The increase in computational power goes hand in hand with an increase in the amount of data to manage. At Exascale, IO can easily become the main performance bottleneck. Understanding parallel file system mechanisms and parallel IO libraries becomes critical to leverage the latest supercomputers.

With the increasing performance gap between compute and storage, even the best use of IO bandwidth might even not be enough. In this case, in situ analytics become a requirement to exploit Exascale at its peak.

Content

This course introduces the concepts, libraries and tools for IO and in situ data handling to make the best of the top available computing power and storage technologies:

- ADIOS,
- Deisa,
- HDF5,
- Lustre parallel file-system,
- NetCDF,
- PDI.

Resources

Slides:

Training material:

Organizers: