CLARISSE project

Grupos de investigación
Ingeniería
Computer Architecture and Technology Area (ARCOS)
Research
Research Lines
CLARISSE project

Cross-Layer Abstractions and Run-time for I/O Software Stack of Extreme-scale systems

Currently, the I/O software stack of high-performance computing platforms consists of independently developed layers (scientific libraries, middlewares, I/O forwarding, parallel file systems), lacking global coordination mechanisms. This uncoordinated development model negatively impacts the performance of both independent and ensembles of applications relying on the I/O stack for data access. The CLARISSE project is designing cross-layer mechanisms for the the I/O software stack aiming to facilitate performance optimizations, programmability, and extendability.

Research Objectives:

To investigate, design and implement control mechanisms for cross-layer dissemination of application hints, run-time feedback, notifications, and shipping of I/O functionality throughout the I/O software stack.

To explore algorithms and to design and implement mechanisms and policies for the adaptive control of the storage I/O data path in order to improve the I/O software stack scalability and resilience.

To study and develop techniques for exposing and exploiting data locality throughout the I/O software stack in order to reduce the storage I/O traffic and improve the performance.

Software

The CLARISSE software is freely available under the BSD license in a bitbucket repository.

Publications and Presentations:

Publications

F. Isaila, J. Garcia, J. Carretero, R. Ross, and D. Kimpe. Making the Case for Reforming the I/O Software Stack of Extreme-Scale Systems. Accepted for publication in Journal: Advances in Engineering Software (AES), 2017.
F. Isaila, J. Carretero, R. Ross. CLARISSE: a middleware for data-staging coordination and control on large-scale HPC platforms In Proceedings of IEEE/ACM CCGrid 2016 (Best Paper Award). pdf
Francisco Rodrigo Duro, Javier Garcia Blas, Florin Isaila, Jesus Carretero, Justin M. Wozniak, and Robert Ross.Flexible Data-Aware Scheduling for Workflows over an In-Memory Object Store. In Proceedings of IEEE/ACM CCGrid 2016.
Francisco Rodrigo Duro, Javier Garcia Blas, Florin Isaila, Jesus Carretero, Justin M. Wozniak, and Robert Ross. Experimental evaluation of a flexible I/O architecture for accelerating workflow engines in ultrascale environments. Accepted for publication in Elsevier’s Parallel Computing Journal, 2016.
Francois Tessier, Venkatram Vishwanath, Preeti Malakar, Emmanuel Jeannot and Florin Isaila. Topology-Aware Data Aggregation for Intensive I/O on Large-Scale Supercomputers. Proceeding of Workshop on Communication Optimizations in HPC, in conjunction with SC 2016, Denver.
Florin Isaila, Prasanna Balaprakash, Stefan M. Wild, Dries Kimpe, Rob Latham, Rob Ross, Paul Hovland. Collective I/O tuning using analytical and machine learning models. In IEEE Cluster Computing Conference, 2015.
Francisco Rodrigo Duro, Javier Garcia Blas, Florin Isaila, Jesus Carretero. Experimental evaluation of a flexible I/O architecture for accelerating workflow engines in cloud environments. Proceedings of the 2015 International Workshop on Data-Intensive Scalable Computing Systems, DISKS ’15.
Francisco Rodrigo Duro, Javier Garcia Blas, Florin Isaila, Jesus Carretero, Justin M. Wozniak, and Robert RossExploiting data locality in Swift/T workflows using Hercules. In Proceedings of NESUS Workshop 2014.

Posters:

Florin Isaila. CLARISSE: Cross-layer abstractions and run-time for I/O stack of extreme scale systems. In USENIX File and Storage Technologies (FAST), Santa Clara 2014.