Targeting scale-out and scale-up platforms with a unified parallel programming model

Séminaire organisé par Nicolo Tonci (Université de Pise) le 07/04/2024.

Résumé :

The proliferation of interconnected devices, capable of generating huge amounts of data, requires highly performing applications to extract insights. These needs amplify the demand of new scalable algorithms and programming interfaces, both for shared-memory and distributed-memory architectures. Currently, the standard tools to approach this challenge are either too complex or unflexible for programmers. This talk aims to present a new distributed-memory run-time system for FastFlow’s building-blocks. FastFlow is a C++ structured parallel programming library, originally targeting shared-memory platforms. This new support allowed the exploitation of the parallel resources of multiple interconnected machines. The main target of the proposed run-time system was to enable an easy and smooth transition between shared-memory FastFlow applications to equivalent distributed-memory ones. A preliminary analysis of the new run-time system reported considerable benefits from the programmability and flexibility points of view. Furthermore, it's presented MTCL, a multi-transport communication library, employed by the distributed RTS of FastFlow. Along with the tools, some applications are shown as well.