LUMI AI Factory - European AI Supercomputing Consortium

Title

LUMI AI Factory - European AI Supercomputing Consortium

Content

The LUMI AI Factory is a one-stop shop that brings together world-class supercomputing, high-quality data, and top-tier AI expertise boosting European AI innovation. LUMI is one of the fastest supercomputers in Europe, managed by the EuroHPC Joint Undertaking and hosted in Finland. The LUMI AI Factory's Dataset-as-a-Service (DaaS) solution brings data and compute closer together, making data visible at the very location where computing power already resides. This shortens the distance from data to results and makes experimentation and research more seamless. The DaaS user interface is a data catalogue in which data producers can publish their datasets in a controlled manner, and data users can discover them without manual searching. The service brings together metadata, access rights and data locations into a single whole, making datasets not only discoverable but immediately usable on the LUMI supercomputer. This is especially important in AI development, where training models require large volumes of data, and where the physical proximity of data to compute significantly affects performance and the reproducibility of workflows. LUMI AI Factory creates value for two user groups: data users and data providers. For data users, DaaS streamlines the search for AI-ready datasets and eliminates the bottleneck of copying large datasets. For data producers, the service offers a clear publication path that makes datasets discoverable in a controlled, standardised way. Source: lumi-supercomputer.eu

URL