EXA4MIND Training: EXA4MIND AI Inference Service | IT4Innovations

In this EXAKI training session, Tomáš Martinovič from IT4Innovations demonstrates the EXA4MIND AI Inference Service. This service is designed to enable the inference of AI models, such as large language models (LLMs), on supercomputers.

The EXA4MIND AI Inference SErvice provides a simple, user-facing interface for selecting Hugging Face models and submitting inference requests, while abstracting away all of the complexity involved in HPC job orchestration and resource management. Under the hood, it integrates with HEAppE middleware for acquiring, launching, and monitoring inference jobs across HPC clusters.

For more information visit the EXA4MIND AI Inference Service: https://exa4mind.pages.it4i.eu/platform/aqis/query-inference/ai-inference-service/

Видео EXA4MIND Training: EXA4MIND AI Inference Service | IT4Innovations канала EXA4MIND