🔵 Choosing the Right LLM for your Use Case: Accuracy, Cost, and Performance in the Balance

With the ever-growing list of large language models (LLMs) available in Generative AI Hub, selecting the best one for specific use cases can be a daunting task. This talk delves into our process of evaluating LLMs for running our use-case, Joule on the SAP Design System, focusing on three critical metrics: accuracy in answering questions, response speed, and query cost. Through this talk, we'll explore how we need to balance the needs of expert users and community members while addressing the demand for rapid, cost-effective, and accurate responses.

Speaker: Joerg Goeppert and Hee Tatt Ooi, SAP

Validation tutorial: https://developers.sap.com/tutorials/devtoberfest2024-week4-ai-session-validation.html

Видео 🔵 Choosing the Right LLM for your Use Case: Accuracy, Cost, and Performance in the Balance канала SAP Developers