Building AI Middleware Solutions Using LLMs with Azure OpenAI and LLAMA

Using AI services is just one part of building powerful applications. To make them suitable for real-world use, you need additional features like tracking, logging, and tool-calling capabilities. The Microsoft.Extensions.AI library makes it easy to add these features to your applications using familiar and straightforward approaches.

In this video, we’ll explore how to implement the middleware concept using Microsoft.Extensions.AI.
00:00 Introduction
00:09 Middleware
00:50 HistoricalMiddlware
01:19 Visual Studio Sample
01:36 HistoricalEventsChatClient
01:49 DelegatingChatClient
02:20 CompleteAsync
02:52 HistoryPrompt
03:43 Add Prompt to ChatMessage
04:38 Remove ChatMessage
05:23 Add Middleware in ChatClient
05:54 Run Middleware
06:40 Add Middleware as a Extension
08:18 Run Middleware

Видео Building AI Middleware Solutions Using LLMs with Azure OpenAI and LLAMA канала Learn Microsoft AI