AI Development, Streaming, and Scaling with AWS Lambda

Olio Apps can help you build your app: https://www.olioapps.com/contact-us

Hey! We're Scott and Aron. We are software engineers, and business operators running Olio Apps. We help our clients build the best software possible. We're always learning and improving our methods and practices, and we want to share that with you.

0:00 - Intro
0:35 - Welcome
0:52 - Zach’s Background
2:22 - Working with LLMs vs ML Models
6:02 - Applying AI to Backrs - Hyper Personalization
9:01 - From prototype to scale
12:57 - Streaming with Lambda
17:34 - Python streaming lambda wrapper
22:17 - Journey to get to 100 concurrent users - db connections - database pool via proxy
25:21 - Lifting LLM provider quota limits
27:29 - Lambda rate limits
31:17 - Backrs UI
33:49 - Backrs Streaming Example
36:11 - Conclusion

Видео AI Development, Streaming, and Scaling with AWS Lambda канала Olio Apps