DevOps, Security, and Observability in ML // Luke Marsden // MLOps Meetup #106

MLOps Community Meetup #106! On June 16th, Thursday, we had our MLOps Community Bristol Meetup guest speaker Luke Marsden, Founder of MLOps Consulting on our very first local MLOps Meetup. This event is brought to you by neptune.ai.

//Abstract
DevOps, Security, and Observability in ML
In this talk we look at how you can build:

MLOps processes
on top of tooling stacks
on top of infrastructure
Click here (https://app.simplenote.com/publish/D3pZXF) for a deeper dive into what we’ll cover in these three points.

Also, Luke gives a sneak peek of something totally new we're working on. We'll post Luke's topic on DevOps, Security, and Observability in ML.

// Bio
Luke is a passionate technology leader. Experienced in CEO, CTO, tech lead, product, sales, and engineering roles. Proven ability to conceive and execute a product vision from strategy to implementation, while iterating on product-market fit.

Deep understanding of AI/ML, infrastructure software and systems programming, containers, microservices, storage, networking, distributed systems, DevOps, MLOps, and CI/CD workflows.

// Jobs board
https://mlops.pallet.xyz/jobs

// Related links
https://www.weave.works/technologies/gitops/
Laszlo's blog: laszlo.substance.com
----------- ✌️Connect With Us ✌️-------------
Join our Slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, Feature Store, Machine Learning Monitoring, and Blogs: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Jose on LinkedIn: https://www.linkedin.com/in/jose-navarro-2a57b612
Connect with Luke on LinkedIn: https://www.linkedin.com/in/luke-marsden-71b3789/
Connect with Laszlo on LinkedIn: https://www.linkedin.com/in/laszlosragner/

Timestamps:
[00:00] Introduction to Luke Marsden
[00:49] DevOps, Security, and Observability in ML
[01:18] Integrations
[01:26] Machine Learning tools and platforms landscape
[01:56] Laszlo's thread
[02:58] Patterns for integrating MLOps tools
[03:14] MLOps Process
[05:41] Infra level
[05:47] Kubernetes and Gitops
[12:30] Security and OIDC as glue
[14:53] Keycloak
[16:26] Lots of tools support OIDC
[18:24] Define and agree on an Ontology
[21:04] Tell me about the stacks!
[24:08] Observability
[24:12] Model Observability is Different to Software
[25:40] Instrumenting throughout lifecycle
[26:13] Tracking divergence
[26:53] Architecture
[27:13] Live Demo

Видео DevOps, Security, and Observability in ML // Luke Marsden // MLOps Meetup #106 канала MLOps.community