Escaping Generative AI Walled Gardens with Omoju Miller

Omoju Miller is a machine learning guru and founder and CEO of Fimio, where she is building 21st century dev tooling. In the past, she was Technical Advisor to the CEO at GitHub, spent time co-leading non-profit investment in Computer Science Education for Google, and served as a volunteer advisor to the Obama administration’s White House Presidential Innovation Fellows.

​We need open tools, open data, provenance, and the ability to build fully reproducible, transparent machine learning workflows. With the advent of closed-source, vendor-based APIs and compute becoming a form of gate-keeping, developer tools are at the risk of becoming commoditized and developers becoming consumers.

​In this live podcast recording, Hugo and Omoju will talk about how ideas for escaping these burgeoning walled gardens. They’ll dive into

- What fully reproducible ML workflows would look like, including git for the workflow build process,
- The need for loosely coupled and composable tools that embrace a UNIX-like philosophy,
- What a much more scientific toolchain would look like,
- ​What a future open sources commons for Generative AI could look like,
- What an open compute ecosystem could look like,
- How to create LLMs and tooling so everyone can use them to build production-ready apps!

​And much more, all the while grounding our conversation in real-world examples from data science, machine learning, business, and life.

00:00 Prelude
01:40 Introducing Omoju
04:05 Semantic Search and Omoju's journey at Github
08:40 What open tools really are (and why open weights aren't enough)
12:00 Dev tooling accessibility (and our deep romance with friction)
15:40 Why do big companies often produce closed tools?
21:30 What is open, accessible compute and what can we learn from web3?
27:45 Writing software is NOT shipping production-ready software
30:40 There's NO science to LLMs and GenAI (yet)
34:00 How to get humans in the loop correctly with LLMs and ML
37:00 Reproducibility for fine-tuning
41:40 Can we actually have fully reproducible workflows with OpenAI?
43:00 Show me the training data, data dignity, and data provenance
48:15 Using GUIs for data and machine learning
50:17 Why GenAi news feels like Succession
55:20 UNIX philosophy wrt ML & GenAI
59:00 Open innovation ecosystems
01:02:15 What a future open commons for GenAI could look like
01:06:09 ClosedAI as a form of "chokepoint capitalism"
01:14:00 What OpenAI could actually learn from Wikipedia (not as training data!)
01:19:55 Machine learning IS design thinking

Видео Escaping Generative AI Walled Gardens with Omoju Miller канала Vanishing Gradients