Jeff Huber, co-founder of Chroma: context engineering and modern AI search | Evil Martians podcast

Jeff Huber, co-founder and CEO of Chroma, sits down with Victoria Melnikova to talk about why RAG became industry brain rot, how context engineering replaced it as the real job to be done, and what it takes to build modern search infrastructure for AI. He shares his framework for commercializing open source — keep the engine open, monetize the car — why consensus is a death blow for great products, and how small opinionated teams with low egos build the best developer tools.

Victoria Melnikova is a business and go-to-market expert for developer tools and AI, and host of Dev Propulsion Labs. She works with 40+ early-stage startups a year as Head of New Business at Evil Martians.
https://x.com/vmelnikova_en

Evil Martians is a design and engineering consultancy for developer tools, AI, and cybersecurity startups.
https://evilmartians.com/

00:00 Introduction and Jeff's background
02:59 Why RAG is brain rot and context engineering is the real job
05:08 What context engineering actually means
08:09 Chroma's positioning: modern search infrastructure for AI
09:41 How positioning evolves while the 10-year vision stays fixed
11:23 Chroma in five years: continual learning and memory
14:14 Investing in design early and brand as a moat
17:34 Hiring culture: 1% acceptance rate and obsessing over API names
19:44 Perfectionism without toxicity: low egos and looking for surprises
23:01 Lessons from founding Chroma and catching fire early
25:01 Open source strategy: engine vs car framework
29:22 OSS users vs commercial users and monetizing data
31:06 Roadmap prioritization and SDLC-adjacent thinking for search
34:26 Stance on fundraising: raise when you know how to go faster
35:13 Gaps in AI tooling: massive-scale agent inference orchestration
37:06 Warm fuzzies: democratizing services for all of humanity
38:43 Where to find Chroma

Видео Jeff Huber, co-founder of Chroma: context engineering and modern AI search | Evil Martians podcast канала Evil Martians