TokioConf 2026 - Breaking the 125µs @ 1Mhz barrier w/ Tokio and... by Khawaja Shams, Brian Martin

Breaking the 125µs @ 1Mhz barrier w/ Tokio and what it means for your Tokio Web Server by Khawaja Shams, Brian Martin

We operate a Tokio-based proxy fleet at Momento that fronts large-scale systems such as Valkey and DynamoDB. This fleet processes more than a million requests per second, manages tens of millions of concurrent connections, and keeps client side latencies in the low triple digit microsecond range during major live events such as the 2025 Super Bowl on Fox.

Reaching that level of performance taught us lessons that apply to anyone building a service on Tokio, even if your goals are nowhere near a million TPS. We had to learn EC2 network behavior, interrupt handling, core affinity, kernel tuning, benchmarking discipline, and instrumentation that exposes issues at the microsecond level. Writing async Rust was the easy part. The hard part was understanding and tuning the environment around it.

This session is a hands on walkthrough of those lessons. We will perform live tuning, watch empirical results together, and show how different changes influence latency and throughput. The goal is to give you practical guidance that helps whether you are building your first Tokio web server or trying to push an existing one to new levels of performance.
Video Production by Confreaks
Follow Confreaks 👇
https://confreaks.com
https://confreaks.bsky.social
https://x.com/confreaks

Видео TokioConf 2026 - Breaking the 125µs @ 1Mhz barrier w/ Tokio and... by Khawaja Shams, Brian Martin канала TokioConf