Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin
In this talk, I will discuss the efforts to serve TLS encrypted Netflix video at 400Gb/s from a single server. This will be a follow-on to 2 talks at the 2019 EuroBSDCon: “Numa Optimizations in the FreeBSD Network Stack” and “Kernel TLS and TLS Hardware Offload“. I will provide background on the Netflix video workload, and define key technologies such as NUMA, kernel TLS and hardware kTLS.
I will describe encountering bottlenecks such as:
- Memory bandwidth limits for software kTLS
- PCIe issues with hardware kTLS
- NUMA for software vs hardware kTLS
I will present current and historical performance results from at least:
- AMD “Rome” 2nd generation EPYC systems
- AMD “Milan” 3rd generation EPYC systems
- Ampere Altra arm64 systems
Drew Gallatin
Drew started working on FreeBSD at Duke in the 90s, and was one of the people behind the FreeBSD/alpha port. He worked on zero-copy TCP optimizations for FreeBSD and was sending data at over 1Gb/s before gigabit Ethernet was generally available. He spent a decade at Myricom, optimizing their drivers. After a brief hiatus at Google, he landed at Netflix, where he works on optimizing the FreeBSD kernel and network stack for content delivery. He worked on the optimizations to serve unencrypted Netflix traffic at 100Gb/s, and then on more optimizations to send encrypted traffic at ever increasing speeds, from 100Gb/s to 400Gb/s and beyond.
Видео Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin канала EuroBSDcon
I will describe encountering bottlenecks such as:
- Memory bandwidth limits for software kTLS
- PCIe issues with hardware kTLS
- NUMA for software vs hardware kTLS
I will present current and historical performance results from at least:
- AMD “Rome” 2nd generation EPYC systems
- AMD “Milan” 3rd generation EPYC systems
- Ampere Altra arm64 systems
Drew Gallatin
Drew started working on FreeBSD at Duke in the 90s, and was one of the people behind the FreeBSD/alpha port. He worked on zero-copy TCP optimizations for FreeBSD and was sending data at over 1Gb/s before gigabit Ethernet was generally available. He spent a decade at Myricom, optimizing their drivers. After a brief hiatus at Google, he landed at Netflix, where he works on optimizing the FreeBSD kernel and network stack for content delivery. He worked on the optimizations to serve unencrypted Netflix traffic at 100Gb/s, and then on more optimizations to send encrypted traffic at ever increasing speeds, from 100Gb/s to 400Gb/s and beyond.
Видео Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin канала EuroBSDcon
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Lightning Talks - EuroBSDcon 2023](https://i.ytimg.com/vi/e-FUYbGNdBg/default.jpg)
![Running native and docker containers on FreeBSD, & distribute to OCI image registries - Yan Ka Chiu](https://i.ytimg.com/vi/7__Iee8vmOw/default.jpg)
![FIDO and Webauthn on BSD: Authentication for easily distracted - Taylor R Campbell - EuroBSDcon 2023](https://i.ytimg.com/vi/mHfVwEPaDws/default.jpg)
![The FreeBSD Appliance - Michael Dexter - EuroBSDcon 2023](https://i.ytimg.com/vi/N_AkqTzwFro/default.jpg)
![How to run FreeBSD on POWER - Toshaan Bharvani - EuroBSDcon2023](https://i.ytimg.com/vi/Tj4Q-m_WEh0/default.jpg)
![Practical Use of OpenBSD Routing Domains with Redundant Firewalls - Matthieu Herrb - EuroBSDcon 2023](https://i.ytimg.com/vi/c81bS9u1A6Q/default.jpg)
![Using OpenBSD relayd(8) as an Application Layer Gateway - Joel Carnat - EuroBSDcon 2023](https://i.ytimg.com/vi/yW8QSZyEs6E/default.jpg)
![The OpenBSD Installer - Klemens Nanni - EuroBSDcon 2023](https://i.ytimg.com/vi/r6MwG5D5r5U/default.jpg)
![OpenBSD Ports and Packages: making things faster and easier - Marc Espie - EuroBSDcon 2023](https://i.ytimg.com/vi/9b8B7bJT2y0/default.jpg)
![OpenBSD Attack Mitigations - Alexander Bluhm - EuroBSDcon 2023](https://i.ytimg.com/vi/E3ITPlL8AkM/default.jpg)
![Arbitrary Instruction Tracing with DTrace - Christos Margiolis - EuroBSDcon 2023](https://i.ytimg.com/vi/Fffzafx0sng/default.jpg)
![Gunion: a new GEOM utility in the FreeBSD Kernel - Marshall Kirk McKusick - EuroBSDcon2023](https://i.ytimg.com/vi/MfIrVtRvB4o/default.jpg)
![Panic for historical reasons - Walter Belgers - EuroBSDcon 2023](https://i.ytimg.com/vi/ahbu5CwqwDE/default.jpg)
![devsetup local development environment based on pkgsrc - Pierre Pronchery - EuroBSDcon 2022](https://i.ytimg.com/vi/R_gQ44lDlEc/default.jpg)
![How I learned to stop worrying and yank the USB - Taylor R Campbell - EuroBSDcon 2022](https://i.ytimg.com/vi/ZtThzncVw2E/default.jpg)
![Writing Custom Command in FreeBSD's DDB Kernel Debugger - John Baldwin - EuroBSDcon 2022](https://i.ytimg.com/vi/sZMcVZjFW4g/default.jpg)
![FreeBSD coming from a Linux user - Toshaan Bharvani - EuroBSDcon 2022](https://i.ytimg.com/vi/s1FLwHpiufA/default.jpg)
![Reviving and evaluating Thompson's backdoor in OpenBSD's make - Samuel Aubertin - EuroBSDcon 2022](https://i.ytimg.com/vi/ikAbK9HFwkI/default.jpg)
![FreeBSD: OpenZFS, bhyve, compat_linux, and jail.conf.d nexus - Michael Dexter - EuroBSDcon 2022](https://i.ytimg.com/vi/-qFG8LebHvo/default.jpg)
![Virtualized Network Infrastrukture for VM Clusters - Albert Dengg - EuroBSDcon 2022](https://i.ytimg.com/vi/3dM5P0wC16k/default.jpg)
![Architectures vs the ports tree: a losing battle ? - Marc Espie - EuroBSDcon 2022](https://i.ytimg.com/vi/Kw2_RWku-co/default.jpg)