Colab GPU Benchmarks for Fine-Tuning BERT

Overview and comparison of the Tesla GPUs available in Google Colab. We'll look at their memory capacity and compare their training speeds.

Also, I share a table and plot for the maximum sequence length (at various training batch sizes) that will fit in the memory of a Tesla K80.

==== Notebooks ====
- Blog post: http://mccormickml.com/2020/07/21/gpu-benchmarks-for-fine-tuning-bert/
- Colab Notebook version: https://colab.research.google.com/drive/1Gzm0mBTWQLtI5q8azxwudmZGBWyiq6II
- Parameter Search Notebook: https://colab.research.google.com/drive/15OdPZPVx9OFGK_4eRp8PLOt2yb3Ma5dX

==== Updates ====
Sign up to hear about new content across my blog and channel: https://www.chrismccormick.ai/subscribe

Видео Colab GPU Benchmarks for Fine-Tuning BERT канала ChrisMcCormickAI