Custom optimizer in PyTorch

This video shows how one can implement custom optimizers in PyTorch.

00:00​ Optimizer class
02:43​ Rosenbrock function
04:21 Optimization logic implementation
07:20 Visualization logic implementation
10:47​ Adam and SGD example
12:29​ Custom optimizer
17:40 Outro

Code - https://github.com/jankrepl/mildlyoverfitted/tree/master/mini_tutorials/custom_optimizer_in_pytorch

If you have any video suggestions or you just wanna chat feel free to join the discord server: https://discord.gg/a8Va9tZsG5

Useful resources
https://pytorch.org/docs/stable/optim.html
https://github.com/jettify/pytorch-optimizer

Видео Custom optimizer in PyTorch канала mildlyoverfitted