Multi-Label Classification on Unhealthy Comments - Finetuning RoBERTa with PyTorch - Coding Tutorial
A practical Python Coding Guide - In this guide I train RoBERTa using PyTorch Lightning on a Multi-label classification task. In particular the unhealthy comment corpus - this creates a language model that can classify whether an online comment contains attributes such as sarcasm, hostility or dismissiveness.
---- TUTORIAL NOTEBOOK
https://colab.research.google.com/drive/1ejBYmu0P5urzghoTTDB-GBUxpbUFX0Gz?usp=sharing
remember to press copy to drive to save a copy of the notebook for yourself
Intro: 00:00:00
Video / project outline: 00:00:27
Getting Google Colab set up: 00:02:00
Imports: 00:03:23
Inspect data: 00:07:05
Pytorch dataset: 00:11:15
Pytorch lightning data module: 00:27:08
Creating the model / classifier: 00:35:45
Training and evaluating model: 01:07:30
This series attempts to offer a casual guide to Hugging Face and Transformer models focused on implementation rather than theory. Let me know if you enjoy them! Will be doing future videos on computer vision if that is something people are interested in, let me know in the comments :)
----- Research material for theory
RoBERTa paper: https://arxiv.org/abs/1907.11692
HuggingFace: https://huggingface.co/
Unhealthy Comment Corpus paper: https://arxiv.org/abs/2010.07410
Check out my website: https://www.rupert.digital
Видео Multi-Label Classification on Unhealthy Comments - Finetuning RoBERTa with PyTorch - Coding Tutorial канала rupert ai
---- TUTORIAL NOTEBOOK
https://colab.research.google.com/drive/1ejBYmu0P5urzghoTTDB-GBUxpbUFX0Gz?usp=sharing
remember to press copy to drive to save a copy of the notebook for yourself
Intro: 00:00:00
Video / project outline: 00:00:27
Getting Google Colab set up: 00:02:00
Imports: 00:03:23
Inspect data: 00:07:05
Pytorch dataset: 00:11:15
Pytorch lightning data module: 00:27:08
Creating the model / classifier: 00:35:45
Training and evaluating model: 01:07:30
This series attempts to offer a casual guide to Hugging Face and Transformer models focused on implementation rather than theory. Let me know if you enjoy them! Will be doing future videos on computer vision if that is something people are interested in, let me know in the comments :)
----- Research material for theory
RoBERTa paper: https://arxiv.org/abs/1907.11692
HuggingFace: https://huggingface.co/
Unhealthy Comment Corpus paper: https://arxiv.org/abs/2010.07410
Check out my website: https://www.rupert.digital
Видео Multi-Label Classification on Unhealthy Comments - Finetuning RoBERTa with PyTorch - Coding Tutorial канала rupert ai
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![The U-Net (actually) explained in 10 minutes](https://i.ytimg.com/vi/NhdzGfB1q74/default.jpg)
![ResNet (actually) explained in under 10 minutes](https://i.ytimg.com/vi/o_3mboe1jYI/default.jpg)
![London ML Researcher @ CVPR 2022, New Orleans. Highlights! (ft. Telsa Cybertruck & Dream Fields)](https://i.ytimg.com/vi/rIJsVPeoWVo/default.jpg)
![Implementing a multi-class CNN Image Classifier in Pytorch! Computer Vision Basics Ep. 3 CIFAR10 CNN](https://i.ytimg.com/vi/iG8B7x_prLQ/default.jpg)
![Understanding Convolution Kernels for CNNs! Computer Vision Basics Ep. 2 What are convolutions?](https://i.ytimg.com/vi/6VP9k2WM6k0/default.jpg)
![Image Classification with CIFAR 10! Computer Vision Basics Ep. 1 Loading Data (coding follow-along)](https://i.ytimg.com/vi/eIuR_y4t1QA/default.jpg)
![Masked Language Modelling Part 2 - Retraining BERT w/ Hugging Face Trainer - MRSCC - Coding Tutorial](https://i.ytimg.com/vi/fxlr-OKzCos/default.jpg)
![Masked Language Modelling with Hugging Face - Microsoft Sentence Completion - Coding Tutorial](https://i.ytimg.com/vi/f2Zg997nw8g/default.jpg)
![Hugging Face Transformers: the basics. Practical coding guides SE1E1. NLP Models (BERT/RoBERTa)](https://i.ytimg.com/vi/DQc2Mi7BcuI/default.jpg)