Perceiver for Cardiac Video Data Classification (AlphaCare: Episode 2)

DeepMind recently released a new type of Transformer called the Perceiver IO, which was able to achieve state of the art accuracy across multiple data types (text, images, point clouds, and more). In this episode of the AlphaCare series, I'll explain how Perceiver works, and how we used it to improve accuracy scores for Cardiac video data. The EchoNet dataset was recently made public by Stanford University, and it contains 10K privatized heart videos from patients. We'll also discuss why Transformer networks work so well, and how by using 2 key features (Cross attention & positional embeddings), the Perceiver improved on all variants of Transformers. Get hype!

Big thanks to RapidAPI for sponsoring this video series:
https://rapidapi.com/hub?utm_source=Siraj-Raval&utm_medium=DevRel&utm_campaign=DevRel

Code & Coding Challenge:
https://github.com/llSourcell/AlphaCare/tree/main/Perceiver

Challenge Submission Link:
https://forms.gle/2DJkYts4HAfHMKpm8

More Learning Resources:

Perceiver explainer by Yannic Kilcher:
https://www.youtube.com/watch?v=P_xeshTnPZg&t=1365s

AlphaCare Episode 1 link:
https://youtu.be/fGv6VmfGMLc

Perceiver Explainer by AI Epiphany:
https://www.youtube.com/watch?v=WJWBq4NZfvY

MIT Video on CNNs:
https://www.youtube.com/watch?v=iaSUYvmCekI

Henry AI Labs Video on 3D CNNs:
https://www.youtube.com/watch?v=rcnKGMNyVu4

ECG Time Series Classification Video in PyTorch:
https://www.youtube.com/watch?v=qN3n0TM4Jno

Awesome list of papers + code on ECG Classification:
https://paperswithcode.com/task/ecg-classification

List of awesome materials on Deep Learning in healthcare:
https://github.com/XiaoleiZ/awesome-list-machine-learning-healthcare

Free EdX course on ML in Healthcare:
https://www.edx.org/course/machine-learning-for-healthcare

Andrew Ng's Free Deep Learning courses:
https://www.deeplearning.ai/

Dr David Sinclair at Harvard Medical's Book that inspired me:
https://lifespanbook.com/

My Math of Intelligence Playlist:
https://www.youtube.com/watch?v=xRJCOz3AfYY&list=PL2-dafEMk2A7mu0bSksCGMJEmeddU_H4D

Free Book on Intro to Statistical Learning:
https://www.statlearning.com/

Follow me:

INSTAGRAM:
https://www.instagram.com/sirajraval/

TWITTER:
https://twitter.com/sirajraval

FACEBOOK:
https://www.facebook.com/sirajologyyy

LINKEDIN:
https://www.linkedin.com/in/sirajraval/

TIKTOK (i'll start posting soon):
https://www.tiktok.com/@sirajraval?lang=en

Please subscribe for more programming videos! That's what keeps me going. Join my AI community: http://chatgptschool.io/ Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
https://www.wagergpt.co

Видео Perceiver for Cardiac Video Data Classification (AlphaCare: Episode 2) канала Siraj Raval