Temporal Graph Networks (TGN) | GNN Paper Explained
❤️ Become The AI Epiphany Patreon ❤️ ► https://www.patreon.com/theaiepiphany
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
A deep dive into the temporal graph networks paper.
You'll learn about:
✔️ What are dynamic graphs?
✔️ How to get a vectorized representation of time
✔️ All the nitty-gritty details behind the paper
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ https://arxiv.org/abs/2006.10637
✅ Chris Olah on LSTMs: https://colah.github.io/posts/2015-08-Understanding-LSTMs/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00 Dynamic graphs
03:00 Suboptimal strategies
05:30 Terminology, temporal neighborhood
07:30 High-level overview of the system
08:35 We need to go deeper
13:30 Using temporal information to sample
14:10 Information leakage and the solution
16:55 Main modules explained
21:20 Memory staleness problem
24:00 Temporal graph attention
26:00 Vector representation of time
29:15 Batch size tradeoff
31:00 Results and ablation studies
33:55 Recap of the system
36:55 Some confusing parts
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 BECOME A PATREON OF THE AI EPIPHANY ❤️
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany ► https://www.patreon.com/theaiepiphany
One-time donation:
https://www.paypal.com/paypalme/theaiepiphany
Much love! ❤️
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💡 The AI Epiphany is a channel dedicated to simplifying the field of AI using creative visualizations and in general, a stronger focus on geometrical and visual intuition, rather than the algebraic and numerical "intuition".
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
👋 CONNECT WITH ME ON SOCIAL
LinkedIn ► https://www.linkedin.com/in/aleksagordic/
Twitter ► https://twitter.com/gordic_aleksa
Instagram ► https://www.instagram.com/aiepiphany/
Facebook ► https://www.facebook.com/aiepiphany/
👨👩👧👦 JOIN OUR DISCORD COMMUNITY:
Discord ► https://discord.gg/peBrCpheKE
📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER:
Substack ► https://aiepiphany.substack.com/
💻 FOLLOW ME ON GITHUB FOR COOL PROJECTS:
GitHub ► https://github.com/gordicaleksa
📚 FOLLOW ME ON MEDIUM:
Medium ► https://gordicaleksa.medium.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#temporalgraphnetworks #dynamicgraphs #graphml
Видео Temporal Graph Networks (TGN) | GNN Paper Explained канала Aleksa Gordić - The AI Epiphany
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
A deep dive into the temporal graph networks paper.
You'll learn about:
✔️ What are dynamic graphs?
✔️ How to get a vectorized representation of time
✔️ All the nitty-gritty details behind the paper
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
✅ https://arxiv.org/abs/2006.10637
✅ Chris Olah on LSTMs: https://colah.github.io/posts/2015-08-Understanding-LSTMs/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
⌚️ Timetable:
00:00 Dynamic graphs
03:00 Suboptimal strategies
05:30 Terminology, temporal neighborhood
07:30 High-level overview of the system
08:35 We need to go deeper
13:30 Using temporal information to sample
14:10 Information leakage and the solution
16:55 Main modules explained
21:20 Memory staleness problem
24:00 Temporal graph attention
26:00 Vector representation of time
29:15 Batch size tradeoff
31:00 Results and ablation studies
33:55 Recap of the system
36:55 Some confusing parts
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💰 BECOME A PATREON OF THE AI EPIPHANY ❤️
If these videos, GitHub projects, and blogs help you,
consider helping me out by supporting me on Patreon!
The AI Epiphany ► https://www.patreon.com/theaiepiphany
One-time donation:
https://www.paypal.com/paypalme/theaiepiphany
Much love! ❤️
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
💡 The AI Epiphany is a channel dedicated to simplifying the field of AI using creative visualizations and in general, a stronger focus on geometrical and visual intuition, rather than the algebraic and numerical "intuition".
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
👋 CONNECT WITH ME ON SOCIAL
LinkedIn ► https://www.linkedin.com/in/aleksagordic/
Twitter ► https://twitter.com/gordic_aleksa
Instagram ► https://www.instagram.com/aiepiphany/
Facebook ► https://www.facebook.com/aiepiphany/
👨👩👧👦 JOIN OUR DISCORD COMMUNITY:
Discord ► https://discord.gg/peBrCpheKE
📢 SUBSCRIBE TO MY MONTHLY AI NEWSLETTER:
Substack ► https://aiepiphany.substack.com/
💻 FOLLOW ME ON GITHUB FOR COOL PROJECTS:
GitHub ► https://github.com/gordicaleksa
📚 FOLLOW ME ON MEDIUM:
Medium ► https://gordicaleksa.medium.com/
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
#temporalgraphnetworks #dynamicgraphs #graphml
Видео Temporal Graph Networks (TGN) | GNN Paper Explained канала Aleksa Gordić - The AI Epiphany
Показать
Комментарии отсутствуют
Информация о видео
17 января 2021 г. 21:50:22
00:39:28
Другие видео канала
Feed-forward method | Neural Style Transfer #510k subscribers | joining Google DeepMind, updates, AMADay 25: Open NLLB - filtering HBS (Pt 2)Fastformer: Additive Attention Can Be All You Need | Paper ExplainedDay 24: Open NLLB - back from China, analyzing spikes, preparing HBS run (Pt 2)Day 6: Meta NLLB - data filtering (Pt. 4)Day 24: Open NLLB - back from China, filtering HBS data (Pt 3)Day 14: Open NLLB - Eval of our first run (English, Turkish, Hindi) (Pt 2.)The Vesuvius challenge breakthrough with Luke FarritorDay 4: Training 600M NLLB - data preps (Pt. 2)DeepMind's Android RL Environment - AndroidEnvHamel Husain - Building LLM Apps in ProductionDay 28: Open NLLB - debugging fuzzy dedup, training fasttext LID (Pt 3)Day 10: Open NLLB - evaluation data, filtering (Pt 3.)Day 18: Open NLLB - data loading document, GitHub tasks (Pt 1 cont.)DeepMind's TacticAI: an AI assistant for football tactics | Petar VeličkovićJarvis for Images! (demo) - run locally, no external APIsDay 15: Open NLLB - ALTI+, detecting hallucinations (Pt 2)Day 29: Open NLLB - training fasttext LID (Pt 1)LLaMA 2 w/ Thomas Scialom (LLaMA 2 lead)Day 19: Open NLLB - compute grant, downloading HBS parallel corpora (Pt 1)