TGN: Temporal Graph Networks for Deep Learning on Dynamic Graphs [Paper Explained by the Author]
Speaker(s): Emanuele Rossi
Find the recording, slides, and more info at https://ai.science/e/tgn-temporal-graph-networks-for-deep-learning-on-dynamic-graphs--eqAnR859q8wk2jfcGnbx
Motivation / Abstract
Graph Neural Networks (GNNs) have recently become increasingly popular due to their ability to learn complex systems of relations or interactions arising in a broad spectrum of problems ranging from biology and particle physics to social networks and recommendation systems. Despite the plethora of different models for deep learning on graphs, few approaches have been proposed thus far for dealing with graphs that present some sort of dynamic nature (e.g. evolving
features or connectivity over time). In this paper, the authors present Temporal Graph Networks (TGNs), a generic, efficient framework for deep learning on dynamic graphs represented as sequences of timed events. Thanks to a novel combination of memory modules and graph-based operators, TGNs are able to significantly outperform previous approaches being at the same time more computationally efficient. The authors furthermore show that several previous models for learning on dynamic graphs can be cast as specific instances of the TGN framework. They perform a
detailed ablation study of different components of the TGN framework and devise the best configuration that achieves state-of-the-art performance on several transductive and inductive prediction tasks for dynamic graphs.
What was discussed?
- Understanding the need for dynamic graphs and current limitations using static GNN approaches
- TGN memory modules and time dependent embedding modules
- TGN advanced training strategy with 19x speed up over TGAT and consistent improvement
------
#AISC hosts 3-5 live sessions like this on various AI research, engineering, and product topics every week! Visit https://ai.science for more details
Видео TGN: Temporal Graph Networks for Deep Learning on Dynamic Graphs [Paper Explained by the Author] канала ML Explained - Aggregate Intellect - AI.SCIENCE
Find the recording, slides, and more info at https://ai.science/e/tgn-temporal-graph-networks-for-deep-learning-on-dynamic-graphs--eqAnR859q8wk2jfcGnbx
Motivation / Abstract
Graph Neural Networks (GNNs) have recently become increasingly popular due to their ability to learn complex systems of relations or interactions arising in a broad spectrum of problems ranging from biology and particle physics to social networks and recommendation systems. Despite the plethora of different models for deep learning on graphs, few approaches have been proposed thus far for dealing with graphs that present some sort of dynamic nature (e.g. evolving
features or connectivity over time). In this paper, the authors present Temporal Graph Networks (TGNs), a generic, efficient framework for deep learning on dynamic graphs represented as sequences of timed events. Thanks to a novel combination of memory modules and graph-based operators, TGNs are able to significantly outperform previous approaches being at the same time more computationally efficient. The authors furthermore show that several previous models for learning on dynamic graphs can be cast as specific instances of the TGN framework. They perform a
detailed ablation study of different components of the TGN framework and devise the best configuration that achieves state-of-the-art performance on several transductive and inductive prediction tasks for dynamic graphs.
What was discussed?
- Understanding the need for dynamic graphs and current limitations using static GNN approaches
- TGN memory modules and time dependent embedding modules
- TGN advanced training strategy with 19x speed up over TGAT and consistent improvement
------
#AISC hosts 3-5 live sessions like this on various AI research, engineering, and product topics every week! Visit https://ai.science for more details
Видео TGN: Temporal Graph Networks for Deep Learning on Dynamic Graphs [Paper Explained by the Author] канала ML Explained - Aggregate Intellect - AI.SCIENCE
Показать
Комментарии отсутствуют
Информация о видео
22 июля 2020 г. 10:08:06
01:02:55
Другие видео канала
The basics of spatio-temporal graph neural networksDeep learning on graphs: successes, challenges | Graph Neural Networks | Michael BronsteintNodeEmbed: Node Embeddings over Temporal Graphs | ML with Graphs (Research Paper Walkthrough)TGN: Temporal Graph Networks for Dynamic GraphsFriendly Introduction to Temporal Graph Neural Networks (and some Traffic Forecasting)Deep learning with dynamic graph neural networksAn extension of Physics Informed Neural Networks with a modal approach – IVADO Octobre NumériqueData Scientist vs ML Engineer | A Data Scientist’s PerspectiveAn Introduction to Graph Neural Networks: Models and ApplicationsIntro to graph neural networks (ML Tech Talks)Preview: Graph NNsMichael Bronstein - Geometric deep learning on graphs: going beyond Euclidean dataTemporal Graph Networks (TGN) | GNN Paper ExplainedTemporal graph networksHanna Meyer: "Machine-learning based modelling of spatial and spatio-temporal data"Deep InfoMax: Learning deep representations by mutual information estimation and maximization | AISC‘Spatio-Temporal Traffic Prediction Using Deep Learning’ - Dr Duo LiInductive Graph Representation Learning on Large Graphs (NIPS-07) presented by Lee Ween JianLecture: Graph Neural Networks