Learning over sets, subgraphs, and streams: How to accurately incorporate graph context
MSR AI Distinguished Talk Series: Learning over sets, subgraphs, and streams: How to accurately incorporate graph context in network models
Although deep learning methods have been successfully applied in structured domains comprised of images and natural language, it is still difficult to apply the methods directly to graph and network domains due to issues of heterogeneity and long range dependence. In this talk, I will discuss some of our recent work developing neural network methods for complex network domains, including node classification, motif prediction, and knowledge graph inference. The key insights include incorporating dependencies from graph context into both the input features and the model architectures, employing randomization to learn permutation invariant functions over sets, and using graph-aware attention mechanisms to offset noise when incorporating higher-order patterns. Experiments on real work social network data shows that our methods produce significant gains compared to other state-of-the-art methods, but only when we think carefully about how to integrate relational inductive biases into the process.
See more at https://www.microsoft.com/en-us/research/video/learning-over-sets-subgraphs-and-streams-how-to-accurately-incorporate-graph-context/
Видео Learning over sets, subgraphs, and streams: How to accurately incorporate graph context канала Microsoft Research
Although deep learning methods have been successfully applied in structured domains comprised of images and natural language, it is still difficult to apply the methods directly to graph and network domains due to issues of heterogeneity and long range dependence. In this talk, I will discuss some of our recent work developing neural network methods for complex network domains, including node classification, motif prediction, and knowledge graph inference. The key insights include incorporating dependencies from graph context into both the input features and the model architectures, employing randomization to learn permutation invariant functions over sets, and using graph-aware attention mechanisms to offset noise when incorporating higher-order patterns. Experiments on real work social network data shows that our methods produce significant gains compared to other state-of-the-art methods, but only when we think carefully about how to integrate relational inductive biases into the process.
See more at https://www.microsoft.com/en-us/research/video/learning-over-sets-subgraphs-and-streams-how-to-accurately-incorporate-graph-context/
Видео Learning over sets, subgraphs, and streams: How to accurately incorporate graph context канала Microsoft Research
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
The Intern Experience at Microsoft Research CambridgeBattling Tuberculosis Using Microsoft TechnologyFast and Flexible Multi-Task Classification Using Conditional Neural Adaptive ProcessesData Visualization Reaches New Heights with LayerscapeFaculty Summit 2018 IntroductionMicrosoft Pix - Take Better Photos of People, AutomaticallyImprovements on Higher Order Ambisonics ReproductionCambridge lab overview with Chris BishopGet free cloud computing time and storage on Microsoft AzureHow interns at our New England Lab impact research at MicrosoftAI Institute "Geometry of Deep Learning" 2019 [Workshop] Day 1 | Session 2De-Identifying Healthcare Data for ResearchIntelligent cloud computing lifts villages out of water povertyHow Microsoft and Novartis created Assess MS (short version)How OSIsoft and Deschutes Brewery used Microsoft Security Risk DetectionChronoZoom curriculum and technologyRecent Advances in Image Captioning, Image-Text Retrieval and…Using machine learning and AI to reduce hospital readmissionsIROS 2020 - Mixed Reality and Robotics Tutorial - Demo 1: InteractionCamera-based non-contact health sensingKinect and sign language translation (2:43)