NodePiece 2022: New vocabulary for your Knowledge Graph #Shorts
New representation learning algorithms for knowledge graphs (KG): NodePiece. An anchor-based approach to learn a fixed-size entity vocabulary. In NodePiece, a vocabulary of sub-entity units is constructed from anchor nodes in a graph with known relation types. Similar to WordPiece tokenization for BERT in NLP.
Arxiv preprint (credits to):
https://arxiv.org/pdf/2106.12144.pdf
Mikhail Galkin,Etienne Denis, Jiapeng Wu and William L. Hamilton
Published as a conference paper at ICLR 2022
New NodePiece tokenization can augment any existing downstream KG task. Almost no performance drop: the overall performance level is comparable to much bigger shallow embedding models.
#shorts
#KnowledgeGraphs
#NodePiece
#knowledge
#graphs
#token
#tokenization
Видео NodePiece 2022: New vocabulary for your Knowledge Graph #Shorts канала Discover AI
Arxiv preprint (credits to):
https://arxiv.org/pdf/2106.12144.pdf
Mikhail Galkin,Etienne Denis, Jiapeng Wu and William L. Hamilton
Published as a conference paper at ICLR 2022
New NodePiece tokenization can augment any existing downstream KG task. Almost no performance drop: the overall performance level is comparable to much bigger shallow embedding models.
#shorts
#KnowledgeGraphs
#NodePiece
#knowledge
#graphs
#token
#tokenization
Видео NodePiece 2022: New vocabulary for your Knowledge Graph #Shorts канала Discover AI
AI Sentence embedding Transformer BERT HuggingFace Transformer models Machine learning Deep learning Unsupervised learning Sentence transformer Natural language processing artificial intelligence AI data center Multi GPU Tensor cores SPARK cluster Data center cloud computing Sentence Embedding Databricks train AI model
Комментарии отсутствуют
Информация о видео
18 мая 2022 г. 16:15:00
00:00:58
Другие видео канала
