Does debiasing word embeddings actually work? (+ explanation of GN-GloVe, Hard-debiasing)

We'll look at two approaches to debiasing GloVe embeddings: Hard debiasing and GN-GloVe, and discuss whether these approaches actually work or are just "Lipstick on a Pig", using the Word Embedding Association Test.

Social:
Twitter: https://twitter.com/mukulrathi_
My website (+ blog): https://mukulrathi.com/
My email newsletter: https://newsletter.mukulrathi.com

--------------------------------------------------------------------------------------------------------------

Links:
Man is to Computer Programmer as Woman is to Homemaker?: https://arxiv.org/pdf/1607.06520.pdf
Learning Gender-Neutral Word Embeddings (GN-GLoVe): https://arxiv.org/pdf/1809.01496.pdf
Lipstick on a Pig:
Debiasing Methods Cover up Systematic Gender Biases
in Word Embeddings But do not Remove Them: https://arxiv.org/pdf/1903.03862.pdf
Word Embedding Association Test: https://arxiv.org/pdf/1608.07187.pdf
------------------------------------------------------------------------------------
Timestamps:

00:00 Introduction
00:30 Overview
01:06 Word embeddings + analogies
01:50 Bias in Word embeddings
02:15 Hard-debiasing word-embeddings
02:27 Step 1 - Identify Gender bias direction
03:09 Step 2 - Neutralise Gender-Neutral words
03:29 Step 3 - Equalise Gender Pairs
03:40 Extra step: Identifying Gender-Neutral words
04:25 Gender-Neutral (GN) GloVe
05:36 GN GloVe Loss Function
07:30 Soft vs Hard Debiasing
07:52 Lipstick on a Pig?
08:43 Word Embeddings Association Test
10:03 Is Debiasing Embeddings Futile?
----------------------------------------

Music By: "KaizanBlu"
Track Name: "Remember"
• Instagram - https://www.instagram.com/kaizanblu/
• SoundCloud - https://soundcloud.com/kaizanblu/
• Facebook - https://www.facebook.com/kaizanblumusic/
• TikTok - @kaizanblu http://vm.tiktok.com/aCYwfx/
• YouTube - https://www.youtube.com/channel/UCUtxQO1jg3bJcRjBWnYAzmw
Licence: Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
• Music released by: Chill Out Records https://goo.gl/fh3rEJ @

www.ChillOutMedia.com / www.LoFi-HipHop.com

Видео Does debiasing word embeddings actually work? (+ explanation of GN-GloVe, Hard-debiasing) канала Mukul Rathi