6. L1 & L2 Regularization
We introduce "regularization", our main defense against overfitting. We discuss the equivalence of the penalization and constraint forms of regularization (see Hwk 4 Problem 8 for a precise statement). We compare regularization paths of L1- and L2-regularized linear least squares regression (i.e. "lasso" and "ridge" regression, respectively), and give a geometric argument for why lasso often gives "sparse" solutions. Finally, we present "coordinate descent", our second major approach to optimization. When applied to the lasso objective function, coordinate descent takes a particularly clean form and is known as the "shooting algorithm"
Access the full course at https://bloom.bg/2ui2T4q
Видео 6. L1 & L2 Regularization канала Inside Bloomberg
Access the full course at https://bloom.bg/2ui2T4q
Видео 6. L1 & L2 Regularization канала Inside Bloomberg
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Spotlight On: 2021 Damien Awards with Hetrick-Martin Institute](https://i.ytimg.com/vi/m-N_Q3ZqqJM/default.jpg)
![Bloomberg's Distinguished Engineers Speaker Series: Benjamin Day](https://i.ytimg.com/vi/TnbGWM3zgT4/default.jpg)
![Bloomberg Cornell Tech Series: Josh Silverman, CEO of Etsy - Highlight](https://i.ytimg.com/vi/3eAn2DLujSM/default.jpg)
![2019 D4GX Immersion Day Project @ Love City Strong VI](https://i.ytimg.com/vi/wkKgR0CMkmA/default.jpg)
![Bloomberg Cornell Tech Series: Rob Wiesenthal, CEO of BLADE - Full Interview](https://i.ytimg.com/vi/BDWqMhl8_r8/default.jpg)
![Chromatic Patterns for Bloomberg, by Judy Ledgerwood at 919 3rd Ave , NYC](https://i.ytimg.com/vi/5EEMA-H1WsI/default.jpg)
![Bloomberg in the Computer History Museum](https://i.ytimg.com/vi/vN_ZFpt6Bbs/default.jpg)
![Bloomberg's Distinguished Engineers Speaker Series: Kyle Kingsbury](https://i.ytimg.com/vi/V_1c8sXTuj0/default.jpg)
![D4GX 2018 Open Session & Keynote](https://i.ytimg.com/vi/8ZpQ4KZZwoc/default.jpg)
![Getting the Job Done During COVID-19 - Bloomberg News and Media](https://i.ytimg.com/vi/SSd1vHSJ87M/default.jpg)
![Help London Breathe: Tree Planting](https://i.ytimg.com/vi/sRZoZMbpc_Q/default.jpg)
![Data for Good Exchange 2015 (Bloomberg)](https://i.ytimg.com/vi/FMM6rckvrbs/default.jpg)
![Day in the Life of a Bloomberg Engineer: Daniel](https://i.ytimg.com/vi/ARwnyW4HTFk/default.jpg)
![Spotlight On: Feeding New Yorkers during Covid with Publicolor](https://i.ytimg.com/vi/rGelDKJO2uI/default.jpg)
![Data for Good Exchange 2015: Vlad Kliatchko On Data and Technology](https://i.ytimg.com/vi/LvhW0cgb27Q/default.jpg)
![D4GX 2018: Sustainable Finance: Leveraging Capital for Gender Equality & Climate Change Response](https://i.ytimg.com/vi/pdjUZcub2l4/default.jpg)
![Bloomberg's Distinguished Engineers Speaker Series: Danielle Leong](https://i.ytimg.com/vi/qJys8oiB0SI/default.jpg)
![Bloomberg Cornell Tech Speaker Series: Foursquare Explains Location Intelligence (Full Version)](https://i.ytimg.com/vi/aAf__Xh-aFA/default.jpg)
![Nitin Shares What It's Like Working in Sales in Singapore at Bloomberg](https://i.ytimg.com/vi/3Ft7v7o1OZY/default.jpg)
![Bloomberg Working Families Make it Work](https://i.ytimg.com/vi/YlnGSpcD8hA/default.jpg)
![Building on a Strong Past, Sao Paulo Looks to the Future](https://i.ytimg.com/vi/PnH9sktb5C8/default.jpg)