XGBoost Part 1 (of 4): Regression
XGBoost is an extreme machine learning algorithm, and that means it's got lots of parts. In this video, we focus on the unique regression trees that XGBoost uses when applied to Regression problems.
NOTE: This StatQuest assumes that you are already familiar with...
The main ideas behind Gradient Boost for Regression: https://youtu.be/3CC4N4z3GJc
...and the main ideas behind Regularization: https://youtu.be/Q81RR3yKn30
Also note, this StatQuest is based on the following sources:
The original XGBoost manuscript: https://arxiv.org/pdf/1603.02754.pdf
And the XGBoost Documentation: https://xgboost.readthedocs.io/en/latest/index.html
⭐ NOTE: When I code, I use Kite, a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I love it! https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=statquest&utm_content=description-only
For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Patreon: https://www.patreon.com/statquest
...or...
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...a cool StatQuest t-shirt or sweatshirt:
https://shop.spreadshirt.com/statquest-with-josh-starmer/
...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer
0:00 Awesome song and introduction
2:35 The initial prediction
3:11 Building an XGBoost Tree for regression
4:07 Calculating Similarity Scores
8:23 Calculating Gain to evaluate different thresholds
13:02 Pruning an XGBoost Tree
15:15 Building an XGBoost Tree with regularization
19:29 Calculating output values for an XGBoost Tree
21:39 Making predictions with XGBoost
23:54 Summary of concepts and main ideas
#statquest #xgboost
Видео XGBoost Part 1 (of 4): Regression канала StatQuest with Josh Starmer
NOTE: This StatQuest assumes that you are already familiar with...
The main ideas behind Gradient Boost for Regression: https://youtu.be/3CC4N4z3GJc
...and the main ideas behind Regularization: https://youtu.be/Q81RR3yKn30
Also note, this StatQuest is based on the following sources:
The original XGBoost manuscript: https://arxiv.org/pdf/1603.02754.pdf
And the XGBoost Documentation: https://xgboost.readthedocs.io/en/latest/index.html
⭐ NOTE: When I code, I use Kite, a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I love it! https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=statquest&utm_content=description-only
For a complete index of all the StatQuest videos, check out:
https://statquest.org/video-index/
If you'd like to support StatQuest, please consider...
Patreon: https://www.patreon.com/statquest
...or...
YouTube Membership: https://www.youtube.com/channel/UCtYLUTtgS3k1Fg4y5tAhLbw/join
...a cool StatQuest t-shirt or sweatshirt:
https://shop.spreadshirt.com/statquest-with-josh-starmer/
...buying one or two of my songs (or go large and get a whole album!)
https://joshuastarmer.bandcamp.com/
...or just donating to StatQuest!
https://www.paypal.me/statquest
Lastly, if you want to keep up with me as I research and create new StatQuests, follow me on twitter:
https://twitter.com/joshuastarmer
0:00 Awesome song and introduction
2:35 The initial prediction
3:11 Building an XGBoost Tree for regression
4:07 Calculating Similarity Scores
8:23 Calculating Gain to evaluate different thresholds
13:02 Pruning an XGBoost Tree
15:15 Building an XGBoost Tree with regularization
19:29 Calculating output values for an XGBoost Tree
21:39 Making predictions with XGBoost
23:54 Summary of concepts and main ideas
#statquest #xgboost
Видео XGBoost Part 1 (of 4): Regression канала StatQuest with Josh Starmer
Показать
Комментарии отсутствуют
Информация о видео
16 декабря 2019 г. 19:00:04
00:25:46
Другие видео канала
XGBoost Part 2 (of 4): ClassificationGradient Boost Part 1 (of 4): Regression Main IdeasRegularization Part 1: Ridge (L2) RegressionXGBoost Made Easy | Extreme Gradient Boosting | AWS SageMakerSimulating Foraging DecisionsGradient Boosting In Depth Intuition- Part 1 Machine LearningXGBoost tutorial in RXGBoost: How it works, with an example.Xgboost Classification Indepth Maths Intuition- Machine Learning Algorithms🔥🔥🔥🔥AdaBoost, Clearly ExplainedXgboost Regression In-Depth Intuition Explained- Machine Learning Algorithms 🔥🔥🔥🔥193 - What is XGBoost and is it really better than Random Forest and Deep Learning?How to make your own StatQuest!!!Using Bootstrapping to Calculate p-values!!!Boosting - EXPLAINED!Regression Trees, Clearly Explained!!!Boosting Machine Learning Tutorial | Adaptive Boosting, Gradient Boosting, XGBoost | EdurekaMachine Learning Fundamentals: Bias and VarianceXGBOOST in Python (Hyper parameter tuning)