Posterior for the Bernoulli using the Conjugate Prior | with example in TensorFlow Probability
If we observe data on the event modelled by a Bernoulli distribution, we could be interested in finding a posterior distribution over the latent parameter to it. If we use a conjugate prior, this posterior has a closed-form solution. Here are the notes: https://raw.githubusercontent.com/Ceyron/machine-learning-and-simulation/main/english/essential_pmf_pdf/bernoulli_posterior.pdf
The Bernoulli distribution is actually one of these rare cases in which we can actually express all associated distributions: The marginal, the posterior and the predictive posterior. Other more sophisticated distributions do not allow for this since we there run into the trouble of intractability when applying Bayes' rule.
-------
📝 : Check out the GitHub Repository of the channel, where I upload all the handwritten notes and source-code files (contributions are very welcome): https://github.com/Ceyron/machine-learning-and-simulation
📢 : Follow me on LinkedIn or Twitter for updates on the channel and other cool Machine Learning & Simulation stuff: https://www.linkedin.com/in/felix-koehler and https://twitter.com/felix_m_koehler
💸 : If you want to support my work on the channel, you can become a Patreon here: https://www.patreon.com/MLsim
-------
⚙️ My Gear:
(Below are affiliate links to Amazon. If you decide to purchase the product or something else on Amazon through this link, I earn a small commission.)
- 🎙️ Microphone: Blue Yeti: https://amzn.to/3NU7OAs
- ⌨️ Logitech TKL Mechanical Keyboard: https://amzn.to/3JhEtwp
- 🎨 Gaomon Drawing Tablet (similar to a WACOM Tablet, but cheaper, works flawlessly under Linux): https://amzn.to/37katmf
- 🔌 Laptop Charger: https://amzn.to/3ja0imP
- 💻 My Laptop (generally I like the Dell XPS series): https://amzn.to/38xrABL
- 📱 My Phone: Fairphone 4 (I love the sustainability and repairability aspect of it): https://amzn.to/3Jr4ZmV
If I had to purchase these items again, I would probably change the following:
- 🎙️ Rode NT: https://amzn.to/3NUIGtw
- 💻 Framework Laptop (I do not get a commission here, but I love the vision of Framework. It will definitely be my next Ultrabook): https://frame.work
As an Amazon Associate I earn from qualifying purchases.
-------
Timestamps
00:00 Opening
00:16 Task of inferring parameters from data
01:30 Graphical Model and joint
04:10 Deriving the Posterior
11:20 A conjugate prior
11:55 TensorFlow Probability
15:25 End-Card
Видео Posterior for the Bernoulli using the Conjugate Prior | with example in TensorFlow Probability канала Machine Learning & Simulation
The Bernoulli distribution is actually one of these rare cases in which we can actually express all associated distributions: The marginal, the posterior and the predictive posterior. Other more sophisticated distributions do not allow for this since we there run into the trouble of intractability when applying Bayes' rule.
-------
📝 : Check out the GitHub Repository of the channel, where I upload all the handwritten notes and source-code files (contributions are very welcome): https://github.com/Ceyron/machine-learning-and-simulation
📢 : Follow me on LinkedIn or Twitter for updates on the channel and other cool Machine Learning & Simulation stuff: https://www.linkedin.com/in/felix-koehler and https://twitter.com/felix_m_koehler
💸 : If you want to support my work on the channel, you can become a Patreon here: https://www.patreon.com/MLsim
-------
⚙️ My Gear:
(Below are affiliate links to Amazon. If you decide to purchase the product or something else on Amazon through this link, I earn a small commission.)
- 🎙️ Microphone: Blue Yeti: https://amzn.to/3NU7OAs
- ⌨️ Logitech TKL Mechanical Keyboard: https://amzn.to/3JhEtwp
- 🎨 Gaomon Drawing Tablet (similar to a WACOM Tablet, but cheaper, works flawlessly under Linux): https://amzn.to/37katmf
- 🔌 Laptop Charger: https://amzn.to/3ja0imP
- 💻 My Laptop (generally I like the Dell XPS series): https://amzn.to/38xrABL
- 📱 My Phone: Fairphone 4 (I love the sustainability and repairability aspect of it): https://amzn.to/3Jr4ZmV
If I had to purchase these items again, I would probably change the following:
- 🎙️ Rode NT: https://amzn.to/3NUIGtw
- 💻 Framework Laptop (I do not get a commission here, but I love the vision of Framework. It will definitely be my next Ultrabook): https://frame.work
As an Amazon Associate I earn from qualifying purchases.
-------
Timestamps
00:00 Opening
00:16 Task of inferring parameters from data
01:30 Graphical Model and joint
04:10 Deriving the Posterior
11:20 A conjugate prior
11:55 TensorFlow Probability
15:25 End-Card
Видео Posterior for the Bernoulli using the Conjugate Prior | with example in TensorFlow Probability канала Machine Learning & Simulation
Показать
Комментарии отсутствуют
Информация о видео
21 марта 2021 г. 20:27:34
00:15:47
Другие видео канала
![Adjoint Sensitivities over nonlinear equation with JAX Automatic Differentiation](https://i.ytimg.com/vi/XffFjSMLSkM/default.jpg)
![Deriving the Weak Form for Linear Elasticity in Structural Mechanics](https://i.ytimg.com/vi/Z-FnP2myvKw/default.jpg)
![Scientific Python Tutorial Workshop | Part 3 | Scikit-Learn & a bit of TensorFlow](https://i.ytimg.com/vi/KQ-3KtgZMO4/default.jpg)
![Wavenumber 128 Kolmogorov Flow | Turbulence Simulation](https://i.ytimg.com/vi/ePQvTl76Fkg/default.jpg)
![Update: Machine Learning & Simulation now has a Patreon Page](https://i.ytimg.com/vi/4p4SXQur29Q/default.jpg)
![Wavenumber 64 Kolmogorov Flow | Turbulence Simulation](https://i.ytimg.com/vi/hqg-4DUWwFQ/default.jpg)
![Binomial Distribution | Intuition & Introduction | w\ example in TensorFlow Probability](https://i.ytimg.com/vi/57TU00lA3Wc/default.jpg)
![Posterior & MAP for the Categorical | Full Derivation | example in TensorFlow Probability](https://i.ytimg.com/vi/uTl7iQq2N-E/default.jpg)
![Finite Element Method in FEniCS: 1D Transient Heat Diffusion in detail](https://i.ytimg.com/vi/A25_fAf4kxc/default.jpg)
![What is a Jacobian-Vector product (jvp) in JAX?](https://i.ytimg.com/vi/caoeihy9kLo/default.jpg)
![Simple KS solver in JAX](https://i.ytimg.com/vi/dcmXYa2qyy8/default.jpg)
![Linear Regression in High Dimensions - Deriving the matrix-valued Least-Squares Loss](https://i.ytimg.com/vi/jXVvsa58aoQ/default.jpg)
![Maximum Likelihood Estimate for the One-Hot Categorical | TensorFlow Probability](https://i.ytimg.com/vi/qfoJnrhjTm8/default.jpg)
![Maximum A Posteriori Estimate (MAP) for Bernoulli | Derivation & TensorFlow Probability](https://i.ytimg.com/vi/-g-yQTFmkGI/default.jpg)
![Sampling the Multivariate Normal distribution | example in Python](https://i.ytimg.com/vi/DSWM7-9gK7s/default.jpg)
![Deformation Gradient | Continuum Mechanics | with simple examples](https://i.ytimg.com/vi/R4bcgX1RofE/default.jpg)
![Nonlinear System Solve - Pullback/vJp rule](https://i.ytimg.com/vi/jxaT5b6Eqjs/default.jpg)
![Matrix-Vector product - Pullback/vJp rule](https://i.ytimg.com/vi/lqIhocjJLUc/default.jpg)
![Dirichlet Distribution | Intuition & Intro | w\ example in TensorFlow Probability](https://i.ytimg.com/vi/gWgsKyEjclw/default.jpg)
![Simple forward-mode AD in Julia using Dual Numbers and Operator Overloading](https://i.ytimg.com/vi/DfKKTE9XU0Q/default.jpg)