Deep Learning Reproducibility with TensorFlow
This video shows how to get deterministic outputs when using TensorFlow, so that the outputs are reproducible. Everything should be perfectly repeatable.
I created a Jupyter notebook to demonstrate this at: https://github.com/ageron/handson-ml/blob/master/extra_tensorflow_reproducibility.ipynb
Researchers at Two Sigma managed to get reproducible outputs on the GPU using TensorFlow, but it wasn't a walk in the park, check it out: https://www.twosigma.com/insights/article/a-workaround-for-non-determinism-in-tensorflow/
If you have a scenario I didn't mention where you need perfect reproducibility, I'd love to hear about it, please post it in the comments below. If you still have non-deterministic results after implementing the recommendations in this video, I'd also love to hear about it. Please specify your Python, Numpy and TensorFlow versions, as well as your O.S. version.
ERRATA:
* At 4:19, it should be CUDA_VISIBLE_DEVICES with an S.
Hope this is useful!
Aurélien Géron
August 11th 2018
Видео Deep Learning Reproducibility with TensorFlow канала Aurélien Géron
I created a Jupyter notebook to demonstrate this at: https://github.com/ageron/handson-ml/blob/master/extra_tensorflow_reproducibility.ipynb
Researchers at Two Sigma managed to get reproducible outputs on the GPU using TensorFlow, but it wasn't a walk in the park, check it out: https://www.twosigma.com/insights/article/a-workaround-for-non-determinism-in-tensorflow/
If you have a scenario I didn't mention where you need perfect reproducibility, I'd love to hear about it, please post it in the comments below. If you still have non-deterministic results after implementing the recommendations in this video, I'd also love to hear about it. Please specify your Python, Numpy and TensorFlow versions, as well as your O.S. version.
ERRATA:
* At 4:19, it should be CUDA_VISIBLE_DEVICES with an S.
Hope this is useful!
Aurélien Géron
August 11th 2018
Видео Deep Learning Reproducibility with TensorFlow канала Aurélien Géron
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![A Short Introduction to Entropy, Cross-Entropy and KL-Divergence](https://i.ytimg.com/vi/ErfnhcEV1O8/default.jpg)
![Capsule Networks (CapsNets) – Tutorial](https://i.ytimg.com/vi/pPN8d0E3900/default.jpg)
![Is this still the best book on Machine Learning?](https://i.ytimg.com/vi/gJ9NcxPUSPE/default.jpg)
![Synthetic Gradients Tutorial - How to Speed Up Deep Learning Training](https://i.ytimg.com/vi/1z_Gv98-mkQ/default.jpg)
![TensorFlow 2.0 Changes](https://i.ytimg.com/vi/WTNH0tcscqo/default.jpg)
![Is there a reproducibility crisis in science? - Matt Anticole](https://i.ytimg.com/vi/FpCrY7x5nEE/default.jpg)
![Natural Language Processing - Tokenization (NLP Zero to Hero - Part 1)](https://i.ytimg.com/vi/fNxaJsNG3-s/default.jpg)
![Knowledge Graphs & Deep Learning at YouTube](https://i.ytimg.com/vi/zzTbptEdKhY/default.jpg)
![Dropout Regularization | Deep Learning Tutorial 20 (Tensorflow2.0, Keras & Python)](https://i.ytimg.com/vi/lcI8ukTUEbo/default.jpg)
![How to implement CapsNets using TensorFlow](https://i.ytimg.com/vi/2Kawrd5szHE/default.jpg)
![CPU vs GPU (What's the Difference?) - Computerphile](https://i.ytimg.com/vi/_cyVDoyI6NE/default.jpg)
![TensorFlow Tutorial 06 - Save & Load Models](https://i.ytimg.com/vi/NVY0FucNRU4/default.jpg)
![CppCon 2017: Peter Goldsborough “A Tour of Deep Learning With C++”](https://i.ytimg.com/vi/Lo1rXJdAJ7w/default.jpg)
![145 - Confusion matrix, ROC and AUC in machine learning](https://i.ytimg.com/vi/Joh3LOaG8Q0/default.jpg)
![These books will help you learn machine learning](https://i.ytimg.com/vi/7R08MPXxiFQ/default.jpg)
![Optimizers, Loss Functions and Learning Rate in Neural Networks with Keras and TensorFlow](https://i.ytimg.com/vi/upsAvKvdROY/default.jpg)
![Saving and Loading Models (Coding TensorFlow)](https://i.ytimg.com/vi/HxtBIwfy0kM/default.jpg)
![Introduction to Forecasting in Machine Learning and Deep Learning](https://i.ytimg.com/vi/bn8rVBuIcFg/default.jpg)
![GPUs: Explained](https://i.ytimg.com/vi/LfdK-v0SbGI/default.jpg)
![Deep Learning Crash Course for Beginners](https://i.ytimg.com/vi/VyWAvY2CF9c/default.jpg)