ONNX and ONNX Runtime
What is the universal inference engine for neural networks?
Tensorflow? PyTorch? Keras? There are many popular frameworks out there for working with Deep Learning and ML models, each with their pros and cons for practical usability for product development and/or research. Once you decide what to use and train a model, now you need to figure out how to deploy it onto your platform and architecture of choice. Cloud? Windows? Linux? IOT? Performance sensitive? How about GPU acceleration? With a landscape of 1,000,001 different combinations for deploying a trained model from some chosen framework into a performant production environment for prediction, we can benefit from some standardization.
See more at https://www.microsoft.com/en-us/research/video/onnx-and-onnx-runtime/
Видео ONNX and ONNX Runtime канала Microsoft Research
Tensorflow? PyTorch? Keras? There are many popular frameworks out there for working with Deep Learning and ML models, each with their pros and cons for practical usability for product development and/or research. Once you decide what to use and train a model, now you need to figure out how to deploy it onto your platform and architecture of choice. Cloud? Windows? Linux? IOT? Performance sensitive? How about GPU acceleration? With a landscape of 1,000,001 different combinations for deploying a trained model from some chosen framework into a performant production environment for prediction, we can benefit from some standardization.
See more at https://www.microsoft.com/en-us/research/video/onnx-and-onnx-runtime/
Видео ONNX and ONNX Runtime канала Microsoft Research
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Everything You Want to Know About ONNX](https://i.ytimg.com/vi/cK5AyawZSUI/default.jpg)
![Chris Lattner: Compilers, LLVM, Swift, TPU, and ML Accelerators | Lex Fridman Podcast #21](https://i.ytimg.com/vi/yCd3CzGSte8/default.jpg)
![Train with Azure ML and deploy everywhere with ONNX Runtime](https://i.ytimg.com/vi/JpfZxRsLgWg/default.jpg)
![Introduction to Neo4j and Graph Databases](https://i.ytimg.com/vi/oRtVdXvtD3o/default.jpg)
![Thinking, Fast and Slow](https://i.ytimg.com/vi/C-4MM8sd3BE/default.jpg)
![Neural Network Pruning for Compression & Understanding | Facebook AI Research | Dr. Michela Paganini](https://i.ytimg.com/vi/f86hkOGoX54/default.jpg)
![What’s TinyML good for](https://i.ytimg.com/vi/Wuq2aP5O5Z0/default.jpg)
![PyTorch ONNX Export Support - Lara Haidar, Microsoft](https://i.ytimg.com/vi/IDc3SzRbkxM/default.jpg)
![A Brief Introduction to LLVM](https://i.ytimg.com/vi/a5-WaD8VV38/default.jpg)
![Understanding Artificial Intelligence and Its Future | Neil Nie | TEDxDeerfield](https://i.ytimg.com/vi/SN2BZswEWUA/default.jpg)
![Explainable AI for Science and Medicine](https://i.ytimg.com/vi/B-c8tIgchu0/default.jpg)
![CS480/680 Lecture 19: Attention and Transformer Networks](https://i.ytimg.com/vi/OyFJWRnt_AY/default.jpg)
![TorchScript and PyTorch JIT | Deep Dive](https://i.ytimg.com/vi/2awmrMRf0dA/default.jpg)
![[CppDay20] Interoperable AI: ONNX & ONNXRuntime in C++ (M. Arena, M.Verasani)](https://i.ytimg.com/vi/exsgNLf-MyY/default.jpg)
![Will Smith ON: Owning Your Truth and Unlocking the Power of Manifestation](https://i.ytimg.com/vi/kDYMizH73cc/default.jpg)
![Generative Adversarial Networks (GANs) - Computerphile](https://i.ytimg.com/vi/Sw9r8CL98N0/default.jpg)
![Tips and Advice Every New Real Estate Agent Needs to Know | #TomFerryShow](https://i.ytimg.com/vi/4b013QoA4so/default.jpg)
![JDK, JRE, JVM: What Are They and What Are Their Differences?](https://i.ytimg.com/vi/BXFHuaQNnLo/default.jpg)
![Dr. Jon Krohn - Deep Learning Battle: TensorFlow 2 vs PyTorch](https://i.ytimg.com/vi/Be5QwA-yDJE/default.jpg)
![ONNX: Past, Present, and Future - Jim Spohrer, IBM & Prasanth Pulavarthi, Microsoft](https://i.ytimg.com/vi/lBrIOLhgwbU/default.jpg)