Notebooks as Functions with Papermill | Netflix
Get the slides: https://www.datacouncil.ai/talks/notebooks-as-functions-with-papermill
ABOUT THE TALK
Notebooks have traditionally been a tool for drafting code and avoiding repeated expensive computations while exploring solutions. The Machine Learning space has used these extensive as a place to prototype. However, with new tools like nteract's papermill library, this technology has been expanded to make a reusable and parameterizable template for execution.
We'll walk though what Jupyter notebooks are and how they are being programmatically used at Netflix. We’ve had large adoption of notebooks for specific use-cases and can show how this helps with our batch processing world. Specifically we'll explore how notebooks make a great reproducible log of execution and act as a sharable medium for useful integration patterns.
ABOUT THE SPEAKER
Matthew Seal is a senior software engineer at Netflix, where he works on scaling data platform solutions. Based in the Bay Area of California, Matthew attended Stanford University for undergraduate and graduate school. He stayed in the area, working at startups and spending a long stretch of time working at OpenGov.
ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.
FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai
Facebook: https://www.facebook.com/datacouncilai
Eventbrite: https://www.eventbrite.com/o/data-council-30357384520
Видео Notebooks as Functions with Papermill | Netflix канала Data Council
ABOUT THE TALK
Notebooks have traditionally been a tool for drafting code and avoiding repeated expensive computations while exploring solutions. The Machine Learning space has used these extensive as a place to prototype. However, with new tools like nteract's papermill library, this technology has been expanded to make a reusable and parameterizable template for execution.
We'll walk though what Jupyter notebooks are and how they are being programmatically used at Netflix. We’ve had large adoption of notebooks for specific use-cases and can show how this helps with our batch processing world. Specifically we'll explore how notebooks make a great reproducible log of execution and act as a sharable medium for useful integration patterns.
ABOUT THE SPEAKER
Matthew Seal is a senior software engineer at Netflix, where he works on scaling data platform solutions. Based in the Bay Area of California, Matthew attended Stanford University for undergraduate and graduate school. He stayed in the area, working at startups and spending a long stretch of time working at OpenGov.
ABOUT DATA COUNCIL:
Data Council (https://www.datacouncil.ai/) is a community and conference series that provides data professionals with the learning and networking opportunities they need to grow their careers. Make sure to subscribe to our channel for more videos, including DC_THURS, our series of live online interviews with leading data professionals from top open source projects and startups.
FOLLOW DATA COUNCIL:
Twitter: https://twitter.com/DataCouncilAI
LinkedIn: https://www.linkedin.com/company/datacouncil-ai
Facebook: https://www.facebook.com/datacouncilai
Eventbrite: https://www.eventbrite.com/o/data-council-30357384520
Видео Notebooks as Functions with Papermill | Netflix канала Data Council
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Matthew Seal - Programmatic Notebooks with papermill - PyCon 2019Using Markdown in JupyterCreating a Data Engineering Culture | Big Data InstituteKubernetes Operators ExplainedDKRZ Tech Talk: How to use Jupyter Notebooks via Jupyterhub on DKRZ's Mistral SupercomputerAnimation of Explosion at PCA's DeRidder, Louisiana, Pulp and Paper MillAirflow on Kubernetes: Dynamic Workflows Simplified - Daniel Imberman, Bloomberg & Barni SeetharamanAWS | How To Automate Jupyter Notebookscode.talks 2017 - Real-Time Databases Explained: Why Meteor, RethinkDB, Parse & Firebase Don't ScaleAWS re:Invent 2021 - Implementing MLOps practices with Amazon SageMaker, featuring VanguardAirflow in Practice Stop Worrying Start Loving DAGs - Sarah SchattschneiderProcessing Streaming Data with KSQL - Tim BerglundMachine Learning with Apache AirflowFunctional Data Engineering - A Set of Best Practices | LyftRecycled Paper Manufacturing ProcessMatthew Rocklin - Streaming Processing with DaskAuto Export Data into Excel from SQL using Python Pyodbc | Python SQL Automation |Task Scheduler #16Quick introduction to Jupyter NotebookHow Cardboard is Recycled