Real Time Processing and Dask

AnacondaCon 2018. Matthew Rocklin. Dask is a tool for parallel and distributed processing in Python often known for parallelizing subsets of libraries like NumPy, Pandas, and Scikit-Learn. However, Dask also includes a low-level real-time task scheduler capable of asynchronous computation. This talk describes how to leverage the internal engine of Dask to build responsive distributed systems that react to real-world events with computation in a resilient and scalable manner. We will start with a foundational futures API, and build on that to include async-await functionality and streaming dataframes.

Видео Real Time Processing and Dask канала Anaconda, Inc.