BDA - Incremental, Iterative, and Interactive Computation using Differential Dataflow
This talk will cover a new computational framework, differential dataflow, that generalizes standard incremental dataflow for far greater re-use of previous results when collections change. Informally, differential dataflow distinguishes between the multiple reasons a collection might change, including both loop feedback and new input data, allowing a system to re-use the most appropriate results from previously performed work when an incremental update arrives. Our implementation of differential dataflow efficiently executes queries with multiple (possibly nested) loops, while simultaneously responding with low latency to incremental changes to the inputs. We show how differential dataflow enables orders of magnitude speedups for a variety of workloads on real data, and enables new analyses previously not possible in an interactive setting. This is joint work with Derek G. Murray, Rebecca Isaacs, and Michael Isard.
Видео BDA - Incremental, Iterative, and Interactive Computation using Differential Dataflow канала Microsoft Research
Видео BDA - Incremental, Iterative, and Interactive Computation using Differential Dataflow канала Microsoft Research
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
The Materialize Incremental View Maintenance Engine | MaterializeNaiad: A System for Incremental, Iterative and Interactive Parallel ComputationIt's About Time: An Introduction to Timely Dataflow | ClockworksDataflow: A Unified Model for Batch and Streaming Data Processing"Datafun: a functional query language" by Michael ArntzeniusGraphlab Workshop: Incremental. Iterative, and Interactive Data Analysis with NaiadMicrosoft Urban Futures Summer Workshop | Sensors and Data [Day 2]Frontiers in Machine Learning: Machine Learning Reliability and RobustnessDOMAIN MODELING WITH DATALOG by Norbert WojtowiczPyParis 2017 - Incremental Computation in Python by Phillip SchanelyAbstractions for Expressive, Efficient Parallel and Distributed ComputingFrontiers in Machine Learning: Saving Lives with Interpretable MLMicrosoft Urban Futures Summer Workshop | Data Driven Urban Transformation [Day 1]Can we make better software by using ML and AI techniques? With Chandra Madilla and Chetan BansalReactive Datalog for Datomic - Nikolas GöbelMicrosoft Urban Futures Summer Workshop | Policy and Social Impact [Day 3]Six graph algorithms in differential dataflow.Naiad: a timely dataflow systemNWDS Talk - Building modern dataflow systems - Frank McSherry