Spatial Algorithms at Scale with spatialpandas |SciPy 2020| Pevey, Lewis, and Pothina
How do you analyze 1 trillion rows of geospatial point data? What if you have terabytes of astronomy data? We recently faced both of these problems. We solved them by using spatialpandas, dask and terraform-jupyter to efficiently build and execute spatial algorithms at scale. Spatialpandas is a new library that provides Pandas and Dask extensions for vectorized spatial and geometric operations. Dask allowed us to scale the algorithms and terraform-jupyter gave us a cheap cloud autoscaling compute environment. In this talk we will demonstrate how you can do the same.
*****************
https://twitter.com/enthought
https://www.facebook.com/Enthought/
https://www.linkedin.com/company/enthought
Видео Spatial Algorithms at Scale with spatialpandas |SciPy 2020| Pevey, Lewis, and Pothina канала Enthought
*****************
https://twitter.com/enthought
https://www.facebook.com/Enthought/
https://www.linkedin.com/company/enthought
Видео Spatial Algorithms at Scale with spatialpandas |SciPy 2020| Pevey, Lewis, and Pothina канала Enthought
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![Dask in 15 Minutes | Machine Learning & Data Science Open-source Spotlight #5](https://i.ytimg.com/vi/Alwgx_1qsj4/default.jpg)
![Geomstats: A Python Package for Riemannian Geometry in Machine Learning |SciPy 2020| Miolane](https://i.ytimg.com/vi/Ju-Wsd84uG0/default.jpg)
![What is Spatial Data Science?](https://i.ytimg.com/vi/osAbJeTho5w/default.jpg)
![](https://i.ytimg.com/vi/DO_nId_szEo/default.jpg)
![[Web Dev] Large-scale Geospatial Visualization with kepler.gl - Shan He](https://i.ytimg.com/vi/y-SA6bOv4Eo/default.jpg)
![Modern Time Series Analysis | SciPy 2019 Tutorial | Aileen Nielsen](https://i.ytimg.com/vi/v5ijNXvlC5A/default.jpg)
![37: R Trees, SQL for Spatial Data, BigQuery Geo Viz Demo](https://i.ytimg.com/vi/S7E-GhQLNnM/default.jpg)
![Legate Numpy: Accelerated and Distributed Array Computing |SciPy 2020| Michael Bauer](https://i.ytimg.com/vi/Jxxs_moibog/default.jpg)
![Geospatial Options in Apache Spark](https://i.ytimg.com/vi/bUWGbW3guy0/default.jpg)
![Dask dataframe on a terabyte of artificial data](https://i.ytimg.com/vi/nH_AQo8WdKw/default.jpg)
![Aaron Richter- Parallel Processing in Python| PyData Global 2020](https://i.ytimg.com/vi/eJyjB3cNIB0/default.jpg)
![Perfect spatial hashing (SIGGRAPH 2006)](https://i.ytimg.com/vi/kXEUbBSOX1c/default.jpg)
![Hyperopt: A Python library for optimizing machine learning algorithms; SciPy 2013](https://i.ytimg.com/vi/Mp1xnPfE4PY/default.jpg)
![Detecting Plastics in Coastal Waters with Satellite Data and Machine Learning |SciPy 2020| Lynn](https://i.ytimg.com/vi/ylT4J6wCctQ/default.jpg)
![Time Series Analysis with Python Intermediate | SciPy 2016 Tutorial | Aileen Nielsen](https://i.ytimg.com/vi/JNfxr4BQrLk/default.jpg)
![Python SciPy Tutorial | Solving Numerical and Scientific Problems using SciPy | Edureka](https://i.ytimg.com/vi/k8s-R3csOt0/default.jpg)
![Introduction to Geospatial Data Analysis with Python | SciPy 2018 Tutorial | Serge Rey](https://i.ytimg.com/vi/kJXUUO5M4ok/default.jpg)
![Intro to Numerical Computing with NumPy (Beginner) | SciPy 2018 Tutorial | Alex Chabot-Leclerc](https://i.ytimg.com/vi/V0D2mhVt7NE/default.jpg)
![Geospatial Deep Learning with ArcGIS](https://i.ytimg.com/vi/adrqRm4q5Ic/default.jpg)
![Geospatial triangular interpolation with Python, Scipy, Geopandas and Rasterio - Tutorial](https://i.ytimg.com/vi/wDOXOLrdLwk/default.jpg)