AWS re:Invent 2019: [REPEAT 1] Deep dive into running Apache Spark on Amazon EMR (ANT308-R1)

Amazon EMR enables customers to run ETL, machine learning, real-time processing, data science, and low-latency SQL at petabyte scale. We focus this session on running Apache Spark on Amazon EMR. We introduce design patterns such as using Amazon S3 instead of HDFS, running long- and short-lived clusters, using notebooks, and performance-related enhancements. We discuss lowering cost with auto scaling and Spot Instances, and security with encryption and fine-grained access control with AWS Lake Formation.

Видео AWS re:Invent 2019: [REPEAT 1] Deep dive into running Apache Spark on Amazon EMR (ANT308-R1) канала AWS Events