Deciding the right size for executor | Spark in Production | Course on Apache Spark Core | Lesson 23

The first decision to make while running Spark Application in production is about the number and size of executors. This video uncovers the things to keep in mind to choose the optimal value for these configurations.

Source code: https://drive.google.com/drive/folders/1beOhmQmubb2JJ33qF8oT2L0hQ_6-OiUr?usp=sharing
Resources: https://drive.google.com/drive/folders/1pS0lBWDmQHxURGCMI0H-p2OtpVdDsHRu?usp=sharing
Data files: https://drive.google.com/drive/folders/1yCNpxbFHyH-AEyVgIQ3gSE_Y-LBZ1DsZ?usp=sharing

Видео Deciding the right size for executor | Spark in Production | Course on Apache Spark Core | Lesson 23 канала Amit Ranjan