Run Spark Jobs On Amazon Athena [FULL TUTORIAL IN 12MINS]
Have you ever been in a situation where you want to run spark code to analyse data, but don’t want to manage the underlying resources? Then using Amazon Athena’s Spark engine could be the solution for you. Amazon Athena allows you to submit spark code via fully manned spark engine in the form of a notebook. This allows you to carryout data analytics and exploration using Apache Spark without the need to plan for, configure, or manage resources. Apache Spark on Amazon Athena is serverless and provides automatic, on-demand scaling that delivers instant-on compute to meet changing data volumes and processing requirements. In this tutorial I will show you how to set up Amazon Athena to run Spark jobs and using the resources I’ve provided for free on github.
LINK TO GITHUB TUTORIAL RESOURCES:
💾 Code Repo: https://github.com/johnny-chivers/spark-athena
SUPPORT THE CHANNEL:
☕ Buy Me A Coffee: https://www.buymeacoffee.com/johnnychivers
🖥️ My VPN: https://go.nordvpn.net/aff_c?offer_id=612&aff_id=74288&url_id=14830
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 - Intro
01:01 - Setup Work
05:48 - Create An Athena Workgroup
06:47 - Create A Notebook
08:08 - Run Spark Code From Github
10:40 - Clean Up - Delete Resources
11:53 - Outro
OTHER USEFUL LINKS:
ℹ️ My Website: https://johnnychivers.co.uk
🔗 Linkedin: https://www.linkedin.com/in/johnny-chivers/
💻 Limitations: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software
Enjoy 🤘
Видео Run Spark Jobs On Amazon Athena [FULL TUTORIAL IN 12MINS] канала Johnny Chivers
LINK TO GITHUB TUTORIAL RESOURCES:
💾 Code Repo: https://github.com/johnny-chivers/spark-athena
SUPPORT THE CHANNEL:
☕ Buy Me A Coffee: https://www.buymeacoffee.com/johnnychivers
🖥️ My VPN: https://go.nordvpn.net/aff_c?offer_id=612&aff_id=74288&url_id=14830
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
00:00 - Intro
01:01 - Setup Work
05:48 - Create An Athena Workgroup
06:47 - Create A Notebook
08:08 - Run Spark Code From Github
10:40 - Clean Up - Delete Resources
11:53 - Outro
OTHER USEFUL LINKS:
ℹ️ My Website: https://johnnychivers.co.uk
🔗 Linkedin: https://www.linkedin.com/in/johnny-chivers/
💻 Limitations: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html
😎 About me
I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software
Enjoy 🤘
Видео Run Spark Jobs On Amazon Athena [FULL TUTORIAL IN 12MINS] канала Johnny Chivers
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Beginners Guide To AWS S3AWS Sign Up and Sign InAWS Glue Studio - Lets Get Hands On!AWS Data Lakes 101 | Lesson 4: Real Time Data Lake Ingest Using Kinesis FirehoseAWS Certified Data Engineer - Associate (DEA-C01) [Full Course In 285min]#1 My Youtube Journey: Channel and AWS Goals For 2021#3 My Youtube Journey: Update Channel and AWS Goals For 2021Create A Free GCP Account to Claim $300 of Credit and Spin Up A Linux Compute InstanceAWS DynamoDB Console BasicsAWS Lambda Basics ConsoleWhat Do Cloud Data Engineers Do In AWS?AWS Data Lakes 101 | Lesson 3: Using Athena To Query Data In the Data LakeAWS DynamoDB 101 | Lesson 3: DynamoDB TransactionsBeginners Guide To AWS SageMaker - Create your first ML Model#2 My Youtube Journey: Update Channel and AWS Goals For 2021AWS Global Infrastructure | Regions | AZs | Edge LocationsCreate A GCP Cloud Function Using The Cosole#4 My Youtube Journey: The QuestionBank Reveal, Up Coming Videos and 2021 Subscriber Count Progress.Using AWS Aurora For Full Text Search - Complete TutorialCreate An Azure Storage Account and Container