Advancing Spark - Autoloader Resource Management

Happy 2021 everybody!

To kick us off with the new year, Simon is back delving into the depths of Autoloader. Whilst it's super easy to get started with Autoloader, you can quite quickly end up with orphaned EventGrid and Blob Queue resources. The new Cloud Resource Manager Scala API lets us control these resources, and we'll take you through it in today's video.

For our intro to Autoloader video, check out: https://youtu.be/kNG-5uRY4o8

For info around the Cloud Resource Management library, see: https://docs.microsoft.com/en-us/azure/databricks/spark/latest/structured-streaming/auto-loader#cloud-resource-management

If the thought of working with the delightful folks at Advancing Analytics, helping a range of global clients with their data engineering problems sounds appealing, check out our jobs board here: https://bit.ly/3bEQPRU

Видео Advancing Spark - Autoloader Resource Management канала Advancing Analytics