Azure Data Factory | Continuous Integration & Deployment with Azure DevOps
Building CI/CD process for Azure Data Factory is not quite straightforward. Furthermore, there are a few different methods of doing that. Before we begin doing that, we must set up GIT repository associated with ADF, understand what's the differences between save and publish, and why new branch appears.
The basic knowledge of ARM templates also would be beneficial.
During this video, I will explain one of the methods recommended by Microsoft.
00:00 Intro
01:05 Existing ADF review
02:17 Publishing ADF changes
03:14 Create Build Pipeline (master branch)
05:29 Create Release Pipeline
06:47 Task: Create RG & instance of ADF
11:36 Task: Deploy ARM Template
17:10 Connection to Storage Account
18:40 Prep files for demo
20:13 adf_publish branch
21:38 Change & re-deploy
24:23 Outro
The series about ADF on SQLPlayer blog: https://sqlplayer.net/category/big-data/azure-data-factory/
Azure CLI Reference: https://docs.microsoft.com/en-us/cli/azure/reference-index
Continuous integration and delivery in Azure Data Factory: https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment
PS. Don't worry about my security. I have already changed all the keys you could have seen in the video. :)
*** Hungry more? Let's connect. ***
- Blog: https://SQLPlayer.net
- Twitter: https://twitter.com/SQLPlayer | https://twitter.com/NowinskiK
- Facebook: https://www.facebook.com/SQLPlayer/
- Newsletter: https://mailchi.mp/ad5eeda6db00/sqlplayer-newsletter
#devops #adf #cicd #git #azuredatafactory #cli
Видео Azure Data Factory | Continuous Integration & Deployment with Azure DevOps канала Kamil Data Geek - Azure explained
The basic knowledge of ARM templates also would be beneficial.
During this video, I will explain one of the methods recommended by Microsoft.
00:00 Intro
01:05 Existing ADF review
02:17 Publishing ADF changes
03:14 Create Build Pipeline (master branch)
05:29 Create Release Pipeline
06:47 Task: Create RG & instance of ADF
11:36 Task: Deploy ARM Template
17:10 Connection to Storage Account
18:40 Prep files for demo
20:13 adf_publish branch
21:38 Change & re-deploy
24:23 Outro
The series about ADF on SQLPlayer blog: https://sqlplayer.net/category/big-data/azure-data-factory/
Azure CLI Reference: https://docs.microsoft.com/en-us/cli/azure/reference-index
Continuous integration and delivery in Azure Data Factory: https://docs.microsoft.com/en-us/azure/data-factory/continuous-integration-deployment
PS. Don't worry about my security. I have already changed all the keys you could have seen in the video. :)
*** Hungry more? Let's connect. ***
- Blog: https://SQLPlayer.net
- Twitter: https://twitter.com/SQLPlayer | https://twitter.com/NowinskiK
- Facebook: https://www.facebook.com/SQLPlayer/
- Newsletter: https://mailchi.mp/ad5eeda6db00/sqlplayer-newsletter
#devops #adf #cicd #git #azuredatafactory #cli
Видео Azure Data Factory | Continuous Integration & Deployment with Azure DevOps канала Kamil Data Geek - Azure explained
Показать
Комментарии отсутствуют
Информация о видео
14 марта 2020 г. 1:10:53
00:24:56
Другие видео канала
Michael Rys - father of U-SQL | Ask SQL Family 008Organize a Fabric Lakehouse using Medallion Architecture DesignUse Data Factory pipelines in Microsoft Fabric | Lab 04Get started with Data Activator in Microsoft Fabric | Lab 11Bob Ward - SQL Server during the last 30 years | Ask SQL Family 006Azure Data Factory with Databricks setup connectionJames Rowland-Jones: How failure crafts your better future | Ask SQL Family 013Itzik Ben-Gan - Window functions have no secrets to him | Ask SQL Family 014Get started with Real-Time Intelligence in Microsoft FabricGet started with Lakehouses in Microsoft Fabric | Lab 01Stephanie Locke Shares Her Data Science Journey and Insights | Ask SQL Family 003Greg Low | Ask SQL Family 002 | Where do 70% of SQL Server design problems come from?Sending an attachment via REST API using ADF/Synapse pipelineBrent Ozar | Ask SQL Family 001 | How did I become Microsoft Certified Master?Simon Whiteley - What is hiding behind the term “Modern Data Warehouse”? | Ask SQL Family 019Rob Sewell: What is his recipe for having a good speech? | Ask SQL Family 012MVP Summit 2024 - my video recapAutomate deployment of Azure services with ARM TemplateGrant Fritchey: Why "Scary DBA" and what's his favourite Redgate tool? | Ask SQL Family 011Kalen Delaney - story about @sqlqueen twitter handle | Ask SQL Family 015Chris Webb - future of SSAS On-Premise and a few more! | Ask SQL Family 016