Azure Data Factory | Copy multiple tables in Bulk with Lookup & ForEach
With Azure Data Factory Lookup and ForEach activities you can perform dynamic copies of your data tables in bulk within a single pipeline.
In this episode I will show you how to perform bulk copies with ADF.
Source code for demos: https://github.com/MarczakIO/azure4everyone-samples/tree/master/azure-data-factory-lookup-activity
In this episode live demo of ADF lookup activity in SQL to Blob export scenario and how to control this using metadata table.
Next steps for you after watching the video
1. ADF bulk copy scenario
- https://docs.microsoft.com/en-us/azure/data-factory/tutorial-bulk-copy-portal?WT.mc_id=AZ-MVP-5003556
2. Lookup Activity docs
- https://docs.microsoft.com/en-us/azure/data-factory/control-flow-lookup-activity?WT.mc_id=AZ-MVP-5003556
3. ForEach Activity docs
- https://docs.microsoft.com/en-us/azure/data-factory/control-flow-for-each-activity?WT.mc_id=AZ-MVP-5003556
### Want to connect?
- Blog https://marczak.io/
- Twitter https://twitter.com/MarczakIO
- Facebook https://www.facebook.com/MarczakIO
- LinkedIn https://www.linkedin.com/in/adam-marczak/
- Site https://azure4everyone.com
Видео Azure Data Factory | Copy multiple tables in Bulk with Lookup & ForEach канала Adam Marczak - Azure for Everyone
In this episode I will show you how to perform bulk copies with ADF.
Source code for demos: https://github.com/MarczakIO/azure4everyone-samples/tree/master/azure-data-factory-lookup-activity
In this episode live demo of ADF lookup activity in SQL to Blob export scenario and how to control this using metadata table.
Next steps for you after watching the video
1. ADF bulk copy scenario
- https://docs.microsoft.com/en-us/azure/data-factory/tutorial-bulk-copy-portal?WT.mc_id=AZ-MVP-5003556
2. Lookup Activity docs
- https://docs.microsoft.com/en-us/azure/data-factory/control-flow-lookup-activity?WT.mc_id=AZ-MVP-5003556
3. ForEach Activity docs
- https://docs.microsoft.com/en-us/azure/data-factory/control-flow-for-each-activity?WT.mc_id=AZ-MVP-5003556
### Want to connect?
- Blog https://marczak.io/
- Twitter https://twitter.com/MarczakIO
- Facebook https://www.facebook.com/MarczakIO
- LinkedIn https://www.linkedin.com/in/adam-marczak/
- Site https://azure4everyone.com
Видео Azure Data Factory | Copy multiple tables in Bulk with Lookup & ForEach канала Adam Marczak - Azure for Everyone
Показать
Комментарии отсутствуют
Информация о видео
21 апреля 2020 г. 19:00:13
00:23:16
Другие видео канала
Azure Data Factory Custom Email Notifications TutorialAzure Data Factory Parametrization TutorialAzure Data Lake Storage (Gen 2) Tutorial | Best storage solution for big data analytics in AzureAzure Cosmos DB Tutorial | Globally distributed NoSQL databaseAzure data factory || Incremental Load or Delta load from SQL to File StorageAzure Key Vault Tutorial | Secure secrets, keys and certificates easilyAzure Data Factory Mapping Data Flows Tutorial | Build ETL visual way!How to Load Multiple CSV Files to Multiple Tables According to File Name in Azure Data FactoryARM Templates Tutorial | Infrastructure as Code (IaC) for Beginners | Azure Resource ManagerAzure Event Hub Tutorial | Big data message streaming serviceAzure Data Factory Self-hosted Integration Runtime Tutorial | Connect to private on-premises networkARM Templates Copy Loops | Create multiple instances of resources, properties and variablesAzure Analysis Services Tutorial | Scale Power BI reports into hundreds of GBsAZ-900 Episode 24 | Azure DDoS Protection | Distributed Denial of ServiceAzure SQL Database Tutorial | Relational databases in AzureAzure Databricks Tutorial | Data transformations at scaleManaged Identities with Azure AD (Active Directory) TutorialBuilding Dynamic Pipelines in Azure Data Factory v2AZ-900 Episode 34 | Core tenets of Security, Privacy, Compliance (Trust Center, DPA, OST, and more.)