Learn Data engineering on Azure Data Factory real world projects in 1.5 hour. Start your career as Azure Data Engineer
In this course, you are going to learn how to build data pipelines with azure data factory for real-world projects from an industry expert with hands-on Labs.
What you’ll learn
- Data engineering with Azure data factory in real world projects to process large scale data.
- Data movement and migration using copy data activity from various sources.
- Data transformations and processing using Data flow activity.
- Creating linked services to connect with various data sources.
- Creating Integration runtime to run the ADF pipeline.
- Implementing different types of triggers in Azure Data Factory.
- Data monitoring and and alerts in Azure Data factory.
Course Content
- Introduction –> 1 lecture • 6min.
- Data engineering with ADF –> 1 lecture • 8min.
- Data Pipeline components in ADF –> 8 lectures • 49min.
- Control Flow and Data Flow activities –> 2 lectures • 21min.
- Triggers and Monitoring –> 5 lectures • 21min.
Requirements
In this course, you are going to learn how to build data pipelines with azure data factory for real-world projects from an industry expert with hands-on Labs.
Anyone can spend 1.5 hours time and become an Azure Data engineer!
This course will provide what is data factory, what are the various core components in azure data factory.
This course is useful for those aspiring to become azure data engineers.
Those who want to switch their career from soft engineering to data engineer
To expand their skills from AWS, GCP data engineer to AZURE data engineer
to gain an in-depth understanding of the latest trends in azure data engineering
This course covers the following topics.
Basic concepts of various components in ADF
What are ETL and ELT
What is Linked service,
Demo for creating Linked service
What is a data set,
Demo for creating Data set
What is Integration run time
What is an Azure Data lake
Demo for creating Azure data lake storage account
What is Cosmos DB
Demo for creating Cosmos DB
What is COPY activity
Demo for creating a data pipeline to move data from ADLS 2 to Cosmos DB using COPY Activity
What are control flow activities-
Get Metadata activity
Demo for getting Metadata activity
Filter activity
Demo for Filter activity
ForEach activity
Demo for ForEach activity
Demo for other Control flow activities
What is DATA FLOW Activity
Demo for removing Duplicate data using DATA FLOW Activity
The course is useful not only for freshers but also for experienced data engineers to gain more skills in azure data engineering