Showing posts from August, 2020

Overview of Azure Data Factory Components

Azure Data Factory Components On the left side of the  Author  page, you will see your  factory resources . In this example, we have already created one  pipeline , two  datasets , and one  data flow : Let’s go through each of these Azure Data Factory components and explain what they are and what they do. Pipelines Pipelines are the things you  execute  or  run  in Azure Data Factory, similar to packages in SQL Server Integration Services (SSIS). This is where you define your  workflow : what you want to do and in which order. For example, a pipeline can first copy data from an on-premises data center to Azure Data Lake Storage, and then transform the data from Azure Data Lake Storage into Azure Synapse Analytics ( previously Azure SQL Data Warehouse ). When you open a pipeline, you will see the pipeline authoring interface. On the left side, you will see a list of all the  activities  you can add to the pipeline. On the right side, you will see the design canvas with the properties pa