Posts

Showing posts from March, 2020

Overview of Azure Data Factory Components

Image
My First Blog on Azure Azure Data Factory Components Pipelines Pipelines are the things you  execute  or  run  in Azure Data Factory, similar to packages in SQL Server Integration Services (SSIS). This is where you define your  workflow : what you want to do and in which order. For example, a pipeline can first copy data from an on-premises data center to Azure Data Lake Storage, and then transform the data from Azure Data Lake Storage into Azure Synapse Analytics ( previously Azure SQL Data Warehouse ). When you open a pipeline, you will see the pipeline authoring interface. On the left side, you will see a list of all the  activities  you can add to the pipeline. On the right side, you will see the design canvas with the properties panel underneath it. Activities Activities are the individual steps inside a pipeline, where each activity performs a single task. You can chain activities or run them in parallel. Activities can either control the flow inside a pipeli