{"id":10379,"date":"2018-03-06T00:00:00","date_gmt":"2018-03-06T06:00:00","guid":{"rendered":"https:\/\/threecloud.wpengine.com\/post\/most-important-components-of-azure-data-factory\/"},"modified":"2022-11-30T09:13:06","modified_gmt":"2022-11-30T15:13:06","slug":"most-important-components-of-azure-data-factory","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/most-important-components-of-azure-data-factory\/","title":{"rendered":"Most Important Components of Azure Data Factory"},"content":{"rendered":"<p><span style=\"background-color: transparent;\">Are you new to Azure and not know what Azure Data Factory is? Azure Data Factory is Microsoft\u2019s cloud version of an ETL or ELT tool that helps you get your data from one place to another and to transform it. Today, I\u2019d like to tell you about the high-level components within Azure Data Factory. These components pull together a data factory that helps your data flow from its source and have an ultimate end-product for consumption.<\/span><\/p>\n<\/p>\n<ul>\n<li><strong>Pipeline<\/strong> \u2013 A pipeline is a logical grouping of activities that performs a grouping of work. An example of an activity may be: you\u2019re copying on-premise data from one data source to the cloud (Azure Data Lake for instance), you then want to run it through an HDI Hadoop cluster for further processing and analysis and put it into a reporting area. The components will be contained inside the pipeline and would be chained together to create a sequence of events, depending upon your specific requirement.<\/li>\n<li><strong>Linked Service<\/strong> \u2013 This is very similar to the concept of a connection string in SQL Server, where you\u2019re saying what is the source and destination of your data.<\/li>\n<li><strong>Trigger<\/strong> \u2013 A trigger is a unit of processing that determines when a pipeline needs to be run. These can be scheduled or set off (triggered) by a different event.<\/li>\n<li><strong>Parameter<\/strong> \u2013 Essentially, the information you can store inside a pipeline that will pass in an argument when you need to fill in what that dataset or linked service is.<\/li>\n<li><strong>Control Flow<\/strong> \u2013 The control flow in a data factory is what\u2019s orchestrating how the pipeline is going to be sequenced. This includes activities you\u2019ll be performing with those pipelines, such as sequencing, branching and looping.<\/li>\n<\/ul>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/jsPNLb28Diw\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>Need further help? Our expert team and solution offerings can help your business with any Azure product or service, including Managed Services offerings. Contact us at 888-8AZURE or\u00a0 <a href=\"mailto:sales@3cloudsolutions.com\">sales@3cloudsolutions.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Are you new to Azure and not know what Azure Data Factory is? Azure Data&mldr;<\/p>\n","protected":false},"author":21,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[],"class_list":["post-10379","post","type-post","status-publish","format-standard","hentry","category-data-ai","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10379","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=10379"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10379\/revisions"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=10379"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=10379"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=10379"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}