{"id":10212,"date":"2018-07-04T00:00:00","date_gmt":"2018-07-04T05:00:00","guid":{"rendered":"https:\/\/threecloud.wpengine.com\/post\/azure-data-factory-v2-visual-design-tools\/"},"modified":"2022-11-30T09:12:58","modified_gmt":"2022-11-30T15:12:58","slug":"azure-data-factory-v2-visual-design-tools","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/azure-data-factory-v2-visual-design-tools\/","title":{"rendered":"Azure Data Factory V2 Visual Design Tools"},"content":{"rendered":"<p>In this post I\u2019d like to tell you about Azure Data Factory Version 2 (ADF V2). If you\u2019re familiar with the first version of Data Factory, you know that designing anything meant that you had to write JSON. Getting started with ADF was hard for many as there were no visual tools. Data Factory is a powerful product for doing data integration and the cloud, but it could be a challenge to get it up and running.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/GNpdDuqu_FU\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>The good news is that, within Azure Data Factory V2, there are some great new visual design tools available. All the concepts available in V1 with your data sets, pipelines and activities are still there, but with new GUI driven design tools.<\/p>\n<p>As you start with defining your data sets, there are visual tools for doing this and connecting your data strings, all available through the Azure portal \u2013 no client tool installation needed. Once you\u2019ve defined your data set, you can define a pipeline and then add activities to that pipeline.<\/p>\n<p>This can now all be done with a drag and drop style interface. You can drag an activity onto your workspace and write the logic for conditions under which to fire the next action; all done through some powerful tools. Activities and features that are available in ADF V2 visual tools are:<\/p>\n<ul>\n<li>Invoke Data Lake analytics through a drag and drop and some configuration.<\/li>\n<li>Invoke Azure Machine Learning batch processing with hooks in to do this with visual tools.<\/li>\n<li>There are tools for HDInsight loads, such as running Hive or Pig jobs.<\/li>\n<li>They recently added a new activity for SSIS package executions, giving us the ability to execute SSIS packages from Azure Data Factory with visual tooling to do this.<\/li>\n<li>The ability to schedule pipelines through creating a trigger. If you\u2019ve ever set up SQL Server Agent schedules, the scheduling that\u2019s available with triggers will feel very familiar and you\u2019ll have flexibility for how often you want to run it, for how long and to retry logic and such.<\/li>\n<\/ul>\n<p>Need further help? Our expert team and solution offerings can help your business with any Azure product or service, including Managed Services offerings. Contact us at 888-8AZURE or\u00a0 <a href=\"mailto:sales@3cloudsolutions.com\">sales@3cloudsolutions.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In this post I\u2019d like to tell you about Azure Data Factory Version 2 (ADF&mldr;<\/p>\n","protected":false},"author":32,"featured_media":9526,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[],"class_list":["post-10212","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10212","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=10212"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10212\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/9526"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=10212"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=10212"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=10212"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}