{"id":10397,"date":"2018-09-28T00:00:00","date_gmt":"2018-09-28T05:00:00","guid":{"rendered":"https:\/\/threecloud.wpengine.com\/post\/performance-techniques-for-ssis-in-azure-data-factory\/"},"modified":"2022-11-30T09:12:03","modified_gmt":"2022-11-30T15:12:03","slug":"performance-techniques-for-ssis-in-azure-data-factory","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/performance-techniques-for-ssis-in-azure-data-factory\/","title":{"rendered":"Performance Techniques for SSIS in Azure Data Factory"},"content":{"rendered":"<p>If you\u2019re new to using integration services within Azure Data Factory, you may notice at times it takes a bit longer for some of the packages to run than they would have on prem. Today I\u2019ll share a couple simple and effective ways to help with the performance of those from experiences we\u2019ve had.<\/p>\n<\/p>\n<p>First, you are going to want to look at your performance tier of your SSIS catalog database. The database does two things where the service tier will impact it. One is when the package starts, it needs to read the definition of that package from the database, so the higher the tier of your database, the quicker it will be able to read that definition out and start the package.<\/p>\n<p>Secondly when it comes to the performance tier, the database manages all the logging. If you have a package with a lot of tasks and activities, it\u2019s going to log a lot of that execution activity to the SSIS catalog. If you have a higher tier catalog, the logging operation will be faster. Increase the performance tier of your catalog and that will help with the performance of your package.<\/p>\n<p>Looking at the performance tiers is typically the first thing we try as it\u2019s simple to change, as well as relatively inexpensive to increase the performance tier of that database.<\/p>\n<p>Another thing we do that we find to have even more impact is to increase the node size of your integration runtime. The node size is the size and power of the virtual machine(s) that are running your integration runtime. You do this by simply using the \u2018node size option\u2019 in your integration runtime (see screenshot below).<\/p>\n<p><img decoding=\"async\" style=\"width: 603px; display: block; margin-left: auto; margin-right: auto;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2021\/09\/SSIS_ADF_NodeSize-002-1.jpg\" alt=\"SSIS_ADF_NodeSize (002)\" width=\"603\" \/><\/p>\n<p>For example, if you were running on a D1 machine, you may want to try bumping up to a D2 or D4 or if you\u2019re running an A4, maybe bump that up to an A8. So, if you\u2019re running a single package and it\u2019s running slow, we generally find much more impact on performance by cranking up the power of that VM.<\/p>\n<p>These tips are for increasing the performance when running a single package. If we\u2019re talking about running many packages in parallel, there are other options and considerations, possibly to be covered in another post.<\/p>\n<p><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/AGEHUB_ctz4\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><br \/>\nI hope you found these quick pointers helpful.<\/p>\n<p>Need further help? Our expert team and solution offerings can help your business with any Azure product or service, including Managed Services offerings. Contact us at 888-8AZURE or\u00a0 <a href=\"mailto:sales@3cloudsolutions.com\">sales@3cloudsolutions.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>If you\u2019re new to using integration services within Azure Data Factory, you may notice at&mldr;<\/p>\n","protected":false},"author":32,"featured_media":9455,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[],"class_list":["post-10397","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10397","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=10397"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10397\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/9455"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=10397"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=10397"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=10397"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}