{"id":10416,"date":"2021-04-21T14:53:40","date_gmt":"2021-04-21T19:53:40","guid":{"rendered":"https:\/\/threecloud.wpengine.com\/post\/serverless-pools-in-synapse-analytics-workspace\/"},"modified":"2022-11-30T09:23:52","modified_gmt":"2022-11-30T15:23:52","slug":"serverless-pools-in-synapse-analytics-workspace","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/serverless-pools-in-synapse-analytics-workspace\/","title":{"rendered":"Serverless Pools in Synapse Analytics Workspace"},"content":{"rendered":"<p>Hopefully, you\u2019ve already heard about Azure Synapse. One of the newest Azure offerings, Synapse is a limitless analytics service that brings together, data warehousing, enterprise data warehousing, and big data analytics. I\u2019d like to tell you about the \u201claunchpad\u201d for all things Synapse \u2013 Synapse workspaces.<\/p>\n<p>With Synapse workspaces you can do many things including development, ETL, ELT, DevOps, Azure ML, and Power BI. When you create a new workspace, you automatically get a serverless pool.<\/p>\n<ul>\n<li>When you go into your workspace, you\u2019ll see Activity Hubs in Synapse Studio. These hubs organize the tasks needed for building analytics solutions.<\/li>\n<li>Synapse Studio is divided into Activity hubs; there are currently 6 hubs:\n<ul>\n<li>Overview and data \u2013 where we can explore all our structured\/unstructured data<\/li>\n<li>Develop \u2013 the development hub where you can use workbooks, SQL, etc.<\/li>\n<li>Orchestrate, monitor, and manage \u2013 these look like Azure Data Factory, they have the same look &amp; feel and do the same jobs.<\/li>\n<\/ul>\n<\/li>\n<li>Pools are comparable to databases in Synapse Analytics. There are 3 kinds of pools; serverless, dedicated, and Spark.<\/li>\n<li>Each workspace has a serverless pool by default.\n<ul>\n<li>In my serverless pool cheat sheet (To see this, please watch my video included), you\u2019ll see we have Spark, Cosmos DB, and Azure Data Lake Store as the 3 data sources you can use.<\/li>\n<li>The input types are Parquet, CSV, and JSON. Parquet is the better way to do things as it\u2019s compressed, so it only has to read a large piece of the data in a compressed format into memory. In other words, it doesn\u2019t have to go back to the well as often.<\/li>\n<li>Also, think about portioning your data in some logical way when you begin working with this. This way, if your data doesn\u2019t belong to a certain partition, it won\u2019t go looking for it somewhere it\u2019s not.<\/li>\n<li>Also, think about different landing zones for different data (refer to the flow chart on my cheat sheet).<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>In my video, I demo how to use a Synapse Analytics workspace so be sure to check that out. I\u2019ll walk you through how a workspace, as well as how serverless, works.<\/p>\n<p>My advice is to go in the Azure portal and give Azure Synapse Analytics workspace a try. Play around with it and see what you can do.<\/p>\n<p>Quickstart in Microsoft docs: <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/synapse-analytics\/quickstart-create-workspace\">https:\/\/docs.microsoft.com\/en-us\/azure\/synapse-analytics\/quickstart-create-workspace<\/a><\/p>\n<p>&nbsp;<\/p>\n<p><iframe loading=\"lazy\" title=\"YouTube video player\" src=\"https:\/\/www.youtube.com\/embed\/3r4QKAXT1zY\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><br \/>\nIf you have questions about Azure Synapse Analytics, either how to use it or how to implement it in your organization, reach out to us. Our expert team and solution offerings can help your business with any Azure product or service, including Managed Services offerings. Contact us at 888-8AZURE or\u00a0 <a href=\"mailto:sales@3cloudsolutions.com\">sales@3cloudsolutions.com<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hopefully, you\u2019ve already heard about Azure Synapse. One of the newest Azure offerings, Synapse is&mldr;<\/p>\n","protected":false},"author":34,"featured_media":10720,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[],"class_list":["post-10416","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10416","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/34"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=10416"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/10416\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/10720"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=10416"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=10416"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=10416"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}