{"id":15664,"date":"2021-09-09T13:15:00","date_gmt":"2021-09-09T20:15:00","guid":{"rendered":"https:\/\/devwww.3cloudsolutions.com\/post\/azure-purview-series-part-4-data-map-3\/"},"modified":"2023-12-22T13:56:57","modified_gmt":"2023-12-22T21:56:57","slug":"azure-purview-series-part-4-data-map","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/azure-purview-series-part-4-data-map\/","title":{"rendered":"Azure Purview Series \u2013 Part 4: Data Map"},"content":{"rendered":"<p style=\"font-size: 17px;\">Welcome to the final installment of our Azure Purview Series, focusing on Purview Data Map. The Purview Data Map is the foundation for data discovery and serves as the jumping-off point for all things data source related. It is the cloud-native platform-as-a-service (PaaS) that collects the metadata about your data sources and runs the scans to keep your metadata up to date.<\/p>\n<p><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/10\/iStock-639637280.jpg\" alt=\"iStock-639637280\" width=\"1000\" \/><\/p>\n<p>You can use the Purview Portal to visually interact with the Data Map or you can use the <a href=\"https:\/\/atlas.apache.org\/#\/\" target=\"_blank\" rel=\"noopener\">Apache Atlas <span style=\"color: #007cba;\">Open<\/span> APIs<\/a> to programmatically interact with the Data Map. The following narrative is based on Purview Portal interaction.<\/p>\n<h2><span style=\"color: #007cba;\"><span style=\"color: #007cba;\">Available Views<\/span><\/span><\/h2>\n<p><span style=\"color: #000000;\"><span style=\"font-weight: bold;\">Map View<br \/>\n<\/span><\/span>In the Data Map, you can see all your data sources in one place, edit your data sources, schedule scans of your data sources, and organize your data sources visually into collections, as in the example below, presented in &#8220;Map view&#8221;:<\/p>\n<p><img decoding=\"async\" style=\"width: 750px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/10\/image-png-Aug-30-2021-04-30-04-33-PM.png\" width=\"750\" \/><\/p>\n<p><span style=\"color: #000000;\"><span style=\"font-weight: bold;\">Table View<\/span><\/span><br \/>\nIf you prefer a list view of your data sources, you can switch to \u201cTable view\u201d using the slider, and your Data Map will look like this:<\/p>\n<p><img decoding=\"async\" style=\"width: 750px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/10\/image-png-Aug-30-2021-04-30-59-32-PM.png\" width=\"750\" \/><\/p>\n<p>The advantage of the table view is that you can see additional information that you can\u2019t see on the map view, like the number of scans per data source and the date the data source was registered.<\/p>\n<h2 style=\"font-size: 45px;\"><span style=\"color: #007cba;\"><span style=\"color: #007cba;\">Data Source Scans<\/span><\/span><\/h2>\n<p>You can schedule scans of your data sources via either the map or table view. You can create scans that run once, or on a recurring basis to ensure the metadata about your data sources is always up to date.<\/p>\n<p><img decoding=\"async\" style=\"float: right; margin: 0px 45px 0px 0px; width: 250px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/10\/image-png-Aug-30-2021-04-31-38-20-PM.png\" width=\"250\" \/><\/p>\n<p>In the map view, the process to start a scan is pretty obvious:<br \/>\nyou simply click on the \u201cNew scan\u201d icon.<\/p>\n<p>However, in the table view, you need to hover over the row for the data source to get the &#8220;New scan&#8221; icon to appear.<\/p>\n<p><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/10\/Picture1-1.gif\" alt=\"Picture1-1\" width=\"1000\" \/><\/p>\n<h2><span style=\"color: #007cba; font-size: 30px;\"><span style=\"font-size: 48px;\"><span style=\"font-size: 45px;\">Data Source Collections<\/span><br \/>\n<\/span><\/span><\/h2>\n<p>You can also create new Collections in the Data Map. Think of Collections as imaginary borders that allow you to visually separate your data sources. You can <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/manage-data-sources#manage-collections\" target=\"_blank\" rel=\"noopener\">create your Collections<\/a><\/span> based on business area, environment, source type, region, or whatever criteria you choose. You can also create hierarchies within your Collections to make organizing your data sources even easier. You can assign data sources to a Collection at the time the data source is registered or anytime after the data source has been registered. You can do this using the visual interface of the <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/manage-data-sources#manage-collections\" target=\"_blank\" rel=\"noopener\">Purview Portal<\/a><\/span> or programmatically via the <a href=\"https:\/\/atlas.apache.org\/#\/\">Apache Atlas Open APIs<\/a>.<\/p>\n<h2><span style=\"color: #007cba; font-size: 30px;\"><span style=\"font-size: 48px;\">Relative Costs<br \/>\n<\/span><\/span><\/h2>\n<p>The final point about Data Map is cost. This is where most of your costs will come from when using Purview. Unlike some other Azure services, the Purview Data Map cannot be paused to help control costs when not in use. All Purview accounts are created with a default Data Map size of 1 capacity unit (CU), where 1 CU supports up to 25 data map operations per second and includes up to 2GB of storage for your meta data. The data map is elastic, which means it will automatically scale based on the load request, up to a maximum of 100 CUs. By default, the scaling is configured to not scale more than 10 times the steady state capacity in order to control costs, for more detailed information, see the Microsoft <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/concept-elastic-data-map\" target=\"_blank\" rel=\"noopener\">Elastic Data Map<\/a><\/span> article. During the Public Preview all CUs are free, however once Purview goes into General Availability (GA), you may be in for a surprise. See the current <a href=\"https:\/\/azure.microsoft.com\/en-us\/pricing\/details\/azure-purview\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #007cba;\">Azure Purview Pricing page<\/span><\/a> for more information.<\/p>\n<h2><span style=\"color: #007cba; font-size: 45px;\">In Summary<\/span><\/h2>\n<div>\n<p>Azure Purview has some great features that are long overdue in today\u2019s world, where Data Governance is not just a \u201cnice to have\u201d commodity, but a necessity. It combines traditional data cataloging features with a business glossary, visual lineage, data classification, and data sensitivity to provide data consumers with insights into the entire data estate. It also provides a mechanism to keep that metadata up-to-date with customizable scanning schedules and rules. Azure Purview is still in Public Preview, but once it goes General Availability (GA), it just might be data nirvana.<\/p>\n<p><span style=\"font-size: 17px;\">Note: Azure Purview is now <a href=\"https:\/\/azure.microsoft.com\/en-us\/updates\/azure-purview-is-now-generally-available\/\" target=\"_blank\" rel=\"noopener\">Generally Available<\/a> as of 9\/28\/21.<\/span><\/p>\n<\/div>\n<div><\/div>\n<p><span style=\"font-size: 17px;\">Well, that\u2019s it for our Azure Purview series. <\/span><span style=\"font-size: 17px;\">If you missed the first three posts in this series, they can be found here:<br \/>\n<span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"\/blog\/azure-purview-serires-part-1-an-overview\" target=\"_blank\" rel=\"noopener\">Azure Purview Series &#8211; Part 1: An Overview<\/a><\/span><br \/>\n<span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"\/blog\/azure-purview-series-part-2-data-catalog\" target=\"_blank\" rel=\"noopener\">Azure Purview Series &#8211; Part 2: Data Catalog<\/a><br \/>\n<\/span><\/span><a href=\"\/blog\/azure-purview-series-part-3-scanning-and-classification\" target=\"_blank\" rel=\"noopener\"><span style=\"font-size: 17px;\">Azure Purview Series &#8211; Part 3: Scanning &amp; Classification<\/span><\/a><\/p>\n<p><span style=\"color: #000000;\"><span style=\"font-weight: bold;\"><br \/>\nMore Information<br \/>\n<\/span><\/span>3cloud offers a variety of <a href=\"\/resources\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #007cba;\">resources<\/span><\/a> and <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"\/events\/\" target=\"_blank\" rel=\"noopener\">events<\/a><\/span> to help you learn how you can leverage Modern Data Analytics.<\/p>\n<p><a href=\"\/get-started\/\">C<span style=\"color: #007cba;\">ontact us<\/span><\/a> directly to see how we can help you explore your about modern data analytics options and accelerate your business value.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Welcome to the final installment of our Azure Purview Series, focusing on Purview Data Map. The Purview Data Map is the foundation for data discovery and serves as the jumping-off point for all things data source related. It is the cloud-native platform-as-a-service (PaaS) that collects the metadata about your data sources and runs the scans to keep your metadata up to date.<\/p>\n","protected":false},"author":21,"featured_media":12478,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[307,304],"class_list":["post-15664","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","tag-digital-transformation","tag-modern-data-platform","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/15664","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=15664"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/15664\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/12478"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=15664"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=15664"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=15664"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}