{"id":15670,"date":"2021-08-13T17:30:00","date_gmt":"2021-08-14T00:30:00","guid":{"rendered":"https:\/\/devwww.3cloudsolutions.com\/post\/azure-purview-series-part-2-data-catalog-3\/"},"modified":"2023-08-15T14:58:04","modified_gmt":"2023-08-15T21:58:04","slug":"azure-purview-series-part-2-data-catalog","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/azure-purview-series-part-2-data-catalog\/","title":{"rendered":"Azure Purview Series \u2013 Part 2: Data Catalog"},"content":{"rendered":"<p>The <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/how-to-browse-catalog\" target=\"_blank\" rel=\"noopener\">Data Catalog portion of Purview<\/a> is where most people will spend their time. It provides the information about your organizations data assets in a searchable format. Depending on which level of Data Catalog you choose; you can also access a business glossary, lineage visualization, catalog insights, and sensitive data identification insights. This article will focus on the three different levels available within Data Catalog and offers scenarios demonstrating when you would use each offering.<\/p>\n<p><img decoding=\"async\" style=\"width: 1000px;\" src=\"https:\/\/3cloudsolutions.com\/wp-content\/uploads\/2022\/12\/Blog_Purview-Data-Catalog-1.png\" alt=\"Blog_Purview Data Catalog\" width=\"1000\" \/><\/p>\n<p>The three levels of Data Catalog features that are available are: Free, C1, and D0. Each level comes with a different set of features that builds on the previous feature level. For example, C1 includes everything from the Free level, and D0 includes everything from C1 level.<\/p>\n<div style=\"overflow-x: auto; max-width: 100%; width: 100%; margin-left: auto; margin-right: auto;\" data-hs-responsive-table=\"true\">\n<table style=\"width: 100%; border-collapse: collapse; table-layout: fixed; border: 1px solid #99acc2; height: 148.1px;\">\n<tbody>\n<tr style=\"height: 36.0333px;\">\n<td style=\"width: 10.8098%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\"><strong>Level<\/strong><\/td>\n<td style=\"width: 61.5172%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\"><strong>Feature<\/strong><\/td>\n<td style=\"width: 27.6729%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\"><strong>Cost<\/strong><\/td>\n<\/tr>\n<tr style=\"height: 36.0333px;\">\n<td style=\"width: 10.8098%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\">Free<\/td>\n<td style=\"width: 61.5172%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\">Search and browse data assets<\/td>\n<td style=\"width: 27.6729%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\">Included with Data Map<\/td>\n<\/tr>\n<tr style=\"height: 39px;\">\n<td style=\"width: 10.8098%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 39px;\">C1<\/td>\n<td style=\"width: 61.5172%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 39px;\">Business glossary, lineage visualization, and catalog insights<\/td>\n<td style=\"width: 27.6729%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 39px;\">Free in Preview<\/td>\n<\/tr>\n<tr style=\"height: 36.0333px;\">\n<td style=\"width: 10.8098%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\">D0<\/td>\n<td style=\"width: 61.5172%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\">Sensitive data identification insights<\/td>\n<td style=\"width: 27.6729%; padding-top: 4px; padding-right: 4px; padding-bottom: 4px; height: 36px;\">Free in Preview<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<p>&nbsp;<\/p>\n<h2><span style=\"color: #007cba; font-size: 30px;\"><span style=\"font-size: 45px;\">Free<\/span><br \/>\n<\/span><\/h2>\n<p>The Free level of Data Catalog comes with search and browse capabilities within your data asset library. This enables you to search for any of the data assets that have been appropriately scanned and registered. The <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/how-to-search-catalog\" target=\"_blank\" rel=\"noopener\">search functionality within Purview<\/a><\/span> is extremely quick and comprehensive:<\/p>\n<ul>\n<li>Your data assets are indexed not only by name, but by all the metadata associated with them, all the way down to the column level (if available).<\/li>\n<li>You can use keywords to search, filter search results, and see previous search keywords. The search also provides live suggestions based on what you are typing (think autocomplete).<\/li>\n<\/ul>\n<h2 style=\"font-size: 45px;\"><span style=\"color: #007cba;\">C1<\/span><\/h2>\n<p>If you need more features than just search capabilities, then you can move up a level to C1. With C1, you gain access to a business glossary, data lineage visualization, and catalog insights.<\/p>\n<p><strong><span style=\"color: #000000;\">Business Glossary<br \/>\n<\/span><\/strong>The Business Glossary provides vocabulary definitions for business users. This can come in handy when you use terms differently within your organization. The glossary allows you to define terms and then map them to data assets. This way, everyone has the same understanding of the terms that are being used, and confusion is minimized. Purview supports the following out-of-the-box attributes for any glossary term:<\/p>\n<ul>\n<li>Name<\/li>\n<li>Definition<\/li>\n<li>Data Stewards<\/li>\n<li>Data Experts<\/li>\n<li>Acronym<\/li>\n<li>Synonyms<\/li>\n<li>Related Terms<\/li>\n<\/ul>\n<p>You can also <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/tutorial-import-create-glossary-terms\" target=\"_blank\" rel=\"noopener\">add your own custom attributes<\/a> to complement and enrich your glossary terms.<br \/>\n<span style=\"font-weight: normal;\"><br \/>\n<\/span><\/p>\n<p><span style=\"color: #000000;\"><strong>Data Lineage Visualization<\/strong><br \/>\n<\/span>Data lineage is import for so many reasons, including impact analysis, troubleshooting incorrect report results, and root cause analysis. But sometimes it\u2019s hard to see how all the pieces fit together without an end-to-end picture. This is where lineage visualization comes in. Purview takes all those parts and pieces and <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/concept-data-lineage\" target=\"_blank\" rel=\"noopener\">creates a visual<\/a> to allow users to better, and more quickly, understand the data lineage from raw data staged in different platforms, to the transformations performed in your ETL\/ELT tools, to data visualizations in your reports. Purview is able to do this by capturing all the metadata about your data sources and transformation tools at the highest available degree of granularity.<\/p>\n<p><strong>Catalog Insights<\/strong><br \/>\nWe all know a picture is worth a thousand words, so Microsoft included some great visualizations to help enhance the Data Catalog to provide a \u201csingle pane of glass\u201d view of your data estate. Purview does this through several different Catalog Insights, including:<\/p>\n<p>Asset Insights give you better understanding of what types of assets you have and how they are distributed across your data estate. You can see how many you have, their distribution by source type, size, and classification.<\/p>\n<ul>\n<li>Scan Insights provide administrators with the tools to understand the overall health of the scans that are performed.<\/li>\n<li>Glossary Insights provide business users valuable information about what areas are being assigned terms and what areas may need more attention.<\/li>\n<li>Classification Insights show you where your classified data lives, enabling security administrators to do their jobs more effectively and efficiently.<\/li>\n<li>File Extension Insights show you how many different file extensions are found during scans. This can be extremely helpful in identifying \u201cdark data sources\u201d that are not under IT control but are mission critical.<\/li>\n<\/ul>\n<h2><span style=\"color: #007cba; font-size: 30px;\"><br \/>\n<span style=\"font-size: 45px;\">D0<\/span><\/span><\/h2>\n<p>Data Sensitivity is a key concern when talking about data governance. Microsoft already has <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/docs.microsoft.com\/en-us\/microsoft-365\/compliance\/sensitivity-labels?view=o365-worldwide\" target=\"_blank\" rel=\"noopener\">Sensitivity Labels in Microsoft 365<\/a><\/span>, and those same sensitivity labels can be easily extended into Purview when <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/techcommunity.microsoft.com\/t5\/security-compliance-and-identity\/microsoft-information-protection-and-microsoft-azure-purview\/ba-p\/1957481\" target=\"_blank\" rel=\"noopener\">Information Protection for Azure Purview <\/a><\/span>is turned on in the Microsoft 365 compliance center. Once enabled, you can define what is sensitive in your organization and apply those labels to your data assets.<\/p>\n<h2><span style=\"color: #007cba; font-size: 45px;\">Availability<\/span><\/h2>\n<p>All these features can be accessed via the <a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/purview\/use-purview-studio\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #007cba;\">Azure Purview Studio<\/span><\/a> in any of the leading web browsers:<\/p>\n<ul>\n<li>Microsoft Edge<\/li>\n<li>Safari (latest version, Mac only)<\/li>\n<li>Chrome (latest version)<\/li>\n<li>Firefox (latest version)<\/li>\n<\/ul>\n<p>No additional applications need to be installed or maintained.<\/p>\n<p>Note: Azure Purview is now <span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"https:\/\/azure.microsoft.com\/en-us\/updates\/azure-purview-is-now-generally-available\/\" target=\"_blank\" rel=\"noopener\">Generally Available<\/a><\/span> as of 9\/28\/21.<\/p>\n<h2><span style=\"color: #007cba;\">In Summary<\/span><\/h2>\n<p>That\u2019s it for the Data Catalog installme<span style=\"font-size: 17px;\">nt of our Azure Purview series!<\/span> <span style=\"font-size: 17px;\">If you missed the other posts in this series, they can be found here:<br \/>\n<span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"\/blog\/azure-purview-serires-part-1-an-overview\" target=\"_blank\" rel=\"noopener\">Azure Purview Series &#8211; Part 1: An Overview<\/a><\/span><br \/>\n<span style=\"color: #007cba;\"><a style=\"color: #007cba;\" href=\"\/blog\/azure-purview-series-part-3-scanning-and-classification\" target=\"_blank\" rel=\"noopener\">Azure Purview Series &#8211; Part 3: Scanning &amp; Classification<\/a><br \/>\n<a style=\"color: #007cba;\" href=\"\/blog\/azure-purview-series-part-4-data-map\" rel=\"noopener\">Azure Purview Series &#8211; Part 4: Data Map<\/a><\/span><\/span><\/p>\n<p><span style=\"color: #000000;\"><span style=\"font-weight: bold;\"><br \/>\nMore Information<br \/>\n<\/span><\/span>3Cloud offers a variety of <a href=\"\/resources\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #007cba;\">resources<\/span><\/a>\u00a0to help you learn how you can leverage Modern Data Analytics.<\/p>\n<p>Please\u00a0<a href=\"\/get-started\/\" target=\"_blank\" rel=\"noopener\"><span style=\"color: #007cba;\">contact us<\/span><\/a> directly to see how we can help you explore your about modern data analytics options and accelerate your business value.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This series will take a deep dive into each of the building blocks that make up Azure Purview. This secondary article is meant to give a detailed view into the Data Catalog feature capabilities.<\/p>\n","protected":false},"author":21,"featured_media":12534,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[260],"tags":[307,304],"class_list":["post-15670","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-data-ai","tag-digital-transformation","tag-modern-data-platform","topics-blog"],"acf":[],"_links":{"self":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/15670","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/users\/21"}],"replies":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/comments?post=15670"}],"version-history":[{"count":0,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/posts\/15670\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media\/12534"}],"wp:attachment":[{"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/media?parent=15670"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/categories?post=15670"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/3cloudsolutions.com\/wp-json\/wp\/v2\/tags?post=15670"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}