{"id":10217,"date":"2021-06-14T19:10:28","date_gmt":"2021-06-15T00:10:28","guid":{"rendered":"https:\/\/threecloud.wpengine.com\/post\/azure-data-modern-platform\/"},"modified":"2023-07-05T09:37:22","modified_gmt":"2023-07-05T16:37:22","slug":"azure-modern-data-platform","status":"publish","type":"post","link":"https:\/\/3cloudsolutions.com\/resources\/azure-modern-data-platform\/","title":{"rendered":"Modern Data Platform in Azure"},"content":{"rendered":"

Are you using your data as an asset to make predictions about your business? Some challenges that many businesses face are, large volumes of incoming data which they are unable to process and derive insights from, and data silos that make it difficult to find and share data as it\u2019s spread across multiple sources within the organization, as well as slow adoption of AI\/ML and real-time analytics. A Modern Data Platform<\/a> in Azure can help overcome these challenges.<\/p>\n

First, let\u2019s look at how we got here from the Microsoft business intelligence we\u2019ve had for over 20 years. In the past, most products were on premises, using SQL Server for our storage and ELT, master data, and data quality, and static reporting with SQL Server Reporting Services (SSRS). Security was in multiple places and change management was manual with much room for errors. Our data dictionary consisted of tables and field types, typically in Excel, and got outdated quickly and was hard to find as it was buried somewhere on the network.<\/p>\n

Now in the cloud, the transition is surely for the better.
\n\u2022 Storage \u2013 we have a variety of options including Azure SQL Database, Azure Synapse, blob storage and Cosmos DB.
\n\u2022 ETL \u2013 we now use Azure Data Factory or Databricks.
\n\u2022 Delivery \u2013 reports are in Power BI in the form of dashboards and SSRS reports are being converted to paginated reports.
\n\u2022 Master Data and Data Quality \u2013 we have a variety of 3rd party vendors we are partnered with.
\n\u2022 Security \u2013 we can leverage Azure Key Vault, Azure RBAC which consists of roles assigned to people and groups, and service principles for some of our automation.
\n\u2022 Change Management \u2013 Azure DevOps boards enable us to set up tasks in sprints of time to bite off a chunk of work to complete, then update the ticket when complete, test, and move to production.
\n\u2022 Source Code Repository \u2013 Azure DevOps Git.
\n\u2022 Data Dictionary, Data Lineage, and Data Sensitivity \u2013 we have the new Azure Purview and this fills in a lot of gaps we had in the past.<\/p>\n

If we look at the analytical maturity curve. (Please see the chart outlining this in my video.) We began with basic, static reports with limited Ad hoc and a single version of the truth and mainly created by IT. Now we\u2019ve moved to self-service reporting with large ad hoc and we\u2019re not dependent on IT for report creation. With Power BI we have empowered the user to build their own reports to investigate the data and gain insights to run the business, increase sales, streamline processes, and lower costs.
\nPredictive analytics is where we form models and allow machine learning to process the data and look for patterns over time. We can then move through the analytical maturity curve to real-time analytics and finally, real-time predictive modeling and mining which is event-based and allows for data discovery.<\/p>\n

As you can see, we\u2019ve come a long way over the years and a Modern Data Platform in Azure gives you a solid platform in which to run your business in the cloud and to better manage your data. Throw in data governance and Azure can handle most, if not all, of your data needs.<\/p>\n

 <\/p>\n