Do more with less using Microsoft Purview Data Estate Insights

[Guest Sunetra]

As Microsoft’s mission is to put customers first and “do more with less”, Microsoft Purview has been constantly innovating, to help our customers “govern more with less total cost of ownership”. After announcing the general availability of Microsoft Purview’s Data Estate Insights App in July of 2022, the team has been laser-focused on improving total cost of ownership for deriving insights from the Data Map, through various levels of optimization. These performance improvements have provided customers with savings of up to 65%.

 

 

 

Here are some of the notable improvements that have led to better customer experience and lowest costs to customers.

 

 

 

Dynamic selection of optimal compute:

 

Through multiple performance calibrations across various Catalog sizes, we have benchmarked optimal compute-power that would translate to the best cost savings for our customers.

 

 

 

Based on heuristics of analytical data, such as data size and complexity of the annotations in the data estate, Data Estate Insights dynamically picks optimal compute capacity, to process complex aggregations, in the most optimal amount of time possible. This method has led to an overall cost savings of up to 65%, for our customers (see chart below). This enables Data Stewards and Chief Data Officer’s office to get fresher insights into governance without worrying about a huge bill!

 

 

 

 

 

 

In-memory caching:

 

Another notable cost saving has come from the in-memory caching for reports and dashboards that have altogether minimized the number of API calls needed to generate results in Data Estate Insights, thus resulting in better analytics response and lower cost to customers (see chart below).

 

 

 

 

 

 

Better querying techniques:

 

As Insights calculates new assets, deleted assets, and updated assets over time, the jobs are now modeled to look at incremental changes in a data asset property between snapshots of days, rather than full snapshot comparisons. This minimizes the amount of data being processed by jobs through incremental changes only.

 

 

 

Learn more about Microsoft Purview and try Data Estate Insights, which provides insights on top of your hybrid data estate.

 

Continue reading...