Posted September 7, 20231 yr This blog has been co-authored by Samantha Brown, Pallavi Reddy and Ksheerja Batra Microsoft’s Health and Life Sciences customers use our enterprise-ready and secure health data platform to solve a multitude of real world problems in healthcare and digitally transform their organization. While working with large amounts of organizational data, customers often run into the need to make data across siloed systems more interoperable. Customers have been asking for an easier way to construct their own custom ETL (extract, transform, and load) pipelines to integrate all their data and ultimately unlock business insights through analytics. We knew that we needed to make this process easier for our customers, and we are proud to have now released several templates within the Azure Data Factory (ADF) template gallery. Azure Data Factory is a fully managed, serverless data integration service that comes with more than 90 built-in connectors. And yes, Data Factory is now in Microsoft Fabric, an all-in-one analytics solution for enterprises. Azure Health Data and AI Templates To allow customers to get started quickly with Azure Health Data Services and Azure AI services, we published several predefined and totally customizable templates in the ADF gallery. Today, when you search in the Azure Data Factory Gallery View, you will find several published templates, pictured below: The image above shows the template gallery of Azure Data Factory, with five Health Data Services and AI services for Health examples listed with the “Health” tag. Get Started with Convert Data One of our new templates allows you to transform HL7v2 data to Fast Healthcare Interoperability Resources (FHIR®) R4 and persist transformed results within an Azure Data Lake Storage (ADLS) Gen2 account. One of the most common scenarios that we hear about from customers is wanting to convert their source HL7v2 data into the FHIR R4 format, without having to create client apps to invoke the convert operation. We created a template that allows you to reduce your manual overhead and do just that! Search for HLv2 in the Template gallery, select the “Transform HL7V2 health data to FHIR R4 format and write to ADLS Gen2” tile and then click Continue. This image shows the "Transform HL7v2 to FHIR R4 and write to ADLS Gen 2" template in the Azure Data Factory Template Gallery. Once you select “Use this template", it will import a set of pipelines as shown below. Each of these are categorized under Extract, Load, Transform and Pipelines. This image shows Extract, Load and Transform pipelines that were imported from the selected template. You can now make any modifications to the pipelines to fit your scenario. If you do not intend to persist the result in a destination ADLS Gen2 storage account, for example, you can modify the pipeline to remove that step altogether. The purpose of this template is to help you get started, cut down on development time, and be able to customize it to your unique use case. We now have five different templates available for you to use in the Azure Data Factory Template Gallery. This will lessen the burden on customers when it comes to creating their own ETL pipeline from scratch, allow for seamless data integration, and ultimately will improve developer productivity through a more intuitive user interface. Learn More If you would like to learn more details about any of the following topics mentioned in this blog, please see official Azure documentation below: Azure Health Data Services Azure Data Factory Azure Data Factory Templates $Convert-data FHIR Operation Troubleshoot $convert-data - Azure Health Data Services | Microsoft Learn Transform HL7v2 to FHIR R4 FHIR® is the registered trademark of HL7 and is used with the permission of HL7 Continue reading...
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.