Request a call
  • Hidden

Business Overview

600x405 (50)

Business Overview

Our client, a prominent healthcare performance improvement company, offers SaaS solutions for acute and ambulatory care providers and academic medical centers. Collaborating with diverse healthcare entities, the company offers services in analytics, contract management, operational oversight, and supply chain management to enhance the delivery of high-value care, aligning cost, quality, and market performance.

The client’s on-premise solutions merge supply and clinical data for healthcare providers and insurance companies. This data covers diagnoses, procedures, medications, and medical equipment. It enables executives to enhance patient outcomes and reduce operational costs.

Their existing solutions were hard to maintain and required huge investments of resources to support. The client turned to NIX as a trusted vendor renowned for our extensive expertise in cloud services. The goal was to transition their on-premise system to a more scalable and cost-efficient architecture, while also ensuring a seamless migration of data pipelines.

Scope

challenge icon

Migrate existing system from on-premise to more scalable and cost-efficient cloud architecture that will increase flexibility and reduce costs

challenge icon

Ensure a smooth migration of data pipelines to the cloud architecture maintaining existing business logic and functionality

challenge icon

Improve the clinical data validation process for better accuracy, integrity, and compliance

Solution

The NIX team migrated the existing solutions from an on-premise Hadoop ecosystem to an Azure and Databricks technology stack. We also designed multi-tenancy architecture that is easy to scale, can resist peak loads, and ensures Infrastructure as Code (IaC) availability, while taking into account potential technical and business risks.

The NIX team opted to switch from the SAS programming language to Python, as Python is not only easier to maintain on Azure but also provides better cost-efficiency. The adoption of a single language for data engineering also proves to be more efficient. We integrated Octopus Deploy with Azure DevOps to provide a fully-automated build and deployment pipeline, improving resource utilization and ultimately leading to cost savings.

The migration concerned two solutions:

The migration concerned two solutions:

  1. Financial reporting
    The web platform collects statistical data on hospitals and allows financial departments to generate performance reports. This solution provides comprehensive reporting capabilities such as customizing the reports, comparing indicators with competitors, and identifying areas for further development.
  2. Analytics for insurance calculations
    Web application for clinics that connects procedural supply and clinical data to help healthcare providers understand the drivers of supply costs, utilization and quality of care. Clinicians enter data every time a patient comes for a visit and then this data is transferred for validation, processing and transformation. This solution aids in identifying opportunities from a variety of service lines and procedures to create actionable insights. Consequently, this data enables accurate insurance calculations and optimizes costs.
600x405 (51)

Data Pipelines Orchestration and Migration

600x405 (52)

Data Pipelines Orchestration and Migration

We orchestrated the migration of the client’s pipelines, shifting them from on-premises servers to the Azure platform and ensuring a smooth data exchange between databases and storages. At present, our efforts are focused on the transformation of PySpark scripts into Azure Databricks, alongside the development of pipelines within Azure Data Factory to execute these scripts effectively.

For orchestrating ETL/ELT pipelines and data enrichment processing, we leveraged Azure Data Factory and Databricks. Databricks Delta Lake was used as a main data warehouse and contains all the historical, procedural, clinical quality enrichment data. Azure Databricks serves as core for data processing and migration of existing Pyspark jobs.

On the Azure side, we also implemented table comparison service for comparing input/output data in Azure and on-premise by certain filter criteria to ensure uniformity.

Data Validation

Data Validation

Leveraging Apache Spark, we established and refined the processing and validation of hospital data, including patient personal information such as diagnoses, age, gender, payments, procedures, and prescription treatments.

Our team of data engineers devised validation rules to rectify discrepancies and implemented sophisticated data quality monitoring capabilities for clinics. This prevents the system from processing data files containing significant disparities, thereby ensuring superior accuracy, data integrity, and regulatory compliance.

600x405 (53)

Outcome

600x405 (54)

Outcome

Through the adoption of a cloud-centric infrastructure and the enhancement of data pipelines, NIX enabled the client to offer healthcare and insurance providers cost-effective, secure, and data-driven solutions, resulting in improved patient outcomes and reduced operational expenses.

The solutions leverage raw clinical and supply data to deliver valuable insights through advanced data visualization capabilities, all the while upholding robust data processing, strong security, and data integrity.

 

Team:

6 Data Engineers

Tech Stack:

Python, Azure, Azure DevOps, Django, Pandas, PySpark, Spark, Hive, Azure Data Factory, Azure SQL Database, Azure Databricks

Relevant Success Stories

Contact Us

Latest Insights

How to Outsource Mobile App Development and Succeed

A proper approach for outsourcing mobile app development can bring years of expertise to your business and enhance performance.

13 Predictive Analytics in Healthcare Use Cases

Predictive analytics has a lot of potential to improve the healthcare industry. Multiple use cases prove that it can revamp patient care, making it more effective and timely.

Healthcare Data Warehouse: Architecture, Benefits, Implementation 

Would you like to learn about the benefits of a data warehouse in healthcare? Meet our comprehensive guide on healthcare DWHs.

Top Sprint Retrospective Examples and Benefits for Business

Sprints yield great results for development projects. How does one assess their success? Learn how to effectively run a sprint retro to build the best IT products.

DevOps Automation: Best Practices and Benefits

Are you considering DevOps automation for your company? Let’s find out whether you need it or not. Check its benefits, steps, and best practices.

Can MAUI Fully Replace Xamarin Forms? A Deep Dive into .NET MAUI

Release of .NET MAUI sparked conversations about the future of Xamarin. Today we will discuss what MAUI brings to the table and how it can benefit your project.

Outsourcing Software Testing: Best Practices and Benefits

Testing is a challenging process that determines the success of the product. Learn about software testing outsourcing, its pros and cons, and best practices.

Benefits and Examples of Robotic Process Automation in Healthcare

The healthcare sector is known for complex processes and difficult working conditions. Explore how RPA in healthcare can combat these obstacles.

User Research: Why Do You Need It? Goals and Requirements

Learn key objectives and steps of user research as one of the key steps of product development. Get insights and best practices from NIX.