NLP Summit

Session on

Integrating Multimodal RAG and Human-in-the-Loop for Scalable Healthcare IT Applications: From Analytics to Dx Coding

Presenter

Rosh Singh, CTO, Cozeva

About the Event

In this work, we presented an integrated framework employing multimodal Retrieval-Augmented Generation (RAG) combined with human-in-the-loop oversight to address a spectrum of applications in healthcare IT. This framework was designed to harness both textual and visual data, facilitating comprehensive information extraction for enhanced decision-making across various domains, including analytics optimization, knowledge base synthesis, and diagnostic (Dx) coding accuracy.

 

Our approach leveraged the strengths of multimodal RAG to interpret complex datasets, incorporating visual and textual clues for a richer analysis. The inclusion of human-in-the-loop mechanisms further refined the system’s output, ensuring both scalability and precision in applications ranging from function calling in analytics platforms to the generation of dynamic, accurate knowledge repositories and the substantiation of Dx codes through precise ICD-10-CM mapping.

 

We detailed the architecture’s design principles, emphasizing its modular nature that allows for scalability across different healthcare IT needs. Through case studies, we demonstrated the architecture’s effectiveness in improving operational efficiencies, enhancing the reliability of clinical data interpretation, and supporting comprehensive knowledge synthesis. This work underscores the potential of multimodal RAG systems in transforming healthcare IT by providing a robust, scalable solution for integrating diverse data types into actionable insights.

View Event Recording

We follow GDPR Privacy Guidelines

We use cookies to enhance your browsing experience. By clicking “Accept and Continue”, you consent to our use of cookies.