Business Overview

Our client is a SaaS company providing elderly care facilities with digital tools and automated software solutions. To integrate innovation, automate, and improve the efficiency of their products, they decided to test the idea of creating an AI-powered solution capable of analyzing feeds from cameras and images of care facilities. This solution should identify possible hazards, such as water spills, thereby preventing injurious incidents for senior patients. To develop a proof of concept for this idea, the client approached NIX for our deep expertise in AI and prompt engineering.

Solution

3

The PoC solution was planned to consist of two-step functionality: automated training and inference.

  • Training creates automated prompt engineering for a new set of images with labels, and after a few iterations, the optimized prompt is saved for future operational use.
  • Inference combines the input images, the classification task, and labels with the previously generated prompt to produce the final, accurate hazard identification output.

To execute this, our team strategically utilized the AWS architecture, where SageMaker orchestrated the model, with AWS Lambda serving as the event-driven compute layer and utilizing a suite of LLMs. For this solution, we selected the LLM approach for its superior simplicity and adaptability in differentiating image labels and classes, which was crucial for accurate hazard identification.

Our experts trained the LLM with four classes of sample images (clear vs. hazard-present) to teach the system, while utilizing Lambda and Bedrock for inference. In Bedrock, we obtained the output label classification for images and returned the results to Lambda.

5

Crucially, our rigorous validation process demonstrated high viability across various LLM configurations, confirming the technical feasibility of the solution. This result demonstrates the model’s high adaptability, as it can be easily retrained on diverse datasets—whether for fire detection or warehouse analytics—by simply providing a new image feed and an updated script to adjust labels and prompts.

As a result, the solution can be trained in various ways and provide businesses with a precise prediction model that detects unusual patterns, warns employees about potential identifiers, and prevents incidents before they occur.

6

Outcome

The client received a validated PoC that conclusively proved the feasibility of building a real-time, AI-based application for hazard identification. Even on this limited PoC scale, we developed a model that demonstrated exceptional precision, achieving 98% viability in accurately pinpointing potential safety threats.

This successful outcome immediately de-risked the client’s investment and provided a solid, data-backed foundation for advancing the solution to full product development. Our next steps with the client include preparing for further expansion of the PoC solution into a full-fledged AI-powered application.

2
Team:

Team:

Project Manager AI Engineer
Tech stack:

Tech stack:

Python AWS S3 AWS Bedrock LangChain Anthropic Claude Amazon Nova boto3 Lambda

REQUEST A CONSULTATION

Contact us   

Relevant Case Studies

View all case studies

AI-Driven Application for Mental Health Support in the US

Healthcare

Success Story AI-Driven Application for Mental Health Support in the US image

AI-powered System: Cybersecurity Report Generation and Risk Mitigation

Healthcare

Success Story AI-powered System: Cybersecurity Report Generation and Risk Mitigation image

NLP Chatbot for Accelerating Internal Operations

Healthcare

Success Story NLP Chatbot for Accelerating Internal Operations image

AI-powered Search Solution for a Healthcare Company

Healthcare

Success Story AI-powered Search Solution for a Healthcare Company image

Pharmaceutical Software Modernization and AI Implementation

Healthcare

Success Story Pharmaceutical Software Modernization and AI Implementation image

Starday Foods: Scaling to 100K Posts per Hour With AI

Food & Beverages

Success Story Starday Foods: Scaling to 100K Posts per Hour With AI image
01

Contact Us

Accessibility Adjustments
Adjust Background Colors
Adjust Text Colors