NVISO collaborates with Siemens Healthineers to apply Human Behaviour AI in medical imaging applications

Lausanne, Switzerland – June  16th, 2022 – – nViso SA (NVISO), the leading Human Behavioural Analytics AI company, is pleased to announce it has commenced a commercial pilot applying the NVISO Human Behavioural Analytics AI software solution to support Siemens Healthineers solutions in developing new intelligent applications. Initially the collaboration includes the deployment of real-time deep learning-based AI Apps for face detection, head pose recognition, facial recognition, and emotion recognition within a trial environment.  These AI Apps are specifically designed for resource constrained hardware requiring low-power and low-memory footprints deployed at the edge without requiring an internet connection.

“We at Siemens Healthineers are convinced that patient experience will become the key differentiator in the medical device industry by creating greater clinical and operational customer value.” said Carsten Thierfelder of Siemens Healthineers “In this context, next generation man-machine-communication based on AI technologies will help interpreting patient emotions at various touchpoints and thus avoid unpleasant moments throughout their journey. Our latest collaboration activities with NVISO are already showing promising results in this space”.

Within the healthcare sector there are a growing number of  use cases for AI technology in improving Health Assessment and Screening, Patient Monitoring and Workflow Automation Support to help deliver both improved patient outcomes and efficiencies within the healthcare system. Driven by the ever increasing costs in the healthcare system and the need for more resource efficient and decentralised delivery processes along with rapidly aging populations, this is achieved through using visual comprehension and NVISO’s human behavioural analytics AI running at the edge as a private, secure and noninvasive system supporting  today’s healthcare challenges. 

– Health Assessment and Screening: Real-time health assessments and screening can assist medical staff and care assistants in both prevention and treatment of conditions and the best allocation of resources. Using AI powered visual observation for measurement of vital signs, and advanced emotions including the assessment of levels of mood, stress, fatigue and anxiety, information can be gathered to assist in decision making leading to improved patient outcomes with optimal resource utilization.

– Patient Monitoring: Monitoring of patients throughout their care experience integrated with hospital information systems, can lead to safer, more secure, and improved patient centric experiences with efficiency and better outcomes. Highly accurate biometrics analysis helps in reliable identification of delirious patients to ensure patient security throughout the treatment journey along with the observation of vital signs, management of stress and anxiety when under treatment and observation of overall mood. Further, observations of body movement, postures, extremity movements, and head pose variations can help identify medical conditions along with emergencies such as collapse or complications in post-operative recovery.

– Workflow Automation Support: Monitoring of both patient and staff identities and activities throughout the patient journey can lead to significantly improved outcomes and efficiencies as well as enhancing security. AI enables patient emotional profiling to address various challenges in communication and medical procedures including the onset of severe fatigue by medical staff and patient confusion and comprehension. AI can be used to monitor facilities and objects, for example to ensure the correct sterilisation process and tool preparation have been followed, correct patient positioning for automated processes has been made, and potential contamination sources identified (e.g., where touch has taken place).

NVISO’s solutions deliver on these use cases through its range of AI Apps providing visual observation, perception and semantic reasoning capabilities, the results of which can be used in identifying issues, in decision making processes and in supporting autonomous “human like” interactions. Examples of these AI Apps provide the analysis of core signals of human behaviour such as body movements, extremity movements, facial expressions, advanced emotions, identity, head pose variations, gaze, gestures, activities, and the identification of objects with which users interact. These AI Apps can be optimised for typically resource constrained low power and low memory processing platforms deployed on the edge without requiring an internet connection. Furthermore, NVISO AI Apps can be easily configured to suit any camera system for optimal performance in terms of distance and camera angle, and thanks to NVISO’s large scale proprietary human behaviour databases NVISO’s AI Apps are robust to the imaging conditions often found in real world deployments. Unlike cloud-based solutions, NVISO’s solutions do not require information to be sent off-device for processing elsewhere so user privacy and safety can be protected.

“Over the last year we have worked with Siemens Healthineers’ team to develop concepts to provide new solutions supporting a variety of use cases within the healthcare environment. Our engineering team has delivered an excellent AI solution for fast customer setup with deployment within the demanding environment of medical imaging applications where continuous assessment and monitoring of patients along with workflow support is required”, said Tim Llewellynn, CEO of NVISO, “Deployment of this technology can provide significant improvement in the target use cases leading to improvement in both patient outcomes and workflow efficiency. For several years, we have been investing in partnerships to integrate our AI Apps  into deep learning accelerated hardware enabling breakthrough capabilities which is now starting to bear fruits. This commercial pilot provides additional evidence for the strong industry demand we are experiencing for the integration of advanced Human Behavioural Analytics technology into extreme edge-based systems for a wide range of applications ranging from consumer products through to medical devices and autonomous and connected automotive systems”.

About NVISO, NVISO is an Artificial Intelligence company founded in 2009 and headquartered at the Innovation Park of the École Polytechnique Fédérale de Lausanne (EPFL) in Switzerland. Its mission is to help teach machines to understand people and their behavior to make autonomous machines safe, secure, and personalized for humans. As leader in human behavioral AI, it provides robust embedded software solutions that can sense, comprehend, and act upon human behavior in real-world environments deployed at the deep edge. It achieves this through real-time perception and observation of people and objects in contextual situations combined with the reasoning and semantics of human behavior based on trusted scientific research. NVISO’s technology is made accessible through ready-to-use AI solutions addressing Smart Mobility and Smart Health and Living applications (in-cabin monitoring systems, health assessments, and companion robot sensing) with a key focus on the deep and extreme edge with ultra-low power processing capabilities. With a singular focus on how to apply the most advanced and robust technology to industry and societal problems that matter, NVISO’s solutions help advance human potential through more robust and rich human machine interactions. 



Please complete this form to receive purchasing instructions via email for the NVISO Mobile EVK.