Bio-Synergy, a sports and wellness company, worked with Imperial College to develop and implement the SimXAR platform as part of their broader efforts to combine cutting-edge technology with healthcare education and training.
SimXAR is an augmented reality (AR) platform designed to enhance simulation-based learning for healthcare professionals.
It allows users to practice medical procedures in an immersive, augmented reality environment, improving their practical skills in a safe and controlled setting.
The technology also allows clinicians and patients to view and interact with high-resolution 3D hologram-like images of patient scans, alongside traditional imaging techniques.
SimXAR is an augmented reality (AR) platform designed to enhance simulation-based learning for healthcare professionals
It is being used to support some patient consultations, assist preparations for certain operations and provide immersive clinical training.
Mixed reality, which blends 3D digital content with the real world, is regarded as the next frontier in visual computing. It enables users to interact with digital content - such as 3D renderings of patient scans - while remaining fully aware of their real-world surroundings.
Unlike Virtual Reality (VR), which immerses users in a completely separate 3D environment and blocks out the real world, mixed reality enhances the user’s perception by integrating digital and physical elements.
The Trust’s neurosurgery team utilizes XARlabs’ simXAR mixed reality tool, which was developed independently by a registrar at the Trust when he was part of the NHS Clinical Entrepreneur Programme, prior to joining the Trust.
The technology is also being used alongside conventional scans to enhance the team's ability to view and understand the surgical anatomy ahead of certain brain and spine operations
The simXAR technology was initially planned to support training within the neurosurgery department with funding from NHS England.
The Trust neurosurgery team recognised the broader benefits the technology could offer patient care - and introduced it in some consultations in order to better explain proposed treatments to patients as part of the consent process and also used it more widely to enhance team preparedness.
The team uses the technology to convert CT and MRI patient scans into 3D augmented reality models. During training sessions and certain patient consultations, both the surgeon and the trainee - or the surgeon and the patient - wear Trust-owned Magic Leap 2 headsets.
Patients provide consent for both the generation of their models and for wearing the headsets. The surgeon can interact with the 3D model by zooming in, rotating it, or even ‘walking’ inside to visualise the patient’s anatomy in an immersive and easily understandable way.
The technology allows us to visualise and rehearse surgical procedures with great detail and accuracy, which we believe brings quantifiable benefits to both patients and clinicians
This marks a significant shift from the traditional method of viewing scans one series at a time on 2D computer screens. The team believes this represents an innovative way of viewing medical imaging that can significantly benefit both patients and health professionals in the NHS.
The neurosurgery team at Imperial College Healthcare is primarily using the simXAR technology in training and simulation sessions and has also begun inviting some patients to view their 3D models before surgery to help them better understand the planned procedures.
The technology is also being used alongside conventional scans to enhance the team's ability to view and understand the surgical anatomy ahead of certain brain and spine operations.
Additionally, the team is looking to assess the technology’s potential broader benefits in medical training, patient experience, and surgical guidance, subject to ethical and regulatory approvals.
Patients provide consent for both the generation of their models and for wearing the headsets
Consultant skull base and vascular Neurosurgeon at Imperial College Healthcare NHS Trust, Dr Arthur Dalton, said: "We immediately saw the potential of this technology and set out to develop a world-class mixed reality suite, drawing on the expertise and innovation within our own surgical team. The level of detail and interactivity it offers far surpasses traditional methods, facilitating better preparation and understanding for surgeons, trainees, and patients."
"We're already starting to see benefits as we continue embedding this system into our work. The potential for improving patient care and training is huge. We believe we are the first, or one of the first, to adopt this type of mixed reality platform in this way in the NHS and hope our work can help the NHS remain at the forefront of this emerging technology," Dr Dalton concluded.
Senior Neurosurgery registrar at Imperial College Healthcare NHS Trust, an alumni of the NHS Clinical Entrepreneur Programme and founder and CEO of XARlabs, Ali Haddad, said: "We are thrilled to be pioneering this innovative technology at the Trust, and are really excited about the potential for improving patient care. We believe it marks a significant advancement in the integration of mixed reality technology within the NHS."
"The technology allows us to visualise and rehearse surgical procedures with great detail and accuracy, which we believe brings quantifiable benefits to both patients and clinicians. We are also looking to explore how the technology could benefit surgeries in real-time in the future, hopefully undertaking clinical trials within the next couple of years," Haddad concluded.
Top image: Mixed reality consultation