3D Telepresence
Provide live 3D volumetric video across a 5G network, shown in XR to a remote expert, in order to provide guidance, advice and instruction to a local caregiver.
In the 5G-Tours project, we examined the use of 3D Telepresence for supporting Emergency Medical Teams (EMTs), providing insight for remote traumatologists and other experts.
This demonstrator was constructed 2019-2022 in these Horizon 2020 projects, using Unity, Kinect cameras, HoloLens 2, Oculus Quest 2 and HTC Vive headsets.
In the 5G HEART project, we examined the use of 3D telepresence for screening, diagnosis and follow-up of Congenital Heart Disease (CHD).
My responsibilities:
- Project lead for a team of four
- Concept design/technical design
- Workflow setup, interface design
- US signal integration
- Networking
- Evaluation and deployment, testing on the 5G testbeds
- Capture/render
The remote expert has an XR application showing live volumetric video and Ultrasound images where he can manipulate a virtual probe. The local caregiver wears an XR headset and sees Ultrasound images and the virtual probe on the patient. The remote expert gives verbal and visual guidance on how to perform the exam.
Virtual Frontier 