Medical Augmented Reality on the Battlefield (ARTEMIS)
Official Website: ARTEMIS
This project is to support the use of AR technologies as a technological platform to guide first responders, whether they are trained or untrained, to assess and treat injuries on the battlefield. The project is a comprehensive software architecture that involves multidisciplinary areas of AR/VR user interface development, deformable computer vision tracking and fusion, multi-model sensor (i.e. depth camera, RGB, inertial, etc.) measurements to create high situational awareness between the mentor and the responder. Key innovations that ARClab provides is in:
Soft tissue tracking in camera
Reconstruction of 3D scenes from multiple RGB-D sources
GPU-accelerated dynamic fusion of the surgical scene
Bilateral communication of data between AR/VR equipment and camera sensors.
Our hardware platforms that are incorporated into the framework include:
Microsoft Kinect Azure
HTC Vive Pro
Magic Leap One
This project is in tight collaboration with the Dr. Nadir Weibel in Computer Science and the Weibel Lab, and clinical collaboration with the Navy Balboa Medical Center with lead PI CAPT Konrad Davis. The project is funded under USMRMC Defense Health Project funding.
Students and Collaborators