Back
2025

Endomersion

Multi-user control system for surgical robotics

About

This project upgraded a surgical telementoring platform to support real-time, multi-user collaboration among remote medical experts. Built with Unity and ROS, the architecture synchronizes complex surgical states across VR headsets and PC interfaces with strict low-latency requirements.

Critical was a secure dual-robot control system that allows operators to safely toggle between robot arms. To coordinate distributed inputs, a robust rights management architecture was implemented using a request-response model.

This ensures that only one user holds control privileges at any given time, featuring a strict "Security Mode" for explicit access requests and a hierarchical "Surgery Mode" that allows lead operators to instantly override controls to prevent input conflicts.

Key Highlights
  • Real-time multi-user collaboration for surgical telementoring
  • Dual-robot control system with secure toggle between arms
  • Rights management with Security Mode and Surgery Mode
  • State synchronization across VR headsets and PC interfaces
  • Low-latency architecture meeting surgical-grade requirements
Stack
UnityC#ROSVR/XRNetworkingRobotics