biostudies-literaturevan Amsterdam BEPSRC Centre for Doctoral Training in Intelligent, Integrated Imaging In HealthcareGerman Research FoundationWellcome/EPSRC Centre for Interventional and Surgical SciencesCluster of Excellence “Centre for Tactile Internet with Human-in-the-Loop”Royal Academy of Engineering Chair in Emerging Technologies SchemeWellcome TrustGermany’s Excellence Strategy—EXC 2050/1Engineering and Physical Sciences Research Council1677-1687https://www.ebi.ac.uk/biostudies/studies/S-EPMC7616924biostudies-literatureUnknown41(7)Automatically recognising surgical gestures from surgical data is an important building block of automated activity recognition and analytics, technical skill assessment, intra-operative assistance and eventually robotic automation. The complexity of articulated instrument trajectories and the inherent variability due to surgical style and patient anatomy make analysis and fine-grained segmentation of surgical motion patterns from robot kinematics alone very difficult. Surgical video provides crucial information from the surgical site with context for the kinematic data and the interaction between the instruments and tissue. Yet sensor fusion between the robot data and surgical video stream is non-trivial because the data have different frequency, dimensions and discriminative capability. IEEE transactions on medical imagingGesture Recognition in Robotic Surgery With Multimodal Attention.PMC7616924390696704203145EP/P012841/1203145Z/16/ZEP/S021930/1EP/P030084/1EP/P027938/1EP/R004080/1Sridhar AEdwards EKelly JFunke ISpeidel Svan Amsterdam BClarkson MJStoyanov DCollins JfalseGesture Recognition in Robotic Surgery With Multimodal Attention.Automatically recognising surgical gestures from surgical data is an important building block of automated activity recognition and analytics, technical skill assessment, intra-operative assistance and eventually robotic automation. The complexity of articulated instrument trajectories and the inherent variability due to surgical style and patient anatomy make analysis and fine-grained segmentation of surgical motion patterns from robot kinematics alone very difficult. Surgical video provides crucial information from the surgical site with context for the kinematic data and the interaction between the instruments and tissue. Yet sensor fusion between the robot data and surgical video stream is non-trivial because the data have different frequency, dimensions and discriminative capability. 2022-01-01T00:00:00Z2022 Jul2025-04-03T23:52:35.343Z2025-04-03T23:52:35.343ZS-EPMC76169243510820010.1109/TMI.2022.3147640