Arnaud Huaulmé

• Doctor of Engineering
• University of Rennes

As simulation advances in healthcare training, understanding how body-only signals convey emotions in virtual environments is crucial, particularly with masked virtual agents. This study involved 41 nursing students evaluating 16 faceless fear and surprise postures to assess their realism and the emotion conveyed. While well-recognized in 2D human...

Aims: Crises in the operating room, often resulting from human factors, endangers patient safety. Simulation based training to develop non-technical skills shows promise in managing these crises. This review examines the simulation techniques, targeted healthcare professionals, non-technical skills, crisis scenarios, and evaluation metrics used in...

The advent of robotic surgery has brought about a paradigm shift in the medical field, necessitating the development of corresponding surgical skills training and assessment methods. These methods aim to enable surgeons to acquire the requisite skills for robotic surgery in the most efficient manner. Despite the progression from a master-apprentice...

Observer-based scoring systems, or automatic methods, based on features or kinematic data analysis, are used to perform surgical skill assessments. These methods have several limitations, observer-based ones are subjective, and the automatic ones mainly focus on technical skills or use data strongly related to technical skills to assess non-technic...

Different methods have been proposed to evaluate surgical skills from observer-based scoring to recent data-driven approaches. However, most of these methods assess the surgical performance considering the procedure as a whole, avoiding detailed performance insights. In this study, we focused on the most challenging phases of robotic-assisted hyste...

Purpose Limited data exist on the actual transfer of skills learned using a virtual reality (VR) simulator for arthroscopy training because studies mainly focused on VR performance improvement and not on transfer to real word (transfer validity). The purpose of this single-blinded, controlled trial was to objectively investigate transfer validity i...

Surgical skills assessment is a crucial step to help understanding surgical expertise and to provide technical knowledge to beginners. Scores, such as GOALS [1], have been designed to assess surgical skills. However, these scores are subjective and need experts to compute them. With the advent of robotic surgery, it is possible to compute Automated...

PurposeSimulation-based training allows surgical skills to be learned safely. Most virtual reality-based surgical simulators address technical skills without considering non-technical skills, such as gaze use. In this study, we investigated surgeons’ visual behavior during virtual reality-based surgical training where visual guidance is provided. O...

Introduction: Environmental factors in the operating room during cesarean sections are likely important for both women/birthing people and their babies but there is currently a lack of rigorous literature about their evaluation. The principal aim of this study was to systematically examine studies published on the physical environment in the obste...

Background Annotated data are foundational to applications of supervised machine learning. However, there seems to be a lack of common language used in the field of surgical data science. The aim of this study is to review the process of annotation and semantics used in the creation of SPM for minimally invasive surgery videos. Methods For this sy...

Background and objective: In order to be context-aware, computer-assisted surgical systems require accurate, real-time automatic surgical workflow recognition. In the past several years, surgical video has been the most commonly-used modality for surgical workflow recognition. But with the democratization of robot-assisted surgery, new modalities,...

International benchmarking competitions have become fundamental for the comparative performance assessment of image analysis methods. However, little attention has been given to investigating what can be learnt from these competitions. Do they really generate scientific progress? What are common and successful participation strategies? What makes a...

Improving surgical training by means of technology assistance is an important challenge that aims to directly impact surgical quality. Surgical training includes the acquisition of two categories of knowledge: declarative knowledge (i.e. ‘knowing what’) and procedural knowledge (i.e. ‘knowing how’). It is essential to acquire both before performing...

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in...

PurposeSurgery simulators can be used to learn technical and non-technical skills and, to analyse posture. Ergonomic skill can be automatically detected with a Human Pose Estimation algorithm to help improve the surgeon’s work quality. The objective of this study was to analyse the postural behaviour of surgeons and identify expertise-dependent mov...

This paper presents the design and results of the "PEg TRAnsfert Workflow recognition" (PETRAW) challenge whose objective was to develop surgical workflow recognition methods based on one or several modalities, among video, kinematic, and segmentation data, in order to study their added value. The PETRAW challenge provided a data set of 150 peg tra...

Introduction Robot-assisted laparoscopy is a safe surgical approach with several studies suggesting correlations between complication rates and the surgeon’s technical skills. Surgical skills are usually assessed by questionnaires completed by an expert observer. With the advent of surgical robots, automated surgical performance metrics (APMs)—obje...

Background and objective: Automatic surgical workflow recognition is an essential step in developing context-aware computer-assisted surgical systems. Video recordings of surgeries are becoming widely accessible, as the operational field view is captured during laparoscopic surgeries. Head and ceiling mounted cameras are also increasingly being us...

Introduction La simulation par réalité virtuelle (VR) est adaptée à l’apprentissage de l’arthroscopie. Malgré de nombreuses études, il reste néanmoins difficile de distinguer des niveaux de compétence (Construct Validity) parmi les chirurgiens expérimentés. Il semble donc adéquat de rechercher de nouvelles méthodes de mesure de compétence en utilis...

Background: Virtual reality (VR) simulation is particularly suitable for learning arthroscopy skills. Despite significant research, one drawback often outlined is the difficulty in distinguishing performance levels (Construct Validity) in experienced surgeons. Therefore, it seems adequate to search new methods of performance measurements using prob...

The "MIcro-Surgical Anastomose Workflow recognition on training sessions" (MISAW) challenge provided a data set of 27 sequences of micro-surgical anastomosis on artificial blood vessels. This data set was composed of videos, kinematics, and workflow annotations described at three different granularity levels: phase, step, and activity. The particip...

Objective: According to a meta-analysis of 7 studies, the median number of patients with at least one adverse event during the surgery is 14.4%, and a third of those adverse events were preventable. The occurrence of adverse events forces surgeons to implement corrective strategies and, thus, deviate from the standard surgical process. Therefore, i...

Objective: A median of 14.4% of patient undergone at least one adverse event during surgery and a third of them are preventable. The occurrence of adverse events forces surgeons to implement corrective strategies and, thus, deviate from the standard surgical process. Therefore, it is clear that the automatic identification of adverse events is a ma...

Purpose Annotation of surgical activities becomes increasingly important for many recent applications such as surgical workflow analysis, surgical situation awareness, and the design of the operating room of the future, especially to train machine learning methods in order to develop intelligent assistance. Currently, annotation is mostly performed...

Purpose To assess surgical skills in robot-assisted partial nephrectomy (RAPN) with and without surgical navigation (SN). Methods We employed an SN system that synchronizes the real-time endoscopic image with a virtual reality three-dimensional (3D) model for RAPN and evaluated the skills of two expert surgeons with regard to the identification an...

Objective: The analysis of surgical motion has received a growing interest with the development of devices allowing their automatic capture. In this context, the use of advanced surgical training systems makes an automated assessment of surgical trainee possible. Automatic and quantitative evaluation of surgical skills is a very important step in...

Purpose: Surgical processes are generally only studied by identifying differences in populations such as participants or level of expertise. But the similarity between this population is also important in understanding the process. We therefore proposed to study these two aspects. Methods: In this article, we show how similarities in process wor...

Objective: Each surgical procedure is unique due to patient's and also surgeon's particularities. In this study, we propose a new approach to distinguish surgical behaviors between surgical sites, levels of expertise and individual surgeons thanks to a pattern discovery method. Methods: The developed approach aims to distinguish surgical behavio...

Les événements indésirables (EIs) sont devenus une vraie préoccupation du monde médical, leur réduction étant recherchée pour assurer la meilleure sécurité possible pour les patients. Les événements indésirables sont, selon la HAS, ‘‘des situations qui s'écartent de procédures ou de résultats escomptés dans une situation habituelle et qui sont ou q...

Purpose: With the intention of extending the perception and action of surgical staff inside the operating room, the medical community has expressed a growing interest towards context-aware systems. Requiring an accurate identification of the surgical workflow, such systems make use of data from a diverse set of available sensors. In this paper, we...