Gesture learning in VR and physical properties of replicas

Abstract

Industrial and economic context of the thesis to contribute to the increase in skills of SMEs in the Loire region in the field of eXtended Reality: Virtual, Augmented and Mixed Reality (continuum from Virtual Reality to Augmented Reality) by facilitating the development of applications capable of integrating the business characteristics of their customers to facilitate the use and appropriation of these 3D applications. A particular focus will be made on the use of XR for knowledge transfer. The scientific part of this thesis will consist in studying and proposing models to facilitate the taking into account of users’ business environments in the creation of XR applications related to learning and more particularly to knowledge transfer. Recent works have highlighted that the issue of hand representation for laparoscopic surgery training was an influential factor on the quality of interaction. Conversely, other work has shown that it is possible to create a catalog of interactions for a task ontology. Finally, approaches based on the representation of gestures and/or expert behaviors seem promising to be able to efficiently guide users in the tasks they have to perform.

People involved

Researchers

Guillaume Moreau

Professor of Computer Science at IMT Atlantique, Brest campus, in France, with research interests in Virtual and Augmented Reality within the Lab-STICC lab. He is also a member of the INRIA Hybrid team and currently serve as Deputy Dean for Research and Innovation at IMT Atlantique.

Thierry Duval

Thierry Duval is a highly accomplished computer science professional currently serving as the Head of the Computer Science Department at IMT Atlantique. He is also a full professor at the same institution. Duval’s research focuses on collaborative virtual environments, human-computer interaction (HCI), and immersive 3D user interfaces. He is also the leader of the INUIT team at Lab-STICC and the scientific leader of the ATOL lab.

Lionel Dominjon

Lionel Dominjon is the Scientific Director at CLARTE in Pays de la Loire, France, with over 18 years of experience in virtual and augmented reality research and development. He holds a PhD in Computer Science from Université d’Angers and an engineering degree from Institut français de Mécanique avancée. Lionel’s work focuses on creating immersive systems for industrial applications, and he has published research on haptic interaction techniques.

PhD Student

Julien Cauquis

Julien Cauquis is a doctoral student on a CIFRE thesis with the Clarté research center and the Lab-STICC laboratory, as part of the INUIT team. He is working on the study of the physical properties of tool replicas in virtual reality to improve the learning of technical gestures.

Interns

Lucas Thomesse