Voice Driven Virtual Assistant Tutor in Virtual Reality for Electronic and Electrical Engineering Remote Laboratories

MJ Callaghan, Gildas Bengloan, Julien Ferrer, Léo Cherel, Mohamed Ali El Mostadi, Augusto Gómez Eguíluz, Niall McShane

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The first generation of affordable consumer virtual reality headsets and related peripherals are now available. Question-Answering (QA) systems and speech recognition/synthesis has improved dramatically over the last decade. Virtual assistants, based on speech-based services are growing in popularity and can be used in a range of diverse application areas. This paper explores the practical use of virtual reality, IOT and voice driven virtual assistants in remote laboratories to facilitate visualization of electrical phenomena and to tutor students; guiding them through each stage of an experiment; presenting supplementary teaching resources when requested; accessing, controlling and configuring instrumentation and hardware and providing feedback with summative and formative assessment. The re-purposing of existing teaching material for use in an immersive environment with a virtual assistant is shown and the limitations and opportunities offered by the approach taken and the technologies used are discussed. The process of integrating test instrumentation, the board under test, a switching matrix and additional teaching resources into virtual reality using IOT is discussed and the inclusion of virtual assistants described. Two case studies of practical working examples of remote laboratories in virtual reality with a virtual assistant tutor are demonstrated and the viability and long-term opportunities for the use of virtual reality and virtual assistants in the context discussed
Original languageEnglish
Title of host publicationUnknown Host Publication
PublisherSpringer
Number of pages13
Publication statusAccepted/In press - 23 Dec 2017
Event15th International Conference on Remote Engineering and Virtual Instrumentation (REV) - Duesseldorf, Germany
Duration: 23 Dec 2017 → …

Conference

Conference15th International Conference on Remote Engineering and Virtual Instrumentation (REV)
Period23/12/17 → …

Keywords

  • Virtual Reality
  • IoT
  • Automatic Question-Answering (QA) systems
  • speech recognition and synthesis
  • virtual assistants
  • voice user interface practical laboratories.

Fingerprint Dive into the research topics of 'Voice Driven Virtual Assistant Tutor in Virtual Reality for Electronic and Electrical Engineering Remote Laboratories'. Together they form a unique fingerprint.

  • Cite this