Virtual Reality for Immersive Human Machine Teaming with Vehicles
No Thumbnail Available
Authors
Novitzky, Michael
Semmens, Rob
Franck, Nicholas H.
Chewar, Christa M.
Korpela, Christopher M.
Issue Date
2020
Type
book-chapter
Language
Keywords
Underlying and supporting technologies , VAMR technologies and techniques for human-robot interaction , Virtual Reality , Human-Robot Interaction , Simulation
Alternative Title
Abstract
We present developments in constructing a 3D environment and integrating a virtual reality headset in our Project Aquaticus platform. We designed Project Aquaticus to examine the interactions between human-robot teammate trust, cognitive load, and perceived robot intelligence levels while they compete in games of capture the flag on the water. Further, this platform will allows us to study human learning of tactical judgment under a variety of robot capabilities. To enable human-machine teaming (HMT), we created a testbed where humans operate motorized kayaks while the robots are autonomous catamaran-style surface vehicles. MOOS-IvP provides autonomy for the robots. After receiving an order from a human, the autonomous teammates can perform tasks conducive to capturing the flag, such as defending or attacking a flag. In the Project Aquaticus simulation, the humans control their virtual vehicle with a joystick and communicate with their robots via radio. Our current simulation is not engaging or realistic for participants because it presents a top-down, omniscient view of the field. This fully observable representation of the world is well suited for managing operations from the shore and teaching new players game mechanics and strategies; however, it does not accurately reflect the limited and almost chaotic view of the world a participant experiences while in their motorized kayak on the water. We present creating a 3D visualization through Unity that users experience through a virtual reality headset. Such a system allows us to perform experiments without the need for a significant investment in on-water experiment resources while also permitting us to gather data year-round through the cold winter months.
Description
Citation
Novitzky, M., Semmens, R., Franck, N.H., Chewar, C.M., Korpela, C. (2020). Virtual Reality for Immersive Human Machine Teaming with Vehicles. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. Design and Interaction. HCII 2020. Lecture Notes in Computer Science(), vol 12190. Springer, Cham. https://doi.org/10.1007/978-3-030-49695-1_39
Publisher
Springer International Publishing
License
Journal
Volume
Issue
PubMed ID
ISSN
0302-9743
1611-3349
1611-3349