College of Social and Behavioral Science

149 Testing the Reliability of Multi-Sensory Cue Use During Navigation in Virtual Reality

Phoenix Hines; Sarah Creem-Regehr; and Corey Shayman

Faculty Mentor: Sarah Creem-Regehr (Psychology, University of Utah)

 

People rely on their senses to participate in their daily activities. However, research has not fully explored how the senses are used in combination during navigation. In navigation, two primary sensory cues are visual landmarks and the cues that come from vestibular and proprioceptive (body-based) senses associated with people’s movements. We aim to investigate the contribution of both visual and body-based cues when people are navigating. Our project has two objectives; 1) To test how single cues (body-based or visual) are weighted and combined during navigation and 2) To test whether those measures remain stable over time. We have hypothesized that participants will perform better with access to two cues than with access to a single cue and that errors and variability will decrease with repeated trials. Twenty participants were asked to put on a virtual reality headset and to perform a “homing” task where they walked two legs of a triangle and then returned to where they remembered the starting location to be. The participant repeats the same sequence under each of the three conditions possible.  The first condition acts as a control where sensory cues are unaltered; the second condition disrupts the use of body-based cues for location by spinning the participant  before returning to the target; and the third condition limits the participants’ ability to use their vision by removing visual landmarks. With many trials and two visits, we can assess the accuracy and variability over time, as well as how accuracy and variability varies when using a single cue versus two cues. This method will help us understand the contribution of practice and learning to sensory cue combinations. We ran a 2 (test session) x 3 (condition) ANOVA on mean accuracy to assess the accuracy of returning to the home location across all three conditions and whether it improved in the second session. There was no significant effect of test session, showing that participants did not improve from the first to second session. But, there was a significant effect of cue condition showing that performance improved in the consistent cue condition compared to the self-motion only condition. We ran correlations between session 1 and session 2 for each of the 3 cue conditions, on both accuracy and variability to determine if performance remained consistent over time. We found the strongest correlations for the consistent condition, showing reliability across test sessions when two cues are available, but less reliability with only a single cue. Understanding how people navigate with multisensory information can act as a resource when developing helpful forms of intervention in cases of sensory decline. 

References

Baenninger, M., & Newcombe, N. (1989). The role of experience in spatial test performance: A meta-analysis. Sex roles, 20(5-6), 327-344.

Bates, S.L., & Wolbers, T. (2014). How cognitive aging affects multisensory integration of navigational cues. Neurobiology of Aging, 35(12), 2761-2769.

Doi:10.1016/j.neurobiolaging.2014.04.003.

Chen, X., McNamara, T. P., Kelly, J. W., & Wolbers, T. (2017). Cue combination in human spatial navigation. Cognitive Psychology, 95, 105-144:

Coughlan, G., Puthusseryppady, V., Lowry, E., Gillings, R., Spiers, H., Minihane, A. M., & Hornberger, M. (2020). Test-retest reliability of spatial navigation in adults at- risk of Alzheimer’s disease. PLoS One, 15(9), e0239077.

Dosher, B., & Lu, Z. L. (2017). Visual perceptual learning and models. Annual review of vision science, 3, 343-363.

Frissen, I., Campos, J.L., Souman, J.L. et al. Integration of vestibular and proprioceptive signals for spatial updating. Exp Brain Res 212, 163–176 (2011). https://doi.org/10.1007/s00221-011-2717-9

Kearns, M. J., Warren, W. H., Duchon, A. P., & Tarr, M. J. (2002). Path Integration from Optic Flow and Body Senses in a Homing Task. Perception, 31(3), 349-374. https://doi.org/10.1068/p3311

Lester, A. W., Moffat, S. D., Wiener, J. M., Barnes, C. A., & Wolbers, T. (2017). The Aging Navigational System. Neuron, 95(5), 1019-1035. doi:10.1016/j.neuron.2017.06.037

McLaren, R., Chaudhary, S., Rashid, U., Ravindran, S., & Taylor, D. (2022). Reliability of the triangle completion test in the real-world and in virtual reality. Frontiers in Human Neuroscience, 16, 945953. https://doi.org/10.3389/fnhum.2022.945953

McNamara, T. P., & Chen, X. (2022). Bayesian decision theory and navigation.

Psychonomic Bulletin & Review, 1-32.

Nardini, M., Jones, P., Bedford, R., & Braddick, O. (2008). Development of cue integration in human navigation. Current biology, 18(9), 689-693.

Sjolund, L. A., Kelly, J. W., & McNamara, T. P. (2018). Optimal combination of environmental cues and path integration during navigation. Memory & Cognition, 46, 89-99.

Szturm, T., Sakhalkar, V., Boreskie, S., Marotta, J. J., Wu, C., & Kanitkar, A. (2015). Integrated testing of standing balance and cognition: Test–retest reliability and construct validity. Gait & posture, 41(1), 146-152.

Zhao, M. & Warren, W.H. (2015). Environmental stability modulates the role of path integration in human navigation. Cognition, 142, 96-109. doi:10.1016/j.cognition.2015.05


About the authors

License

Icon for the Creative Commons Attribution 4.0 International License

RANGE: Journal of Undergraduate Research (2024) Copyright © 2024 by University of Utah is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.

Share This Book