AURALLY AIDED VISUAL SEARCH IN DEPTH USING ‘REAL’ AND ‘VIRTUAL’ CROWDS

  • Jason S. Chan

Abstract

Auditory stimuli are known to improve visual target recognition and detection when both arepresented in the same spatial location. However, these studies have focused on spatialcongruency along the horizontal plane. To date, it is unknown whether the audio-visual spatialcongruency is important for localisation in depth. In Experiment 1, we presented simple audiovisualstimuli presented in a congruent spatial location or the auditory stimulus was presenteddirectly in-front or behind the visual stimulus. We find that participants are faster and moreaccurate when audio-visual stimuli are presented in the same location, compared to differentdepths. To increase the number of distracters and locations, a more complex scene was createdand presented on a computer monitor. Virtual audio was recorded to be congruent orincongruent with the visual target. Participants were asked to locate a target agent (virtualperson) amongst a varying number of distracters. Once again, we found participants were fasterand more accurate when audio-visual stimuli were presented in the same location in the scene,compared to different “depthsâ€.
Section
Full Articles