Giessener Elektronische Bibliothek

GEB - Giessener Elektronische Bibliothek

Multimodal Integration of Spatial Information: The Influence of Object-Related Factors and Self-Reported Strategies

Karimpur, Harun ; Hamburger, Kai

Originalveröffentlichung: (2016) Frontiers in Psychology 7:1443 doi: 10.3389/fpsyg.2016.01443
Zum Volltext im pdf-Format: Dokument 1.pdf (886 KB)

Bitte beziehen Sie sich beim Zitieren dieses Dokumentes immer auf folgende
URN: urn:nbn:de:hebis:26-opus-129084

Freie Schlagwörter (Englisch): multimodality , modality , wayfinding , landmark , congruency
Sammlung: Open Access - Publikationsfonds
Universität Justus-Liebig-Universität Gießen
Institut: Experimental Psychology and Cognitive Science
Fachgebiet: Psychologie
DDC-Sachgruppe: Psychologie
Dokumentart: Aufsatz
Sprache: Englisch
Erstellungsjahr: 2016
Publikationsdatum: 31.05.2017
Kurzfassung auf Englisch: Spatial representations are a result of multisensory information integration. More recent findings suggest that the multisensory information processing of a scene can be facilitated when paired with a semantically congruent auditory signal. This congruency effect was taken as evidence that audio-visual integration occurs for complex scenes. As navigation in our environment consists of a seamless integration of complex sceneries, a fundamental question arises: how is human landmark-based wayfinding affected by multimodality? In order to address this question, two experiments were conducted in a virtual environment. The first experiment compared wayfinding and landmark recognition performance in unimodal visual and acoustic landmarks. The second experiment focused on the congruency of multimodal landmark combinations and additionally assessed subject’s self-reported strategies (i.e. whether they focused on direction sequences or landmarks). We demonstrate (1) the equality of acoustic and visual landmarks and (2) the congruency effect for the recognition of landmarks. Additionally, the results point out that self-reported strategies play a role and are an under-investigated topic in human landmark-based wayfinding.
Lizenz: Lizenz-Logo  Creative Commons - Namensnennung 4.0