TU Darmstadt / ULB / TUbiblio

The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch

Wallraven, Christian ; Bülthoff, Heinrich H. ; Waterkamp, Steffen ; Dam, Loes van ; Gaißert, Nina (2024)
The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch.
In: Psychonomic Bulletin & Review, 2014, 21 (4)
doi: 10.26083/tuprints-00027557
Artikel, Zweitveröffentlichung, Postprint

WarnungEs ist eine neuere Version dieses Eintrags verfügbar.

Kurzbeschreibung (Abstract)

Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.

Typ des Eintrags: Artikel
Erschienen: 2024
Autor(en): Wallraven, Christian ; Bülthoff, Heinrich H. ; Waterkamp, Steffen ; Dam, Loes van ; Gaißert, Nina
Art des Eintrags: Zweitveröffentlichung
Titel: The eyes grasp, the hands see: Metric category knowledge transfers between vision and touch
Sprache: Englisch
Publikationsjahr: 22 Juli 2024
Ort: Darmstadt
Publikationsdatum der Erstveröffentlichung: 2014
Ort der Erstveröffentlichung: New York
Verlag: Springer
Titel der Zeitschrift, Zeitung oder Schriftenreihe: Psychonomic Bulletin & Review
Jahrgang/Volume einer Zeitschrift: 21
(Heft-)Nummer: 4
Kollation: 23 Seiten
DOI: 10.26083/tuprints-00027557
URL / URN: https://tuprints.ulb.tu-darmstadt.de/27557
Zugehörige Links:
Herkunft: Zweitveröffentlichungsservice
Kurzbeschreibung (Abstract):

Categorization of seen objects is often determined by the shapes of objects. However, shape is not exclusive to the visual modality: The haptic system also is expert at identifying shapes. Hence, an important question for understanding shape processing is whether humans store separate modality-dependent shape representations, or whether information is integrated into one multisensory representation. To answer this question, we created a metric space of computer-generated novel objects varying in shape. These objects were then printed using a 3-D printer, to generate tangible stimuli. In a categorization experiment, participants first explored the objects visually and haptically. We found that both modalities led to highly similar categorization behavior. Next, participants were trained either visually or haptically on shape categories within the metric space. As expected, visual training increased visual performance, and haptic training increased haptic performance. Importantly, however, we found that visual training also improved haptic performance, and vice versa. Two additional experiments showed that the location of the categorical boundary in the metric space also transferred across modalities, as did heightened discriminability of objects adjacent to the boundary. This observed transfer of metric category knowledge across modalities indicates that visual and haptic forms of shape information are integrated into a shared multisensory representation.

Freie Schlagworte: shape, object categorization, vision, haptics, categorization, multi-sensory representations
Status: Postprint
URN: urn:nbn:de:tuda-tuprints-275575
Sachgruppe der Dewey Dezimalklassifikatin (DDC): 100 Philosophie und Psychologie > 150 Psychologie
600 Technik, Medizin, angewandte Wissenschaften > 610 Medizin, Gesundheit
Hinterlegungsdatum: 22 Jul 2024 13:44
Letzte Änderung: 31 Jul 2024 07:39
PPN:
Export:
Suche nach Titel in: TUfind oder in Google

Verfügbare Versionen dieses Eintrags

Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen