TU Darmstadt / ULB / TUbiblio

Multimodal Similarity and Categorization of Novel, Three-Dimensional Objects

Cooke, T. ; Jäkel, F. ; Wallraven, C. ; Bülthoff, H. (2007)
Multimodal Similarity and Categorization of Novel, Three-Dimensional Objects.
In: Neuropsychologia, 45
doi: 10.1016/j.neuropsychologia.2006.02.009
Artikel, Bibliographie

Kurzbeschreibung (Abstract)

Similarity has been proposed as a fundamental principle underlying mental object representations and capable of supporting cognitive-level tasks such as categorization. However, much of the research has considered connections between similarity and categorization for tasks performed using a single perceptual modality. Considering similarity and categorization within a multimodal context opens up a number of important questions: Are the similarities between objects the same when they are perceived using different modalities or using more than one modality at a time? Is similarity still able to explain categorization performance when objects are experienced multimodally? In this study, we addressed these questions by having subjects explore novel, 3D objects which varied parametrically in shape and texture using vision alone, touch alone, or touch and vision together. Subjects then performed a pair-wise similarity rating task and a free sorting categorization task. Multidimensional scaling (MDS) analysis of similarity data revealed that a single underlying perceptual map whose dimensions corresponded to shape and texture could explain visual, haptic, and bimodal similarity ratings. However, the relative dimension weights varied according to modality: shape dominated texture when objects were seen, whereas shape and texture were roughly equally important in the haptic and bimodal conditions. Some evidence was found for a multimodal connection between similarity and categorization: the probability of category membership increased with similarity while the probability of a category boundary being placed between two stimuli decreased with similarity. In addition, dimension weights varied according to modality in the same way for both tasks. The study also demonstrates the usefulness of 3D printing technology and MDS techniques in the study of visuohaptic object processing.

Typ des Eintrags: Artikel
Erschienen: 2007
Autor(en): Cooke, T. ; Jäkel, F. ; Wallraven, C. ; Bülthoff, H.
Art des Eintrags: Bibliographie
Titel: Multimodal Similarity and Categorization of Novel, Three-Dimensional Objects
Sprache: Englisch
Publikationsjahr: 2007
Titel der Zeitschrift, Zeitung oder Schriftenreihe: Neuropsychologia
Jahrgang/Volume einer Zeitschrift: 45
DOI: 10.1016/j.neuropsychologia.2006.02.009
URL / URN: https://doi.org/10.1016/j.neuropsychologia.2006.02.009
Kurzbeschreibung (Abstract):

Similarity has been proposed as a fundamental principle underlying mental object representations and capable of supporting cognitive-level tasks such as categorization. However, much of the research has considered connections between similarity and categorization for tasks performed using a single perceptual modality. Considering similarity and categorization within a multimodal context opens up a number of important questions: Are the similarities between objects the same when they are perceived using different modalities or using more than one modality at a time? Is similarity still able to explain categorization performance when objects are experienced multimodally? In this study, we addressed these questions by having subjects explore novel, 3D objects which varied parametrically in shape and texture using vision alone, touch alone, or touch and vision together. Subjects then performed a pair-wise similarity rating task and a free sorting categorization task. Multidimensional scaling (MDS) analysis of similarity data revealed that a single underlying perceptual map whose dimensions corresponded to shape and texture could explain visual, haptic, and bimodal similarity ratings. However, the relative dimension weights varied according to modality: shape dominated texture when objects were seen, whereas shape and texture were roughly equally important in the haptic and bimodal conditions. Some evidence was found for a multimodal connection between similarity and categorization: the probability of category membership increased with similarity while the probability of a category boundary being placed between two stimuli decreased with similarity. In addition, dimension weights varied according to modality in the same way for both tasks. The study also demonstrates the usefulness of 3D printing technology and MDS techniques in the study of visuohaptic object processing.

Fachbereich(e)/-gebiet(e): 03 Fachbereich Humanwissenschaften
03 Fachbereich Humanwissenschaften > Institut für Psychologie
03 Fachbereich Humanwissenschaften > Institut für Psychologie > Modelle höherer Kognition
Hinterlegungsdatum: 09 Jul 2018 09:11
Letzte Änderung: 12 Okt 2020 11:28
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Frage zum Eintrag Frage zum Eintrag

Optionen (nur für Redakteure)
Redaktionelle Details anzeigen Redaktionelle Details anzeigen