TU Darmstadt / ULB / TUbiblio

Solving Bongard Problems With a Visual Language and Pragmatic Constraints

Depeweg, Stefan ; Rothkopf, Contantin A. ; Jäkel, Frank (2024)
Solving Bongard Problems With a Visual Language and Pragmatic Constraints.
In: Cognitive Science, 48 (5)
doi: 10.1111/cogs.13432
Article, Bibliographie

Abstract

More than 50 years ago, Bongard introduced 100 visual concept learning problems as a challenge for artificial vision systems. These problems are now known as Bongard problems. Although they are well known in cognitive science and artificial intelligence, only very little progress has been made toward building systems that can solve a substantial subset of them. In the system presented here, visual features are extracted through image processing and then translated into a symbolic visual vocabulary. We introduce a formal language that allows representing compositional visual concepts based on this vocabulary. Using this language and Bayesian inference, concepts can be induced from the examples that are provided in each problem. We find a reasonable agreement between the concepts with high posterior probability and the solutions formulated by Bongard himself for a subset of 35 problems. While this approach is far from solving Bongard problems like humans, it does considerably better than previous approaches. We discuss the issues we encountered while developing this system and their continuing relevance for understanding visual cognition. For instance, contrary to other concept learning problems, the examples are not random in Bongard problems; instead they are carefully chosen to ensure that the concept can be induced, and we found it helpful to take the resulting pragmatic constraints into account.

Item Type: Article
Erschienen: 2024
Creators: Depeweg, Stefan ; Rothkopf, Contantin A. ; Jäkel, Frank
Type of entry: Bibliographie
Title: Solving Bongard Problems With a Visual Language and Pragmatic Constraints
Language: English
Date: 3 May 2024
Publisher: Wiley Periodicals LLC
Journal or Publication Title: Cognitive Science
Volume of the journal: 48
Issue Number: 5
DOI: 10.1111/cogs.13432
Abstract:

More than 50 years ago, Bongard introduced 100 visual concept learning problems as a challenge for artificial vision systems. These problems are now known as Bongard problems. Although they are well known in cognitive science and artificial intelligence, only very little progress has been made toward building systems that can solve a substantial subset of them. In the system presented here, visual features are extracted through image processing and then translated into a symbolic visual vocabulary. We introduce a formal language that allows representing compositional visual concepts based on this vocabulary. Using this language and Bayesian inference, concepts can be induced from the examples that are provided in each problem. We find a reasonable agreement between the concepts with high posterior probability and the solutions formulated by Bongard himself for a subset of 35 problems. While this approach is far from solving Bongard problems like humans, it does considerably better than previous approaches. We discuss the issues we encountered while developing this system and their continuing relevance for understanding visual cognition. For instance, contrary to other concept learning problems, the examples are not random in Bongard problems; instead they are carefully chosen to ensure that the concept can be induced, and we found it helpful to take the resulting pragmatic constraints into account.

Additional Information:

Art.No.: e13432

Divisions: 03 Department of Human Sciences
Forschungsfelder
Forschungsfelder > Information and Intelligence
Forschungsfelder > Information and Intelligence > Cognitive Science
Forschungsfelder > Information and Intelligence > Künstliche Intelligenz
03 Department of Human Sciences > Institute for Psychology
03 Department of Human Sciences > Institute for Psychology > Models of Higher Cognition
03 Department of Human Sciences > Institute for Psychology > Psychology of Information Processing
Zentrale Einrichtungen
Zentrale Einrichtungen > Centre for Cognitive Science (CCS)
Zentrale Einrichtungen > hessian.AI - The Hessian Center for Artificial Intelligence
Date Deposited: 08 May 2024 06:11
Last Modified: 08 May 2024 06:11
PPN:
Export:
Suche nach Titel in: TUfind oder in Google
Send an inquiry Send an inquiry

Options (only for editors)
Show editorial Details Show editorial Details