Explicit coding in the brain: data-driven semantic analysis of human fMRI BOLD responses with Formal Concept Analysis
-
1
HIH, CIN, BCCN and University of Tübingen, Section of Computational Sensomotorics, Dept. Cognitive Neurology, Germany
-
2
Max Planck Institute for Biological Cybernetics, Germany
Understanding how semantic information is represented in the brain has been an important research focus of neuroscience in the past few years. We showed previously (Endres et al 2010) that Formal Concept Analysis (FCA, (Ganter and Wille 1999)) can reveal interpretable semantic information (e.g. specialization hierarchies, or feature-based representation) from electrophysiological data. Unlike other analysis methods (e.g. hierarchical clustering), FCA does not impose inappropriate structure on the data. FCA is a mathematical formalism compatible with the explicit coding hypothesis (Foldiak, 2009)
Here, we investigate whether similar findings can be obtained from fMRI BOLD responses recorded from human subjects. While the BOLD response provides only an indirect measure of neural activity on a much coarser spatio-temporal scale than electrophysiological recordings, it has the advantage that it can be recorded from humans, which can be questioned about their perceptions during the experiment, thereby obviating the need of interpreting animal behavioural responses. Furthermore, the BOLD signal can be recorded from the whole brain simultaneously.
In our experiment, a single human subject was scanned while viewing 72 grayscale pictures of animate and inanimate objects in a target detection task (Siemens Trio 3T scanner, GE-EPI, TE=40ms, 38 axial slices, TR=3.08s, 48 sessions, amounting to a total of 10,176 volume images). These pictures comprise the formal objects for FCA. We computed formal attributes by learning a hierarchical Bayesian classifier, which maps BOLD responses onto binary features, and these features onto object labels. The connectivity matrix between the binary features and the object labels can then serve as the formal context.
In line with previous reports, FCA revealed a clear dissociation between animate and inanimate objects in a high-level visual area (inferior temporal cortex, IT), with the inanimate category including plants. The inanimate category was subdivided into plants and non-plants when we increased the number of attributes extracted from the fMRI responses. FCA also highlighted organizational differences between the IT and the primary visual cortex, V1. We show that subjective familiarity and similarity ratings are strongly correlated with the attribute structure computed from the fMRI signal.
Acknowledgements
This work was supported by: BMBF FKZ: 01GQ1002, EC FP7-ICT grants TANGO 249858, AMARSi 248311, DFG GI 305/4-1, DFG GZ: KA 1258/15-1 and the Max-Planck Society.
Keywords:
categorical organization,
explicit coding,
fMRI,
Formal Concept Analysis,
semantics
Conference:
Bernstein Conference 2012, Munich, Germany, 12 Sep - 14 Sep, 2012.
Presentation Type:
Poster
Topic:
Neural encoding and decoding
Citation:
Endres
D,
Adam
R,
Noppeney
U and
Giese
MA
(2012). Explicit coding in the brain: data-driven semantic analysis of human fMRI BOLD responses with Formal Concept Analysis.
Front. Comput. Neurosci.
Conference Abstract:
Bernstein Conference 2012.
doi: 10.3389/conf.fncom.2012.55.00056
Copyright:
The abstracts in this collection have not been subject to any Frontiers peer review or checks, and are not endorsed by Frontiers.
They are made available through the Frontiers publishing platform as a service to conference organizers and presenters.
The copyright in the individual abstracts is owned by the author of each abstract or his/her employer unless otherwise stated.
Each abstract, as well as the collection of abstracts, are published under a Creative Commons CC-BY 4.0 (attribution) licence (https://creativecommons.org/licenses/by/4.0/) and may thus be reproduced, translated, adapted and be the subject of derivative works provided the authors and Frontiers are attributed.
For Frontiers’ terms and conditions please see https://www.frontiersin.org/legal/terms-and-conditions.
Received:
25 May 2012;
Published Online:
12 Sep 2012.
*
Correspondence:
Dr. Dominik Endres, HIH, CIN, BCCN and University of Tübingen, Section of Computational Sensomotorics, Dept. Cognitive Neurology, Tübingen, 72076, Germany, dominik.endres@uni-marburg.de
Dr. Ruth Adam, Max Planck Institute for Biological Cybernetics, Tübingen, 72076, Germany, Ruth.Adam@Tuebingen.MPG.de