Predictive Coding: How the Human Brain Uses Context to Facilitate the Perception of Degraded Speech

Abstract

The most common and natural human behaviours are often the most computationally difficult to understand. This is especially true of spoken language comprehension considering the acoustic ambiguities inherent in a speech stream, and that these ambiguities are exacerbated by the noisy and distracting listening conditions of everyday life. Nonetheless, the human brain is capable of rapidly and reliably processing speech in these situations with deceptive ease – a feat that remains unrivaled by state-of-the-art speech recognition technologies. It has long been known that supportive context facilitates robust speech perception, but it remains unclear how the brain integrates contextual information with an acoustically degraded speech signal. The four studies in this dissertation utilize behavioural and functional magnetic resonance imaging (fMRI) methods to examine how the normally functioning human brain uses context to support the perception of degraded speech. First, I have observed that text presented simultaneously with distorted sentences results in an illusory experience of perceptually clearer speech, and that this illusion depends on the amount of distortion in the bottom-up signal, and on the relative timing between the visual and auditory stimuli. Second, fMRI data indicate that activity in the earliest region of primary auditory cortex is sensitive to the perceived clarity of speech, and that this modulation of activity likely comes from left frontal cortical regions that probably support higher-order linguistic processes. Third, conscious awareness of the visual stimulus appears to be necessary to increase the intelligibility of degraded speech, and thus attention might also be required for multisensory integration. Finally, I have demonstrated that attention greatly enhances the processing of degraded speech, and this enhancement is (again) supported by the recruitment of higher-order cortical areas. The results of these studies provide converging evidence that brain uses prior knowledge to actively predict the form of a degraded auditory signal, and that these predictions are projected through feedback connections from higher- to lower-order order areas. These findings are consistent with a predictive coding model of perception, which provides an elegant mechanism in which accurate interpretations of the environment are constructed from ambiguous inputs in way that is flexible and task dependent.