Modality-Specific Training in Audio-Visual Speech Integration

Thumbnail Image



Journal Title

Journal ISSN

Volume Title


The Ohio State University

Research Projects

Organizational Units

Journal Issue


Listeners integrate auditory and visual signals to understand speech in both compromised and normal listening environments. This integration appears to be a process independent of the ability to process auditory-only or visual- only speech cues (Grant & Seitz, 1998). Training with auditory-only stimuli does not seem to generalize to the audio-visual condition (James, 2009); nor does audio-visual training produce improvements in auditory-only perception. Because skill in all three modalities is important in speech perception by hearing impaired persons, the question remains whether audio-visual integration would improve if training in all three modalities were provided. In the present study, five listeners received ten training sessions that included auditory-only, visual-only and audio-visual stimuli. The auditory component of these speech stimuli was degraded in a similar method to Shannon et al. (1995). Results showed that subjects improved in all conditions; however, different measures of audio-visual integration yielded conflicting indications of integration improvement. These results suggest that stimulus selection plays an important role in training to improve audio-visual integration in aural rehabilitation programs.



speech perception, audio-visual, aural rehabilitation