Tuesday, March 28, 2017

Listening with eyes! Interview with John Magnotti on deciphering McGurk effect!!

We all have tried to lip-read when we can't hear properly. We try to use visual cues to listen when the audio cue is missing or of bad quality. But did you know that our brain tries to use visual cues even when we can hear nicely. And if the two cues are not in sync, we can get confused. In-fact, we might 'hear' a different sound than what is falling on our ears! Our eyes change our audio perceptions! 

Have a look here:


John and colleagues wanted to understand why the effect occurs. And to do so, they generated a computational model which used an audio and visual cue to predict its perception. They found that an important step in correct perception is deciding if the cue arrives from one or two sources. Knowing the number of origins improves understanding. To know more, please listen to John.


To know more, please refer to:
A Causal Inference Model Explains Perception of the McGurk Effect and Other Incongruent Audiovisual Speech
Magnotti and Beauchamp.  PLoS Comput Biol 2017

No comments:

Post a Comment