How do we recognize what one person is saying when others are speaking at the same
time? This review summarizes widespread research in psychoacoustics, auditory scene�…

Humans and other animals can attend to one of multiple sounds and follow it selectively
over time. The neural underpinnings of this perceptual feat remain mysterious. Some studies�…

We present a joint audio-visual model for isolating a single speech signal from a mixture of
sounds such as other speakers and background noise. Solving this task using only audio as�…

The fully updated eighth edition of Cognitive Psychology: A Student's Handbook provides
comprehensive yet accessible coverage of all the key areas in the field ranging from visual�…

We introduce PixelPlayer, a system that, by leveraging large amounts of unlabeled videos,
learns to locate image regions which produce sounds and separate the input sounds into a�…

Recent deep learning approaches have achieved impressive performance on visual sound
separation tasks. However, these approaches are mostly built on appearance and optical�…

Sounds originate from object motions and vibrations of surrounding air. Inspired by the fact
that humans is capable of interpreting sound sources from how objects move visually, we�…

During speech perception, a central task of the auditory cortex is to analyze complex
acoustic patterns to allow detection of the words that encode a linguistic message [1]. It is�…

Humans can easily perceive the direction of sound sources in a visual scene, termed sound
source localization. Recent studies on learning-based sound source localization have�…

Making a successful video game is hard. Even games that are well-received at launch may
fail to engage players in the long term due to issues with the user experience (UX) that they�…