Description

The WSJ0 Hipster Ambient Mixtures (WHAM!) dataset pairs each two-speaker mixture in the wsj0-2mix dataset with a unique noise background scene.

The noise audio was collected at various urban locations throughout the San Francisco Bay Area in late 2018. The environments primarily consist of restaurants, cafes, bars, and parks. Audio was recorded using an Apogee Sennheiser binaural microphone on a tripod between 1.0 and 1.5 meters off the ground.

The set of noise samples, referred to as "WHAM! noise dataset", is provided here, along with the scripts to build the WHAM! dataset from the noise data and the WSJ0 dataset.

This work is further described in our paper "WHAM!: Extending Speech Separation to Noisy Environments."

Download

The WHAM! noise dataset and Python scripts for generation are available for download:

Building the Dataset

The WHAM! dataset is built by mixing 2-speaker mixtures from the wsj0-2mix dataset with noise samples from the WHAM! noise dataset. Only the noise data is provided here, and users will need access (and license) to the WSJ0 dataset.

Please refer to the README for detailed instructions on how to use the mixing scripts, which can be downloaded using the link above.

Dataset Structure

The WHAM! noise dataset is split into training, validation, and test sets following the wsj0-2mix dataset.

Split Directory Duration (hr) No. of files
Training tr 58.03 20,000
Validation cv 14.65 5000
Test tt 9.00 3000

The clips are in 32-bit floating point WAV format with 2 channels and a sampling rate of 16 kHz. The average clip duration is 10 seconds with the shortest clip being 3.5 seconds and the longest 47.7 seconds.

Citation

WHAM! is a joint effort between Mitsubishi Electronics Research Laboratories (MERL) and Whisper. If you use WHAM! please cite our paper describing the dataset:

@inproceedings{Wichern2019WHAM,
    title     = {WHAM!: Extending Speech Separation to Noisy Environments},
    author    = {Wichern, Gordon and Antognini, Joe and Flynn, Michael and Zhu,
                 Licheng Richard and McQuinn, Emmett and Crow,
                 Dwight and Manilow, Ethan and Le Roux, Jonathan},
    booktitle = {Proc. Interspeech},
    year      = {2019},
    month     = sep
}

License

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.