Slow-Fast Auditory Streams For Audio Recognition
Abstract
We propose a two-stream convolutional network for audio recognition, that operates on time-frequency spectrogram inputs. Following similar success in visual recognition, we learn Slow-Fast auditory streams with separable convolutions and multi-level lateral connections. The Slow pathway has high channel capacity while the Fast pathway operates at a fine-grained temporal resolution. We showcase the importance of our two-stream proposal on two diverse datasets: VGG-Sound and EPIC-KITCHENS-100, and achieve state-of-the-art results on both.
- Publication:
-
arXiv e-prints
- Pub Date:
- March 2021
- DOI:
- 10.48550/arXiv.2103.03516
- arXiv:
- arXiv:2103.03516
- Bibcode:
- 2021arXiv210303516K
- Keywords:
-
- Computer Science - Sound;
- Computer Science - Computer Vision and Pattern Recognition;
- Electrical Engineering and Systems Science - Audio and Speech Processing
- E-Print:
- Accepted for presentation at ICASSP 2021