1
Return

Conformer-enhanced hybrid neural architectures for sound event detection in driving scenarios

delete2026-08-03
delete0
delete
OA
AI
M
Mohammad Moghimi *
P
Patrick Healy
F
Francesc J. Ferri
DOI:10.1007/s00521-026-12334-2delete
deleteOriginal
deleteOriginal request for help
deleteShare
deleteSave
Abstract

Abstract

En 中文
The increasing adoption of smart vehicles demands safety systems capable of detecting critical acoustic events–such as emergency sirens, tires skidding, and car crashes–in dynamic driving environments. This paper studies a task-specific architectural refinement of a hybrid framework for sound event detection in driving scenarios by replacing the recurrent neck with compact Conformer blocks while retaining CNN, BEATs, and ATST-Frame feature pathways. The motivation is to improve temporal modeling by combining self-attention for broader context with convolution for local acoustic detail. Building on prior work using Convolutional Recurrent Neural Networks (CRNNs) and pre-trained models such as BEATs and ATST-Frame, we introduce Conformer blocks to better capture both global and local acoustic patterns, addressing challenges such as overlapping sounds and noisy conditions. Our approach leverages a dataset of 19,000 audio clips tailored for driving scenarios, augmented with techniques such as mixup and SpecAugment to improve training stability. The architecture fuses features from three parallel pathways through concatenation and projection, with Conformer blocks processing the unified representation to capture multi-scale acoustic characteristics. Experimental results show that the proposed Conformer-integrated hybrid model outperforms the directly comparable CRNN-based baselines considered on this benchmark, achieving a Polyphonic Sound Detection Score (PSDS) of 47.3 and an F1 score of 65.7, demonstrating improved detection of complex acoustic events within the evaluated benchmark. These results support the potential of Conformer-based architectures for sound event detection in smart-vehicle settings.
Keywords:
Sound event detection
Smart vehicles
Driver safety
Audio Teacher-Student Transformer Frame-level (ATST-Frame)
BEATs
Conformer block

Journal

Neural Computing and Applications cover
Neural Computing and Applications
IF:
4.5
Papers:
729
Citations:
3.2W

Organization

D
department of computer science
Scholars:
547
Papers: 287
Citations: 0
Cited Papers

Cited Papers

Citing Papers

Citing Papers