Back to Search
Start Over
Improving Sound Event Detection Metrics: Insights from DCASE 2020
Improving Sound Event Detection Metrics: Insights from DCASE 2020
- Source :
- ICASSP, ICASSP 2021-46th International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021-46th International Conference on Acoustics, Speech, and Signal Processing, Jun 2021, Toronto/Virtual, Canada. ⟨10.1109/ICASSP39728.2021.9414711⟩
- Publication Year :
- 2020
-
Abstract
- International audience; The ranking of sound event detection (SED) systems may be biased by assumptions inherent to evaluation criteria and to the choice of an operating point. This paper compares conventional event-based and segment-based criteria against the Polyphonic Sound Detection Score (PSDS)'s intersection-based criterion, over a selection of systems from DCASE 2020 Challenge Task 4. It shows that, by relying on collars , the conventional event-based criterion introduces different strictness levels depending on the length of the sound events, and that the segment-based criterion may lack precision and be application dependent. Alternatively, PSDS's intersection-based criterion overcomes the dependency of the evaluation on sound event duration and provides robustness to labelling subjectivity, by allowing valid detections of interrupted events. Furthermore, PSDS enhances the comparison of SED systems by measuring sound event modelling performance independently from the systems' operating points.
- Subjects :
- FOS: Computer and information sciences
Sound (cs.SD)
Dependency (UML)
Computer science
02 engineering and technology
computer.software_genre
Computer Science - Sound
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]
Audio and Speech Processing (eess.AS)
Robustness (computer science)
FOS: Electrical engineering, electronic engineering, information engineering
0202 electrical engineering, electronic engineering, information engineering
Event (probability theory)
Operating point
Signal processing
Intersection (set theory)
Sound detection
segment vs event criteria
sound event detection
evaluation metrics
Ranking
[INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD]
020201 artificial intelligence & image processing
Data mining
[SPI.SIGNAL]Engineering Sciences [physics]/Signal and Image processing
computer
polyphonic sound detection score
Electrical Engineering and Systems Science - Audio and Speech Processing
Subjects
Details
- Language :
- English
- Database :
- OpenAIRE
- Journal :
- ICASSP, ICASSP 2021-46th International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021-46th International Conference on Acoustics, Speech, and Signal Processing, Jun 2021, Toronto/Virtual, Canada. ⟨10.1109/ICASSP39728.2021.9414711⟩
- Accession number :
- edsair.doi.dedup.....985220cd46b912f9d1043fc67c45e474
- Full Text :
- https://doi.org/10.1109/ICASSP39728.2021.9414711⟩