Search

Your search keyword '"Nadeu, Climent"' showing total 149 results
Start Over Author "Nadeu, Climent"
149 results on '"Nadeu, Climent"'

1. Sound-to-Imagination: An Exploratory Study on Unsupervised Crossmodal Translation Using Diverse Audiovisual Data

Author

Fanzeres, Leonardo A. and Nadeu, Climent

Subjects
Computer Science - Sound, Computer Science - Graphics, Computer Science - Multimedia, Electrical Engineering and Systems Science - Audio and Speech Processing, Electrical Engineering and Systems Science - Image and Video Processing, 68T07, 68T20, 68T45, H.5.1, H.5.5, I.4.5, I.5.4
Abstract

The motivation of our research is to explore the possibilities of automatic sound-to-image (S2I) translation for enabling a human receiver to visually infer the occurrence of sound related events. We expect the computer to 'imagine' the scene from the captured sound, generating original images that picture the sound emitting source. Previous studies on similar topics opted for simplified approaches using data with low content diversity and/or sound class supervision. Differently, we propose to perform unsupervised S2I translation using thousands of distinct and unknown scenes, with slightly pre-cleaned data, just enough to guarantee aural-visual semantic coherence. To that end, we employ conditional generative adversarial networks (GANs) with a deep densely connected generator. Additionally, we present a solution using informativity classifiers to perform quantitative evaluation of the generated images. This enabled us to analyze the influence of network bottleneck variation over the translation, observing a potential trade-off between informativity and pixel space convergence. Despite the complexity of the specified S2I translation task, we were able to generalize the model enough to obtain more than 14%, in average, of interpretable and semantically coherent images translated from unknown sounds., Comment: Title changed. Added references. Overall revision of text, results unchanged. Figure 6 updated

Published
2021

3. Joint model-based recognition and localization of overlapped acoustic events using a set of distributed small microphone arrays

Author

Chakraborty, Rupayan and Nadeu, Climent

Subjects
Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing
Abstract

In the analysis of acoustic scenes, often the occurring sounds have to be detected in time, recognized, and localized in space. Usually, each of these tasks is done separately. In this paper, a model-based approach to jointly carry them out for the case of multiple simultaneous sources is presented and tested. The recognized event classes and their respective room positions are obtained with a single system that maximizes the combination of a large set of scores, each one resulting from a different acoustic event model and a different beamformer output signal, which comes from one of several arbitrarily-located small microphone arrays. By using a two-step method, the experimental work for a specific scenario consisting of meeting-room acoustic events, either isolated or overlapped with speech, is reported. Tests carried out with two datasets show the advantage of the proposed approach with respect to some usual techniques, and that the inclusion of estimated priors brings a further performance improvement., Comment: Computational acoustic scene analysis, microphone array signal processing, acoustic event detection

Published
2017

4. Automatic detection of alarm sounds in a noisy hospital environment using model and non-model based approaches

Author

Raboshchuk, Ganna, Quintana, Sergi Gómez, Lilja, Alex Peiró, and Nadeu, Climent

Subjects
Electrical Engineering and Systems Science - Audio and Speech Processing, Computer Science - Sound
Abstract

In the noisy acoustic environment of a Neonatal Intensive Care Unit (NICU) there is a variety of alarms, which are frequently triggered by the biomedical equipment. In this paper different approaches for automatic detection of those sound alarms are presented and compared: 1) a non-model-based approach that employs signal processing techniques; 2) a model-based approach based on neural networks; and 3) an approach that combines both non-model and model-based approaches. The performance of the developed detection systems that follow each of those approaches is assessed, analysed and compared both at the frame level and at the event level by using an audio database recorded in a real-world hospital environment.

Published
2017

8. Acoustic Event Detection and Classification

Author

Temko, Andrey, Nadeu, Climent, Macho, Dušan, Malkin, Robert, Zieger, Christian, Omologo, Maurizio, Karat, John, editor, Vanderdonckt, Jean, editor, Waibel, Alexander, editor, and Stiefelhagen, Rainer, editor

Published
2009
Full Text
View/download PDF

9. Automatic Speech Recognition

Author

Potamianos, Gerasimos, Lamel, Lori, Wölfel, Matthias, Huang, Jing, Marcheret, Etienne, Barras, Claude, Zhu, Xuan, McDonough, John, Hernando, Javier, Macho, Dusan, Nadeu, Climent, Karat, John, editor, Vanderdonckt, Jean, editor, Waibel, Alexander, editor, and Stiefelhagen, Rainer, editor

Published
2009
Full Text
View/download PDF

10. Acoustic Event Detection: SVM-Based System and Evaluation Setup in CLEAR’07

Author

Temko, Andrey, Nadeu, Climent, Biel, Joan-Isaac, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Stiefelhagen, Rainer, editor, Bowers, Rachel, editor, and Fiscus, Jonathan, editor

Published
2008
Full Text
View/download PDF

11. Inclusion of Video Information for Detection of Acoustic Events Using the Fuzzy Integral

Author

Butko, Taras, Temko, Andrey, Nadeu, Climent, Canton, Cristian, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Popescu-Belis, Andrei, editor, and Stiefelhagen, Rainer, editor

Published
2008
Full Text
View/download PDF

12. CLEAR Evaluation of Acoustic Event Detection and Classification Systems

Author

Temko, Andrey, Malkin, Robert, Zieger, Christian, Macho, Dušan, Nadeu, Climent, Omologo, Maurizio, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Rangan, C. Pandu, editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Stiefelhagen, Rainer, editor, and Garofolo, John, editor

Published
2007
Full Text
View/download PDF

13. UPC Audio, Video and Multimodal Person Tracking Systems in the Clear Evaluation Campaign

Author

Abad, Alberto, Canton-Ferrer, Cristian, Segura, Carlos, Landabaso, José Luis, Macho, Dušan, Casas, Josep Ramon, Hernando, Javier, Pardàs, Montse, Nadeu, Climent, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Rangan, C. Pandu, editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Doug, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Stiefelhagen, Rainer, editor, and Garofolo, John, editor

Published
2007
Full Text
View/download PDF

14. Robust Speech Activity Detection in Interactive Smart-Room Environments

Author

Macho, Dušan, Nadeu, Climent, Temko, Andrey, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Dough, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Renals, Steve, editor, Bengio, Samy, editor, and Fiscus, Jonathan G., editor

Published
2006
Full Text
View/download PDF

15. Improving the Performance of Acoustic Event Classification by Selecting and Combining Information Sources Using the Fuzzy Integral

Author

Temko, Andrey, Macho, Dušan, Nadeu, Climent, Hutchison, David, Series editor, Kanade, Takeo, Series editor, Kittler, Josef, Series editor, Kleinberg, Jon M., Series editor, Mattern, Friedemann, Series editor, Mitchell, John C., Series editor, Naor, Moni, Series editor, Nierstrasz, Oscar, Series editor, Pandu Rangan, C., Series editor, Steffen, Bernhard, Series editor, Sudan, Madhu, Series editor, Terzopoulos, Demetri, Series editor, Tygar, Dough, Series editor, Vardi, Moshe Y., Series editor, Weikum, Gerhard, Series editor, Renals, Steve, editor, and Bengio, Samy, editor

Published
2006
Full Text
View/download PDF

16. A Speech-to-Speech Translation System for Catalan, Spanish, and English

Author

Arranz, Victoria, Comelles, Elisabet, Farwell, David, Nadeu, Climent, Padrell, Jaume, Febrer, Albert, Alexander, Dorcas, Peterson, Kay, Hutchison, David, editor, Kanade, Takeo, editor, Kittler, Josef, editor, Kleinberg, Jon M., editor, Mattern, Friedemann, editor, Mitchell, John C., editor, Naor, Moni, editor, Nierstrasz, Oscar, editor, Pandu Rangan, C., editor, Steffen, Bernhard, editor, Sudan, Madhu, editor, Terzopoulos, Demetri, editor, Tygar, Dough, editor, Vardi, Moshe Y., editor, Weikum, Gerhard, editor, Carbonell, Jaime G., editor, Siekmann, Jörg, editor, Frederking, Robert E., editor, and Taylor, Kathryn B., editor

Published
2004
Full Text
View/download PDF

25. Pitch- and Formant-Based Order Adaptation of the Fractional Fourier Transform and Its Application to Speech Recognition

Author

Yin Hui, Nadeu Climent, and Hohmann Volker

Subjects
Acoustics. Sound, QC221-246, Electronic computers. Computer science, QA75.5-76.95
Abstract

Fractional Fourier transform (FrFT) has been proposed to improve the time-frequency resolution in signal analysis and processing. However, selecting the FrFT transform order for the proper analysis of multicomponent signals like speech is still debated. In this work, we investigated several order adaptation methods. Firstly, FFT- and FrFT- based spectrograms of an artificially-generated vowel are compared to demonstrate the methods. Secondly, an acoustic feature set combining MFCC and FrFT is proposed, and the transform orders for the FrFT are adaptively set according to various methods based on pitch and formants. A tonal vowel discrimination test is designed to compare the performance of these methods using the feature set. The results show that the FrFT-MFCC yields a better discriminability of tones and also of vowels, especially by using multitransform-order methods. Thirdly, speech recognition experiments were conducted on the clean intervocalic English consonants provided by the Consonant Challenge. Experimental results show that the proposed features with different order adaptation methods can obtain slightly higher recognition rates compared to the reference MFCC-based recognizer.

Published
2009

Catalog

Books, media, physical & digital resources
See catalog results