Search

Your search keyword '"Serafin, Stefania"' showing total 630 results
Start Over Author "Serafin, Stefania"
630 results on '"Serafin, Stefania"'

3. Reimagining Speech: A Scoping Review of Deep Learning-Powered Voice Conversion

Author

Bargum, Anders R., Serafin, Stefania, and Erkut, Cumhur

Subjects
Computer Science - Sound, Computer Science - Artificial Intelligence, Electrical Engineering and Systems Science - Audio and Speech Processing
Abstract

Research on deep learning-powered voice conversion (VC) in speech-to-speech scenarios is getting increasingly popular. Although many of the works in the field of voice conversion share a common global pipeline, there is a considerable diversity in the underlying structures, methods, and neural sub-blocks used across research efforts. Thus, obtaining a comprehensive understanding of the reasons behind the choice of the different methods in the voice conversion pipeline can be challenging, and the actual hurdles in the proposed solutions are often unclear. To shed light on these aspects, this paper presents a scoping review that explores the use of deep learning in speech analysis, synthesis, and disentangled speech representation learning within modern voice conversion systems. We screened 621 publications from more than 38 different venues between the years 2017 and 2023, followed by an in-depth review of a final database consisting of 123 eligible studies. Based on the review, we summarise the most frequently used approaches to voice conversion based on deep learning and highlight common pitfalls within the community. Lastly, we condense the knowledge gathered, identify main challenges and provide recommendations for future research directions.

Published
2023

4. Differentiable Allpass Filters for Phase Response Estimation and Automatic Signal Alignment

Author

Bargum, Anders R., Serafin, Stefania, Erkut, Cumhur, and Parker, Julian D.

Subjects
Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing
Abstract

Virtual analog (VA) audio effects are increasingly based on neural networks and deep learning frameworks. Due to the underlying black-box methodology, a successful model will learn to approximate the data it is presented, including potential errors such as latency and audio dropouts as well as non-linear characteristics and frequency-dependent phase shifts produced by the hardware. The latter is of particular interest as the learned phase-response might cause unwanted audible artifacts when the effect is used for creative processing techniques such as dry-wet mixing or parallel compression. To overcome these artifacts we propose differentiable signal processing tools and deep optimization structures for automatically tuning all-pass filters to predict the phase response of different VA simulations, and align processed signals that are out of phase. The approaches are assessed using objective metrics while listening tests evaluate their ability to enhance the quality of parallel path processing techniques. Ultimately, an over-parameterized, BiasNet-based, all-pass model is proposed for the optimization problem under consideration, resulting in models that can estimate all-pass filter coefficients to align a dry signal with its affected, wet, equivalent., Comment: Collaboration done while interning/employed at Native Instruments. Accepted for publication in Proc. DAFX'23, Copenhagen, Denmark, September 2023. Sound examples at https://abargum.github.io v2: 10 pages, LaTeX; figures resized, pdf optimized

Published
2023

7. Theory of Banded Waveguides

Author

Essl, Georg, Serafin, Stefania, Cook, Perry R, and Smith, Julius O. (Julius Orion)

Published
2004

9. Touching the Untouchable: Playing the Virtual Glass Harmonica

Author

Pedersen, Astrid, Jørgensen, Morten, Serafin, Stefania, Akan, Ozgur, Editorial Board Member, Bellavista, Paolo, Editorial Board Member, Cao, Jiannong, Editorial Board Member, Coulson, Geoffrey, Editorial Board Member, Dressler, Falko, Editorial Board Member, Ferrari, Domenico, Editorial Board Member, Gerla, Mario, Editorial Board Member, Kobayashi, Hisashi, Editorial Board Member, Palazzo, Sergio, Editorial Board Member, Sahni, Sartaj, Editorial Board Member, Shen, Xuemin, Editorial Board Member, Stan, Mircea, Editorial Board Member, Jia, Xiaohua, Editorial Board Member, Zomaya, Albert Y., Editorial Board Member, and Brooks, Anthony L., editor

Published
2024
Full Text
View/download PDF

11. Sonic Interactions in Virtual Environments: the Egocentric Audio Perspective of the Digital Twin

Author

Geronazzo, Michele and Serafin, Stefania

Subjects
Computer Science - Human-Computer Interaction, Computer Science - Artificial Intelligence, Computer Science - Multimedia, Computer Science - Sound, Electrical Engineering and Systems Science - Audio and Speech Processing, H.1.2, H.5.5, I.6.4
Abstract

The relationships between the listener, physical world and virtual environment (VE) should not only inspire the design of natural multimodal interfaces but should be discovered to make sense of the mediating action of VR technologies. This chapter aims to transform an archipelago of studies related to sonic interactions in virtual environments (SIVE) into a research field equipped with a first theoretical framework with an inclusive vision of the challenges to come: the egocentric perspective of the auditory digital twin. In a VE with immersive audio technologies implemented, the role of VR simulations must be enacted by a participatory exploration of sense-making in a network of human and non-human agents, called actors. The guardian of such locus of agency is the auditory digital twin that fosters intra-actions between humans and technology, dynamically and fluidly redefining all those configurations that are crucial for an immersive and coherent experience. The idea of entanglement theory is here mainly declined in an egocentric-spatial perspective related to emerging knowledge of the listener's perceptual capabilities. This is an actively transformative relation with the digital twin potentials to create movement, transparency, and provocative activities in VEs. The chapter contains an original theoretical perspective complemented by several bibliographical references and links to the other book chapters that have contributed significantly to the proposal presented here., Comment: 46 pages, 5 figures. Pre-print version of the introduction to the book "Sonic Interactions in Virtual Environments" in press for Springer's Human-Computer Interaction Series, Open Access license. The pre-print editors' copy of the book can be found at https://vbn.aau.dk/en/publications/sonic-interactions-in-virtual-environments - full book info: https://sive.create.aau.dk/index.php/sivebook/

Published
2022

12. Spatial Audio Mixing in Virtual Reality

Author

Riddershom Bargum, Anders, Ingi Kristjánsson, Oddur, Babó, Péter, Eske Waage Nielsen, Rasmus, Rostami Mosen, Simon, Serafin, Stefania, Vanderdonckt, Jean, Editor-in-Chief, Liao, Q. Vera, Editor-in-Chief, Barbosa, Simone, Editorial Board Member, Bernhaupt, Regina, Editorial Board Member, Blagojevic, Rachel, Editorial Board Member, Bunt, Andrea, Editorial Board Member, Cao, Xiang, Editorial Board Member, Carroll, John M., Editorial Board Member, Cherubini, Mauro, Editorial Board Member, de Choudhury, Munmun, Editorial Board Member, Cockton, Gilbert, Editorial Board Member, Dragicevic, Pierre, Editorial Board Member, Duh, Henry Been-Lirn, Editorial Board Member, Feiner, Steven, Editorial Board Member, Fussell, Susan, Editorial Board Member, González-Calleros, Juan, Editorial Board Member, Jacob, Robert, Editorial Board Member, Jorge, Joaquim, Editorial Board Member, Kuflik, Tsvika, Editorial Board Member, Kumar, Ranjitha, Editorial Board Member, Lazar, Jonathan, Editorial Board Member, Lim, Youn-kyung, Editorial Board Member, Markopoulos, Panos, Editorial Board Member, Myers, Brad A., Editorial Board Member, Palanque, Philippe, Editorial Board Member, Schmidt, Albrecht, Editorial Board Member, Schnädelbach, Holger, Editorial Board Member, Seffah, Ahmed, Editorial Board Member, Vatavu, Radu-Daniel, Editorial Board Member, Vetere, Frank, Editorial Board Member, Zhao, Shengdong, Editorial Board Member, Geronazzo, Michele, editor, and Serafin, Stefania, editor

Published
2023
Full Text
View/download PDF

13. Sonic Interactions in Virtual Environments: The Egocentric Audio Perspective of the Digital Twin

Author

Geronazzo, Michele, Serafin, Stefania, Vanderdonckt, Jean, Editor-in-Chief, Liao, Q. Vera, Editor-in-Chief, Barbosa, Simone, Editorial Board Member, Bernhaupt, Regina, Editorial Board Member, Blagojevic, Rachel, Editorial Board Member, Bunt, Andrea, Editorial Board Member, Cao, Xiang, Editorial Board Member, Carroll, John M., Editorial Board Member, Cherubini, Mauro, Editorial Board Member, de Choudhury, Munmun, Editorial Board Member, Cockton, Gilbert, Editorial Board Member, Dragicevic, Pierre, Editorial Board Member, Duh, Henry Been-Lirn, Editorial Board Member, Feiner, Steven, Editorial Board Member, Fussell, Susan, Editorial Board Member, González-Calleros, Juan, Editorial Board Member, Jacob, Robert, Editorial Board Member, Jorge, Joaquim, Editorial Board Member, Kuflik, Tsvika, Editorial Board Member, Kumar, Ranjitha, Editorial Board Member, Lazar, Jonathan, Editorial Board Member, Lim, Youn-kyung, Editorial Board Member, Markopoulos, Panos, Editorial Board Member, Myers, Brad A., Editorial Board Member, Palanque, Philippe, Editorial Board Member, Schmidt, Albrecht, Editorial Board Member, Schnädelbach, Holger, Editorial Board Member, Seffah, Ahmed, Editorial Board Member, Vatavu, Radu-Daniel, Editorial Board Member, Vetere, Frank, Editorial Board Member, Zhao, Shengdong, Editorial Board Member, Geronazzo, Michele, editor, and Serafin, Stefania, editor

Published
2023
Full Text
View/download PDF

14. Audio in Multisensory Interactions: From Experiments to Experiences

Author

Serafin, Stefania, Vanderdonckt, Jean, Editor-in-Chief, Liao, Q. Vera, Editor-in-Chief, Barbosa, Simone, Editorial Board Member, Bernhaupt, Regina, Editorial Board Member, Blagojevic, Rachel, Editorial Board Member, Bunt, Andrea, Editorial Board Member, Cao, Xiang, Editorial Board Member, Carroll, John M., Editorial Board Member, Cherubini, Mauro, Editorial Board Member, de Choudhury, Munmun, Editorial Board Member, Cockton, Gilbert, Editorial Board Member, Dragicevic, Pierre, Editorial Board Member, Duh, Henry Been-Lirn, Editorial Board Member, Feiner, Steven, Editorial Board Member, Fussell, Susan, Editorial Board Member, González-Calleros, Juan, Editorial Board Member, Jacob, Robert, Editorial Board Member, Jorge, Joaquim, Editorial Board Member, Kuflik, Tsvika, Editorial Board Member, Kumar, Ranjitha, Editorial Board Member, Lazar, Jonathan, Editorial Board Member, Lim, Youn-kyung, Editorial Board Member, Markopoulos, Panos, Editorial Board Member, Myers, Brad A., Editorial Board Member, Palanque, Philippe, Editorial Board Member, Schmidt, Albrecht, Editorial Board Member, Schnädelbach, Holger, Editorial Board Member, Seffah, Ahmed, Editorial Board Member, Vatavu, Radu-Daniel, Editorial Board Member, Vetere, Frank, Editorial Board Member, Zhao, Shengdong, Editorial Board Member, Geronazzo, Michele, editor, and Serafin, Stefania, editor

Published
2023
Full Text
View/download PDF

17. The Relationship Between Frequency and Hand Region Actuated

Author

Paisa, Razvan, Nilsson, Niels Christian, Serafin, Stefania, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Saitis, Charalampos, editor, Farkhatdinov, Ildar, editor, and Papetti, Stefano, editor

Published
2022
Full Text
View/download PDF

18. Tickle Tuner - Haptic Smartphone Cover for Cochlear Implant Users’ Musical Training

Author

Ganis, Francesco, Vatti, Marianna, Serafin, Stefania, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Saitis, Charalampos, editor, Farkhatdinov, Ildar, editor, and Papetti, Stefano, editor

Published
2022
Full Text
View/download PDF

20. Spatial Audio Mixing in Virtual Reality

Author

Riddershom Bargum, Anders, primary, Ingi Kristjánsson, Oddur, additional, Babó, Péter, additional, Eske Waage Nielsen, Rasmus, additional, Rostami Mosen, Simon, additional, and Serafin, Stefania, additional

Published
2022
Full Text
View/download PDF

23. Everyday listening

Author

Serafin, Stefania, primary, Buxton, Bill, additional, Gaver, Bill, additional, and Bly, Sara, additional

Published
2022
Full Text
View/download PDF

24. Auditory icons

Author

Serafin, Stefania, primary, Buxton, Bill, additional, Gaver, Bill, additional, and Bly, Sara, additional

Published
2022
Full Text
View/download PDF

25. Earcons

Author

Serafin, Stefania, primary, Buxton, Bill, additional, Gaver, Bill, additional, and Bly, Sara, additional

Published
2022
Full Text
View/download PDF

28. Enhanced neural phase locking through audio-tactile stimulation.

Author

Jagt, Mels, Ganis, Francesco, and Serafin, Stefania

Subjects
AFFERENT pathways, ABSOLUTE pitch, AUDITORY perception, SPEECH, STIMULUS & response (Psychology)
Abstract

Numerous studies have underscored the close relationship between the auditory and vibrotactile modality. For instance, in the peripheral structures of both modalities, afferent nerve fibers synchronize their activity to the external sensory stimulus, thereby providing a temporal code linked to pitch processing. The Frequency Following Response is a neurological measure that captures this phase locking activity in response to auditory stimuli. In our study, we investigated whether this neural signal is influenced by the simultaneous presentation of a vibrotactile stimulus. Accordingly, our findings revealed a significant increase in phase locking to the fundamental frequency of a speech stimulus, while no such effects were observed at harmonic frequencies. Since phase locking to the fundamental frequency has been associated with pitch perceptual capabilities, our results suggests that audio-tactile stimulation might improve pitch perception in human subjects. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

29. Reimagining speech: a scoping review of deep learning-based methods for non-parallel voice conversion.

Author

Bargum, Anders R., Serafin, Stefania, and Erkut, Cumhur

Subjects
SPEECH, DEEP learning, VOICE culture, HUMAN voice, DATABASES
Abstract

Research on deep learning-powered voice conversion (VC) in speech-to-speech scenarios are gaining increasing popularity. Although many of the works in the field of voice conversion share a common global pipeline, there is considerable diversity in the underlying structures, methods, and neural sub-blocks used across research efforts. Thus, obtaining a comprehensive understanding of the reasons behind the choice of the different methods included when training voice conversion models can be challenging, and the actual hurdles in the proposed solutions are often unclear. To shed light on these aspects, this paper presents a scoping review that explores the use of deep learning in speech analysis, synthesis, and disentangled speech representation learning within modern voice conversion systems. We screened 628 publications from more than 38 venues between 2017 and 2023, followed by an in-depth review of a final database of 130 eligible studies. Based on the review, we summarise themost frequently used approaches to voice conversion based on deep learning and highlight common pitfalls. We condense the knowledge gathered to identify main challenges, supply solutions grounded in the analysis and provide recommendations for future research directions. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

31. Singing in Virtual Reality with the Danish National Children’s Choir

Author

Serafin, Stefania, Adjorlu, Ali, Andersen, Lars, Andersen, Nicklas, Goos, Gerhard, Founding Editor, Hartmanis, Juris, Founding Editor, Bertino, Elisa, Editorial Board Member, Gao, Wen, Editorial Board Member, Steffen, Bernhard, Editorial Board Member, Woeginger, Gerhard, Editorial Board Member, Yung, Moti, Editorial Board Member, Kronland-Martinet, Richard, editor, Ystad, Sølvi, editor, and Aramaki, Mitsuko, editor

Published
2021
Full Text
View/download PDF

34. The Reality of Implementing Virtual Reality: A Case Study on the Challenges of Integrating VR-Based Rehabilitation

Author

Høeg, Emil R., Scully, Christian F. R., Bruun-Pedersen, Jon R., Serafin, Stefania, Akan, Ozgur, Editorial Board Member, Bellavista, Paolo, Editorial Board Member, Cao, Jiannong, Editorial Board Member, Coulson, Geoffrey, Editorial Board Member, Dressler, Falko, Editorial Board Member, Ferrari, Domenico, Editorial Board Member, Gerla, Mario, Editorial Board Member, Kobayashi, Hisashi, Editorial Board Member, Palazzo, Sergio, Editorial Board Member, Sahni, Sartaj, Editorial Board Member, Shen, Xuemin (Sherman), Editorial Board Member, Stan, Mircea, Editorial Board Member, Jia, Xiaohua, Editorial Board Member, Zomaya, Albert Y., Editorial Board Member, Brooks, Anthony, editor, and Brooks, Eva Irene, editor

Published
2020
Full Text
View/download PDF

35. Head-Mounted Display-Based Virtual Reality as a Tool to Reduce Disruptive Behavior in a Student Diagnosed with Autism Spectrum Disorder

Author

Adjorlu, Ali, Serafin, Stefania, Akan, Ozgur, Editorial Board Member, Bellavista, Paolo, Editorial Board Member, Cao, Jiannong, Editorial Board Member, Coulson, Geoffrey, Editorial Board Member, Dressler, Falko, Editorial Board Member, Ferrari, Domenico, Editorial Board Member, Gerla, Mario, Editorial Board Member, Kobayashi, Hisashi, Editorial Board Member, Palazzo, Sergio, Editorial Board Member, Sahni, Sartaj, Editorial Board Member, Shen, Xuemin (Sherman), Editorial Board Member, Stan, Mircea, Editorial Board Member, Jia, Xiaohua, Editorial Board Member, Zomaya, Albert Y., Editorial Board Member, Brooks, Anthony, editor, and Brooks, Eva Irene, editor

Published
2020
Full Text
View/download PDF

36. Co-designing a Head-Mounted Display Based Virtual Reality Game to Teach Street-Crossing Skills to Children Diagnosed with Autism Spectrum Disorder

Author

Adjorlu, Ali, Serafin, Stefania, Akan, Ozgur, Editorial Board Member, Bellavista, Paolo, Editorial Board Member, Cao, Jiannong, Editorial Board Member, Coulson, Geoffrey, Editorial Board Member, Dressler, Falko, Editorial Board Member, Ferrari, Domenico, Editorial Board Member, Gerla, Mario, Editorial Board Member, Kobayashi, Hisashi, Editorial Board Member, Palazzo, Sergio, Editorial Board Member, Sahni, Sartaj, Editorial Board Member, Shen, Xuemin (Sherman), Editorial Board Member, Stan, Mircea, Editorial Board Member, Jia, Xiaohua, Editorial Board Member, Zomaya, Albert Y., Editorial Board Member, Brooks, Anthony, editor, and Brooks, Eva Irene, editor

Published
2020
Full Text
View/download PDF

37. Co-creating Virtual Reality Applications for Motor Rehabilitation with Physiotherapists

Author

Høeg, Emil Rosenlund, Becermen, Begüm, Bruun-Pedersen, Jon Ram, Serafin, Stefania, Akan, Ozgur, Editorial Board Member, Bellavista, Paolo, Editorial Board Member, Cao, Jiannong, Editorial Board Member, Coulson, Geoffrey, Editorial Board Member, Dressler, Falko, Editorial Board Member, Ferrari, Domenico, Editorial Board Member, Gerla, Mario, Editorial Board Member, Kobayashi, Hisashi, Editorial Board Member, Palazzo, Sergio, Editorial Board Member, Sahni, Sartaj, Editorial Board Member, Shen, Xuemin (Sherman), Editorial Board Member, Stan, Mircea, Editorial Board Member, Jia, Xiaohua, Editorial Board Member, Zomaya, Albert Y., Editorial Board Member, Brooks, Anthony, editor, and Brooks, Eva Irene, editor

Published
2020
Full Text
View/download PDF

41. What Is It Like to Be a Virtual Bat?

Author

Andreasen, Anastassia, Nilsson, Niels Christian, Zovnercuka, Jelizaveta, Geronazzo, Michele, Serafin, Stefania, Akan, Ozgur, Series Editor, Bellavista, Paolo, Series Editor, Cao, Jiannong, Series Editor, Coulson, Geoffrey, Series Editor, Dressler, Falko, Series Editor, Ferrari, Domenico, Series Editor, Gerla, Mario, Series Editor, Kobayashi, Hisashi, Series Editor, Palazzo, Sergio, Series Editor, Sahni, Sartaj, Series Editor, Shen, Xuemin (Sherman), Series Editor, Stan, Mircea, Series Editor, Xiaohua, Jia, Series Editor, Zomaya, Albert Y., Series Editor, Brooks, Anthony L., editor, Brooks, Eva, editor, and Sylla, Cristina, editor

Published
2019
Full Text
View/download PDF

42. Head-Mounted Display-Based Virtual Reality as a Tool to Teach Money Skills to Adolescents Diagnosed with Autism Spectrum Disorder

Author

Adjorlu, Ali, Serafin, Stefania, Akan, Ozgur, Series Editor, Bellavista, Paolo, Series Editor, Cao, Jiannong, Series Editor, Coulson, Geoffrey, Series Editor, Dressler, Falko, Series Editor, Ferrari, Domenico, Series Editor, Gerla, Mario, Series Editor, Kobayashi, Hisashi, Series Editor, Palazzo, Sergio, Series Editor, Sahni, Sartaj, Series Editor, Shen, Xuemin (Sherman), Series Editor, Stan, Mircea, Series Editor, Xiaohua, Jia, Series Editor, Zomaya, Albert Y., Series Editor, Brooks, Anthony L., editor, Brooks, Eva, editor, and Sylla, Cristina, editor

Published
2019
Full Text
View/download PDF

43. Spatial Asynchronous Visuo-Tactile Stimuli Influence Ownership of Virtual Wings

Author

Andreasen, Anastassia, Nilsson, Niels Christian, Serafin, Stefania, Akan, Ozgur, Series Editor, Bellavista, Paolo, Series Editor, Cao, Jiannong, Series Editor, Coulson, Geoffrey, Series Editor, Dressler, Falko, Series Editor, Ferrari, Domenico, Series Editor, Gerla, Mario, Series Editor, Kobayashi, Hisashi, Series Editor, Palazzo, Sergio, Series Editor, Sahni, Sartaj, Series Editor, Shen, Xuemin (Sherman), Series Editor, Stan, Mircea, Series Editor, Xiaohua, Jia, Series Editor, Zomaya, Albert Y., Series Editor, Brooks, Anthony L., editor, Brooks, Eva, editor, and Sylla, Cristina, editor

Published
2019
Full Text
View/download PDF

45. The Effect of Multimodal Feedback on Perceived Exertion on a VR Exercise Setting

Author

Bruun-Pedersen, Jon Ram, Andersen, Morten G., Clemmensen, Mathias M., Didriksen, Mads K., Wittendorff, Emil J., Serafin, Stefania, Hutchison, David, Series Editor, Kanade, Takeo, Series Editor, Kittler, Josef, Series Editor, Kleinberg, Jon M., Series Editor, Mattern, Friedemann, Series Editor, Mitchell, John C., Series Editor, Naor, Moni, Series Editor, Pandu Rangan, C., Series Editor, Steffen, Bernhard, Series Editor, Terzopoulos, Demetri, Series Editor, Tygar, Doug, Series Editor, Weikum, Gerhard, Series Editor, Chen, Jessie Y.C., editor, and Fragomeni, Gino, editor

Published
2018
Full Text
View/download PDF

46. Investigating the Role of Auditory Feedback in a Multimodal Biking Experience

Author

Pedersen, Jon Ram Bruun, Serafin, Stefania, Grani, Francesco, Hutchison, David, Series Editor, Kanade, Takeo, Series Editor, Kittler, Josef, Series Editor, Kleinberg, Jon M., Series Editor, Mattern, Friedemann, Series Editor, Mitchell, John C., Series Editor, Naor, Moni, Series Editor, Pandu Rangan, C., Series Editor, Steffen, Bernhard, Series Editor, Terzopoulos, Demetri, Series Editor, Tygar, Doug, Series Editor, Weikum, Gerhard, Series Editor, Aramaki, Mitsuko, editor, Davies, Matthew E. P., editor, Kronland-Martinet, Richard, editor, and Ystad, Sølvi, editor

Published
2018
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results