Clark School Home UMD

ISR News Story

Espy-Wilson, Sivaraman research aims to improve speech inversion

Ganesh Sivaraman and Carol Espy-Wilson
Ganesh Sivaraman and Carol Espy-Wilson

A paper by Professor Carol Espy-Wilson (ECE/ISR) and her former student Ganesh Sivaraman (EE Ph.D. 2017), aims to improve speech inversion, the process of mapping acoustic signals into articulatory parameters. "Unsupervised speaker adaptation for speaker independent acoustic to articulatory speech inversion" has just been published in the Journal of the Acoustical Society of America (Vol.146, No.1).

Speech inversion is the process of mapping acoustic signals into articulatory parameters. Much work needs to be done in developing a robust speech inversion system, but if it could be made significantly more accurate, such a system could make a real impact on improving speech accent conversion, speech therapy, language learning, automatic speech recognition, and detection of depression from speech.

Differences among speakers typically makes speech inversion even harder. Normalizing these differences is essential to effectively using multi-speaker articulatory data for training a speaker-independent speech inversion system. It is essential to develop speech inversion systems that are speaker independent and can accurately estimate articulatory features for any speaker.

Espy-Wilson and Sivaraman aim to minimize speaker variability in the acoustic space attributed to vocal tract length differences between speakers for performing acoustic-to-articulatory inversion. Their goal is to normalize acoustic data from multiple speakers towards the acoustic space of a target speaker.

The researchers explored a vocal tract length normalization (VTLN) technique that could transform the acoustic features of different speakers to a target speaker acoustic space, minimizing speaker-specific details. The speaker-normalized features were then used to train a deep, feed-forward, neural-network-based speech inversion system.

The paper shows that data from multiple speakers can be normalized and combined to create better speaker-independent speech inversion systems. This approach can be extended to combine data from different articulatory datasets to create a single improved speech inversion system.

Sivaraman currently is a research scientist at Pindrop in Atlanta. Pindrop develops solutions for people and companies to authenticate each other via voice interactions, to increase security, identity, and trust for call centers and Internet of Things devices.

Related Articles:
Espy-Wilson Honored at UMD’s First to ADVANCE Celebration
Espy-Wilson Delivers Keynote Address for Stanford’s WISE Inspirations Network
Espy-Wilson Featured in MIT’s Tech Review
Piya Pal delivers plenary talk at IEEE Underwater Acoustic Signal Processing Workshop
OmniSpeech to Demonstrate Technology at 2014 CES International

July 25, 2019


Prev   Next

 

 

Current Headlines

University of Maryland Launches Quantum Technology Center

Min Wu named Associate Dean for Graduate Programs

Mapping Nucleation Kinetics with Nanometer Resolution

MEI² Receives Two New Innovative Vehicle Technology Awards

New EventAction interface improves recommender systems

BIOE, UMB to Host October Symposium

Khaligh elevated to Fellow of Institution of Engineering and Technology

Alumnus Amir Ali Ahmadi receives PECASE Award

Alum Samuel Gollob is NSF Graduate Research Fellow

Espy-Wilson, Sivaraman research aims to improve speech inversion

News Resources

Return to Newsroom

Search News

Archived News

Events Resources

Events Calendar