The Institute for Systems Research
Speech Communication Lab
Carol Espy-Wilson is a Professor in the Electrical and Computer Engineering Department and the Institute for Systems Research at the University of Maryland. View or download Dr. Espy-Wilson's CV here.
Dr. Espy-Wilson received her B.S. in Electrical Engineering from Stanford University. She received her M.S., E.E. and Ph.D. degrees in Electrical Engineering from the Massachusetts Institute of Technology. Prior to joining the faculty at the University of Maryland, Dr. Espy-Wilson was a faculty member at Boston University.
Dr. Espy-Wilson's research is in speech communication. She combines knowledge of digital signal processing, speech science, linguistics, acoustic phonetics and machine learning to conduct interdisciplinary research in speech and speaker recognition, speech production, speech enhancement and single-channel speech segregation. She also analyzes speech as a behavioral signal for emotion recognition, sentiment analysis and the detection and monitoring of mental health.
Her company, OmniSpeech, translated research in her lab on noise suppression and speech enhancement to technology that improves speech-enabled technology in any device, app or platform.
Dr. Espy-Wilson has authored or coauthored numerous papers in journals, conference proceedings and books. She is a Fellow of the International Speech Communication Association (ICSA) and the Acoustical Society of America (ASA) and a Senior Member of IEEE. She was a Radcliffe Fellow at Harvard 2008–2009. Among the other honors and awards she has received for her research contributions are the Clare Boothe Luce Professorship in 1990, the Independent Scientist Award from the National Institutes of Health in 1998 and the Honda Initiation Award in 2003. She served as the chair of the Speech Technical Committee of the Acoustical Society of America (2007-2010) and as an Associate Editor of the ASA's magazine, Acoustics Today. She was a member of the National Advisory Board for Medical Rehabilitation at the National Institutes of Health. Currently, she is a member of the Advisory Council for the NIH National Institutes on Biomedical Imaging and Bioengineering and an Associate Editor of the Journal of the Acoustical Society of America. In 2019 she chaired the NSF Speech for Robotics Workshop.
- Fellow, Institute of Electrical and Electronics Engineers (IEEE) (2021)
- Editorial Board, Computer, Speech and Language (2021–)
- Advisory Council, National Institute on Deafness and other Communication Disorders, NIH (2019-present)
- University of Maryland Campus Woman of Influence (2020)
- First African American woman, and first African American, in ECE to achieve tenure and be promoted to the rank of full professor (University of Maryland First to ADVANCE Program, 2019)
- Jimmy Lin Award for Innovation (2018)
- Fellow of the International Speech Communication Association (2018)
- Associate Editor, Journal of the Acoustical Society of America
- Advisory Council, NIH National Institutes on Biomedical Imaging and Bioengineering (2015-2018)
- Institute for Systems Research Senior Faculty Fellow Award (2015-2017)
- Distinguished Scholar-Teacher Award, University of Maryland (2012-2013)
- Advance Professor, University of Maryland (2011-2012)
- Elected to the Speech and Language Technical Committee of IEEE (2010-2012)
- Invention of the Year Award, University of Maryland (2010)
- Maryland Innovator of the Year Award, Baltimore Daily Record (2010)
- Grand Prize, Rockville Economic Development Inc. (REDI) StartRight! Women’s Business Plan Competition, 2010
- $50,000 SAIC-VentureAccelerator Competition, 2010
- University of Maryland $75K Business Plan Competition (High Technology & Social Impact), 2010
- Invention of the Year (Information Science): OmniSpeech, 2010
- Chair, Speech Communication Technical Committee, Acoustical Society of America (2007-2010)
- Editorial Board, Acoustics Today, Acoustical Society of America (2007-2009)
- Fellow, Radcliffe Institute for Advanced Study, Harvard University (2008)
- Fellow of the Acoustical Society of America (2005)
- Honda Initiation Award (2003)
- Honda Initiation Award (2004)
- Member, NIH Language and Communication Study Section (2001-2004)
- NIH Career Award (1998-2003)
- Clare Boothe Luce Professor (1990-1995)
Integration of engineering, linguistics, speech science and machine learning to study speech communication and develop robust speech technologies. Digital signal process, speech science, speech enhancement and segregation, noise robust automatic speech recognition, assistive technologies.
- C. Espy-Wilson, G. Sivaraman, M. Tiede, V. Mitra, E. Saltzmann, L. Goldstein, H. Nam (in press), “Modeling of Articulatory Gestures to Control Effects of Production Variability on Speech Technologies”. In Cangemi, Clayards, Niebuhr, Schupler & Zellers (eds). Rethinking Reduction, Berlin: Mouton de Gruyter, 2018.
- Vikramjit Mitra, Ganesh Sivaraman, Hosung Nam, Carol Espy-Wilson, Elliot Saltzman, Mark Tiede, “Hybrid Convolutional Neural Networks For Articulatory And Acoustic Information Based Speech Recognition”, Speech Communication, Vol 89, Issue C, pp. 103-112, 2017.
- V. Mitra, H. Nam, C. Espy-Wilson, E. Saltzman, and L. Goldstein, “Recognizing articulatory gestures from speech for robust speech recognition”, Journal of the Acoustical Society of America, vol. 131, no. 3, pp. 2270-2287, 2012.
- X. Zhou, C. Espy-Wilson, S. Boyce, M. Tiede, Christy Holland and Ann Choe
- “A magnetic resonance imaging-based articulatory and acoustic study of “retroflex” and “bunched” American English /r/ sounds”, Journal of the Acoustical Society of America, Vol. 123, no. 6, pp. 4466-4481, 2008.
- A. Juneja and Carol Espy-Wilson, “Probabilistic landmark detection for automatic speech recognition using acoustic-phonetic information”, Journal of the Acoustical Society of America, vol. 123, no. 2, pp. 1154-1168, 2008.
- T. Pruthi, C. Espy-Wilson and Brad Story, “Simulation and analysis of nasalized vowels based on MRI data”, Journal of the Acoustical Society of America, vol. 121, no. 6, pp. 3858-3873, 2007.
- O. Deshmukh, C. Espy-Wilson, L. Carney, “Speech Enhancement using the Modified Phase Opponency Model”, Journal of the Acoustical Society of America, vol. 121, no. 6, pp. 3886-3898, 2007
- C. Y. Espy-Wilson, S. Boyce, M. Jackson, S. Narayanan and A. Alwan, “Acoustic Modeling of American English /r/”, Journal of the Acoustical Society of America, pp. 343-356, 2000.
- C. Y. Espy-Wilson, V. R. Chari, J. M. MacAuslan, C. B. Huang and M. J. Walsh “Enhancement of Electrolaryngeal Speech by Adaptive Filtering”, Journal of Speech, Language and Hearing Research, vol. 41, no. 6, December, pp. 1253-1264, 1998
- F. Guenther, C. Espy-Wilson, S. Boyce, M. Matthies, M. Zandipour and J. Perkell “Articulatory tradeoffs reduce acoustic variability during American English /r/ production”, Journal of the Acoustical Society of America, vol. 105, no. 5, pp. 2854-2865, 1999
- C. Y. Espy-Wilson (1994) “A Feature-Based Semivowel Recognition System,” Journal of the Acoustical Society of America, vol. 96, no. 1, pp. 65-72, 1992
C. Y. Espy-Wilson, “Acoustic Measures for Linguistic Features Distinguishing the Semivowels /wjrl/ in American English,” Journal of the Acoustical Society of America, vol. 92, no. 2, pp. 736-751, 1992.
Seven UMD Grand Challenges projects include ISR and MRC facultyThe $30 million program will accelerate innovative solutions to some of the world's most complex problems.
Maryland Engineers Awarded Grants to Address Humanity's Grand ChallengesTwelve projects led by or involving Maryland Engineering faculty have been awarded funding through the Grand Challenges Grants Program, the largest and most comprehensive program of its kind ever introduced at the University of Maryland.
Department Celebrates Achievements During Annual ‘Welcome Back’ Luncheon and Awards CeremonyEvent recognizes outstanding achievements by students, staff and faculty.
Espy-Wilson is PI for NSF project to improve 'speech inversion' toolMachine learning will improve a tool that uses speech recordings to identify speech-related medical issues.
Congratulations ISR Spring 2022 graduates!We congratulate graduates at all levels who have ISR advisors!
Professor Espy-Wilson Named IEEE FellowThe IEEE Grade of Fellow is conferred by the IEEE Board of Directors upon a person with an outstanding record of accomplishments in any of the IEEE fields of interest.
Frequent research collaborator Deanna Kelly named 'MPower Professor'UMSOM Psychiatry professor has worked on mental health-related projects with Espy-Wilson, Ghodssi, Payne, among others.
In Memoriam: John William Fritz (‘17, electrical engineering)Rock on for John this October.
Pamela Abshire is named UMD Distinguished Scholar-TeacherShe is one of six Clark School faculty honored at the university's annual convocation.
How tech can fill gaps in mental health care$1.2M in NSF funding supports researchers’ work to connect patients, clinicians more effectively.
A new way to monitor mental health conditionsWith machine learning, Carol Espy-Wilson is developing a phone app that can measure depression symptoms using speech and video cues.
Carol Espy-Wilson Receives Campus Woman of Influence AwardEspy-Wilson has served as a pioneer, role model and mentor, especially for African-American women in the sciences.
Report available from 2019 NSF Speech for Robotics WorkshopThe workshop, chaired by Carol Espy-Wilson, identified key scientific and engineering advances needed to enable effective spoken language interaction with robotics.
UMD names Derek Paley as a 2020–2021 Distinguished Scholar-TeacherThe program recognizes faculty members who have demonstrated outstanding scholarly achievement along with equally outstanding accomplishments as teachers.
Clark School faculty 'AIM-HI' to address major health challengesThe new UMB-UMCP program has announced its first grants for projects combining AI and medicine.
Carol Espy-Wilson named 'Campus Woman of Influence'The award recognizes women in the campus community who have made exemplary contributions to the improvement of the quality of women's lives.
Chakraborty, Seneviratne, and Zou Named Outstanding Graduate AssistantsThe award recognizes the outstanding contributions that graduate assistants provide to students, faculty, departments, administrative units, and the university as a whole.
Carol Espy-Wilson Receives Faculty-Student Research AwardThis award will fund research opportunities led by Espy-Wilson to support research into the detection and monitoring of depression from speech.
Espy-Wilson, Sivaraman research aims to improve speech inversionSolutions could improve speech therapy, automatic speech recognition, language learning, depression detection.
Espy-Wilson Honored at UMD’s First to ADVANCE CelebrationProfessor Carol Espy-Wilson is a trailblazer as the first African American woman, and African American, to receive tenure and be promoted to Full Professor in the ECE Department.
NSF funds Shamma, Espy-Wilson for neuromorphic and data-driven speech segregation researchThe project will investigate how mimicking the brain's auditory processing can address AI signal processing challenges.
Five recipients of ISR Graduate Student Travel Award announcedEight graduate students have received funding through the award since 2017.
Vishnubhotla, Espy-Wilson granted patent for improving speech extractionThe patent could improve automatic speech recognition systems, hearing aids and cochlear implants.
Espy-Wilson named International Speech Communication Association FellowCitation reads "for contributions to speech acoustic modelling, speech signal processing and applications to knowledge-driven speech recognition and speech enhancement."
Espy-Wilson's technology included in new Alcatel MOVE TIME smart watchOmniSpeech 'OmniClear' software reduces dynamic noise in communication devices.
Salamanca-Riba Appointed 2017/2018 UMD ADVANCE ProfessorDr. Salamanca-Riba will help facilitate opportunities for advancement among University faculty members, especially under-represented groups.
More than 175 attend national Denice Denton Emerging Leaders WorkshopFaculty development workshop helped mid-career STEM academics develop knowledge, skills, strategies and critical networks.
Sennur Ulukus named UMD Distinguished Scholar-TeacherUlukus is the ninth ISR faculty member to be so honored.
Espy-Wilson Delivers Keynote Address for Stanford’s WISE Inspirations NetworkA Stanford alumnus, Espy-Wilson, was invited to speak because she is leading the way for women in science and engineering.
Espy-Wilson Featured in MIT’s Tech ReviewShe was the first African-American woman to earn a doctorate in electrical engineering at MIT.
Elisabeth Smela named ADVANCE ProfessorShe joins the ranks of five other ISR faculty associated with the ADVANCE program.
Espy-Wilson named to NIH advisory councilShe will serve on the National Advisory Council for Biomedical Imaging and Bioengineering.
Espy-Wilson delivers plenary address at College Board conferenceThe ECE/ISR professor spoke on 'A Change Must Come: African Americans and STEM.'
Six ISR Ph.D. students selected as Future Faculty FellowsProgram prepares students for academic careers in top-50 engineering schools.
Engineering systems for mental health work by Espy-Wilson, Resnik, Vaughn-Cooke featured in NewsweekResearch on quantifiable indicators could result in mental health tracking app.
Reza Ghodssi named UMD Distinguished Scholar-TeacherGhodssi is the eighth ISR faculty member to be so honored by the university.
OmniSpeech, Espy-Wilson mentioned on "Washington Business Report"UM Ventures' Jim Hughes cites the startup company as a university entrepreneurial success.
OmniSpeech to Demonstrate Technology at 2014 CES InternationalProfessor Carol Espy-Wilson's company, OmniSpeech, will debut its groundbreaking speech extraction technology at the 2014 Consumer Electronics Show.
Clark Professors Honored as Top Women Professors in MarylandProfessors Espy-Wilson and Muro recognized by StateStats.org for excellence in and out of the classroom
ISR Alumni Symposium is rousing successFull house for presentations, discussions of entrepreneurship.
Min Wu named Distinguished Scholar-TeacherWu is the seventh ISR faculty member to be so honored.
Carol Espy-Wilson is PI for multi-site NSF speech recognition grantThe researchers will develop a large-vocabulary speech recognition system based on articulatory information.
Espy-Wilson, Bergbreiter receive ADVANCE Seed GrantsFifteen projects funded for 2012.
Espy-Wilson gives keynote address at University of MichiganSpecial event honored first African-American woman to earn Ph.D. in physics.
Carol Espy-Wilson named 2012-2013 Distinguished Scholar-TeacherShe is sixth ISR professor to be so honored.
MERIT-BIEN and TREND Fair Showcases Undergraduate ResearchStudents present their summer research accomplishments to judges at annual fair.
New issue of System Solutions available onlineHighlights ISR 25th anniversary, new initiatives and more.
Cynthia Moss named ADVANCE professorThe ADVANCE program will provide support and opportunities for women faculty across the university.
Espy-Wilson appointed ADVANCE Professor for Women Faculty of ColorThe appointment begins in Spring 2011.
Espy-Wilson named to NIH advisory boardProfessor to be part of National Advisory Board on Medical Rehabilitation Research.
Carol Espy-Wilson honored as Innovator of the YearMaryland Daily Record honors her for invention that improves cell phone sound quality.
OmniSpeech Wins $50K SAIC-VentureAccelerator CompetitionNovel technology to make speech clear for mobile phones, related communications.
Company Started by Professor Wins Women’s Business Plan CompetitionProf. Espy-Wilson's technology eliminates background noise in cell phones, speech communications.
Faculty Start-Up Wins Maryland Incubator Company of the Year AwardCreated by Martin Peckerar & Neil Goldsman, FlexEl is developing flexible, thin-film, rechargeable batteries.
Mtech, Alumna-Run Companies Vie for State AwardsFive Clark School-affiliated companies named finalists for Incubator Company of the Year.
Grad student Daniel Garcia-Romero wins best paper awardPh.D. student of Carol Espy-Wilson is honored at annual ASA meeting.
Espy-Wilson and Pruthi win in University's Business Plan CompetitionTheir Omnispeech LLC placed first in the "high technology" category.
ECE Grad Students Mitra and Zhang Awarded Wylie FellowshipsVikramjit Mitra and Yufu Zhang were among a select group of UMD students to receive this prestigious fellowship.
Espy-Wilson, Rubloff win 'Invention of the Year' awardsInventions could improve speech comprehension in noisy environments, battery capacity.
Espy-Wilson, Pruthi Among Business Plan Competition FinalistsProfessor & alumnus will present a plan for a speech extraction technology for voice communications.
MERIT-BIEN Poster Wins Two Awards at NSF Program MeetingUndergraduate summer research earns two awards for most interesting & technically challenging project.
Three ISR students are named ECE Distinguished Dissertation FellowsBeyaz, Mitra and Varna honored for research excellence.
Chrisopher Davis wins ECE Faculty Venture Fair for cell phone radiation measurementCarol Espy-Wilson takes second place for 'Tidy Talk.'
Espy-Wilson receives NSF grant for digital speech forensicsProfessor will develop theories, methods and tools to identify and authenticate digital speech content.
Espy-Wilson Receives NIH Grant To Help Tongue Cancer Patients' SpeechProfessor is Co-PI on new grant for research on tongue reconstruction and successful post-surgical speech.
Fourteen ISR-affiliated students receive Ph.D.sCongratulations to our ISR-affiliated doctoral graduates!
Abshire and Espy-Wilson receive MIPS grantsFunding will help develop hand-held diagnostic instrument; advanced speech enhancement software.
Espy-Wilson Included in "Soul of Technology" ExhibitPalo Alto exhibition features 50 most important African Americans in technology.
Espy-Wilson awarded NSF grant; subcontractor for Navy STTR grantResearch could aid people with cochlear implants; background noise suppression and anti-birdstrike systems.
Espy-Wilson appointed Radcliffe FellowECE/ISR professor will be in residence at Harvard for 2008-2009 academic year.
An Algorithm for Multiple Pitch Tracking in Adverse Environments (ISR IP)This IP is available to license.
Modified Phase Opponency with a Signal Theoretic Preprocessor for Speech Enhancement (ISR IP)This IP is available to license.
Event Based System: A Probabilistic Acoustic-Phonetic Approach to Automatic Speech Recognition (ISR IP)This IP is available to license.
Espy-Wilson receives NSF grant for robust speech recognitionResearch will develop a system to automatically transcribe unrestricted conversational speech.
Carol Espy-Wilson promoted to full professorResearch integrates engineering, linguistics and speech science.
Grad student Tarun Pruthi wins ASA best student paper awardTopic is the automatic detection of vowel nasalization
Espy-Wilson named ASA FellowContributions to speech, commmunication and mentoring recognized
Espy-Wilson receives NSF grant for speech recongnitionResearch to investigate speech signal properties that persist even when identity is disguised
Grad student Om Deshmukh wins best poster awardResearch was presented at Acoustical Society of America meeting
Shamma receives grant from Honda for robotics workFunding will support research on auditory scene analysis
Espy-Wilson receives Honda Initiation grantResearch to focus on Probabilistic Framework for Acoustic-Phonetic Knowledge Based Continuous Speech Recognition.
Carol Espy-Wilson receives NSF grant for acoustic-phonetic knowledge and speech recognition.April 2003—Project will develop a robust automatic speech recognition system.
Espy-Wilson receives NIH grant for vocal tract acousticsResearch will develop comprehensive acoustic models of interspeaker differences in vocal tract configuration.
International Speech Communication Association
- Fellow, 2018
Acoustical Society of America
- Fellow, 2005
Institute of Electrical and Electronics Engineers (IEEE)
- Pitch detection algorithm based on PWVT of teager energy operator
- Systems and Methods for Speech Extraction
- Multiple pitch extraction by strength calculation from extrema
- Systems and methods for multiple pitch tracking using a multidimensional function and strength values
- System and method for automatic speech recognition from phonetic features and acoustic landmarks
- System and method for automatic speech recognition from phonetic features and acoustic landmarks
- Electrolaryngeal Speech Enhancement for Telephony
- Process to Introduce Realistic Pitch Variation in Artificial Larynx Speech
- UMD Grand Challenges Team Project Grant: Fostering Inclusivity through Technology
- UMD Grand Challenges Team Project Grant: Using Machine Learning to Measure and Improve Equity in K-12 Mathematics Classrooms
- NSF: Estimating Articulatory Constriction Place and Timing from Speech Acoustics
- NSF: Using Multi-Stage Learning to Prioritize Mental Health
- NSF IIS: Neuromorphic and Data-Driven Speech Segregation
- NSF Collaborative Research: Effects of production variability on the acoustic consequences of coordinated articulatory gestures
- Speech Processing Algorithms for Elderly Listeners with Hearing Loss
- Multilingual Gestural Models for Robust Language-Independent Speech Recognition
- Advanced speech enhancement software
- Predictors of Speech Quality after Tongue Cancer Surgery
- NSF RI: Extension of the APP detector for multipitch tracking and speaker separation
- NSF CIF: Nonintrusive Digital Speech Forensics: Source Identification and Content Authentication
- NSF RI Collaborative Research: Landmark-based Robust Speech Recognition Using Prosody-Guided Models of Speech Variability
- Adversarial Auto-encoders for Speech Emotion Recognition
- Articulatory representations to address acoustic variability in speech
- A study of emotional cues in speech
- Effects of depression on speech
- Speech production information for enhanced speech recognition
- Biobehavioral markers of depression: Integrated signal processing of speech, facial expressions and physiology
- An Enhancement of Modified Phase Opponency for Noise-Robust Speech Recognition
- Speech Segregation from Co-Channel Mixtures
- Multi-faceted research in Speech Communications
- From Acoustics to Vocal-Tract Time Functions
- Speech Enhancement for Noise—Robust Speech Recognition
- Language Detection for Music Information Retrieval
- Landmark-Based Speech Recognition
- A Novel Speaker Verification System using Samples-Based Acoustical Models
- Synergy of Acoustic-Phonetics and Peripheral Auditory Modeling Towards Robust Speech Recognition
- Acoustic Parameters for Automatic Detection of Nasal Manner
- Acoustic-phonetic Approach to Speech Recognition Based on Landmark Detection