Clark School Home UMD

ISR Events Calendar

Event Information

CS Colloquium: Soheil Feizi, "Deep learning interpretability, robustness & generative models"
Friday, February 8, 2019
11:00 a.m.
3117 Computer Science Instructional Center (CSIC)
For More Information:
Brandi Adams
bkadams@umd.edu

Computer Science Department Colloquium
Deep Learning Foundations: Interpretability, Robustness and Generative Models


Assistant Professor Soheil Feizi
Department of Computer Science
University of Maryland

Abstract

Deep learning models have demonstrated excellent empirical performance in different application domains. However, a satisfactory understanding of deep learning foundations continues to elude us. In this talk, I will explain our recent results in understanding some of the fundamental problems in supervised and unsupervised deep learning.

 
In unsupervised learning, I will first establish a principled connection between two modern generative approaches, namely Generative Adversarial Networks (GANs) and Variational AutoEncoders (VAEs). Leveraging this connection, I will show how sample likelihoods can be computed in GANs facilitating their use in statistical inference applications. Next, I will explain why the standard Wasserstein distance can lead to undesired results when applied to mixture distributions with imbalanced mixture proportions. To resolve this issue, I will present a new distance measure namely the normalized Wasserstein distance and show its effectiveness in GANs, domain adaptation, adversarial clustering and hypothesis testing.
 
In supervised learning, I will explain impacts of high-order loss approximations and features in two related problems of deep learning interpretation and robustness. In particular, by obtaining a closed-form formula for the Hessian matrix of a deep ReLU network, I will characterize differences between first and second order interpretation methods. Finally, I will explain our recent results on attack-agnostic robustness certificates for a multi-label classification problem using deep ReLU networks. In particular, I will present a certificate that has a closed-form, is differentiable and is an order of magnitude faster to compute than existing methods even for deep networks.


Biography
Soheil Feizi is an assistant professor in the Computer Science Department at University of Maryland, College Park. He is also a member of University of Maryland’s Institute for Advanced Computer Studies (UMIACS) and is affiliated with the Department of Electrical and Computer Engineering at UMD. He is the 2019 recipient of the Simons-Berkeley Research Fellowship on deep learning foundations and is a core faculty at the Machine Learning Center at UMD. Before joining UMD, he was a post-doctoral research scholar at Stanford University. He received his Ph.D. in Electrical Engineering and Computer Science (EECS) with a minor degree in Mathematics from the Massachusetts Institute of Technology (MIT). His research interests are in the area of machine learning and statistical inference. He completed a M.Sc. in EECS at MIT, where he received the Ernst Guillemin award for his thesis, as well as the Jacobs Presidential Fellowship and the EECS Great Educators Fellowship. He also received the best student award at Sharif University of Technology from where he obtained his B.Sc.

Browse Events By Calendar

Calendar Home

« Previous Month    Next Month »

August 2019
SU M TU W TH F SA
1 2 3 w
4 5 6 7 8 9 10 w
11 12 13 14 15 16 17 w
18 19 20 21 22 23 24 w
25 26 27 28 29 30 31 w

Search Events


ISR lecture and seminar series

Distinguished Lecturer Series
Intelligent Automation Inc. Colloquia Series
Microsystems Seminar Series
Lockheed Martin Robotics Seminar Series
Advanced Networks Colloquia Series
Model-Based Systems Engineering Colloquia Series

Submit an event to the ISR calendar Click here

News links

Current news
Search news
News archives