Seminars

View all Seminars  |  Download ICal for this event

New techniques and results for Support Recovery in Mixture Models

Series: Theory Seminar

Speaker: Soumyabrata Pal, Post-Doctoral Researcher, Google Research, India

Date/Time: May 06 11:00:00

Location: CSA Seminar Hall (Room No. 254, First Floor)

Faculty Advisor:

Abstract:
Mixture models with high dimensional parameter vectors are widely used to fit complex multimodal datasets as they allow representation of latent sub-populations within the overall population. The primary difficulty in learning mixture models is that the observed data does not identify the subpopulation to which an individual observation belongs.
We study the problem of support recovery in mixture models parameterized by sparse vectors i.e. our goal is to recover the set of non-zero indices of each of the unknown vectors. We present a very generic framework (including a novel tensor-based algorithm) for support recovery by using estimates of the number of unknown vectors having non-zero entries in small subsets of indices. We apply this framework by showing a variety of techniques to estimate the aforementioned quantities in different mixture models. Our results for support recovery are quite general, namely they are applicable to 1) Mixtures of many different canonical distributions including Uniform, Poisson, Laplace, Gaussians, etc. 2) Mixtures of linear regressions and linear classifiers.
Based on joint works (https://arxiv.org/abs/2202.11940, https://arxiv.org/abs/2106.05951) with Arya Mazumdar and Venkata Gandikota
-----------
For more details about the seminar please visit the website at https://www.csa.iisc.ac.in/iisc-msr-seminar/

Speaker Bio:

Host Faculty: Sruthi Gorantla and Rahul Madhavan