Timezone: »
Poster
High-dimensional Location Estimation via Norm Concentration for Subgamma Vectors
Shivam Gupta · Jasper Lee · Eric Price
In location estimation, we are given $n$ samples from a known distribution $f$ shifted by an unknown translation $\lambda$, and want to estimate $\lambda$ as precisely as possible. Asymptotically, the maximum likelihood estimate achieves the Cramér-Rao bound of error $\mathcal N(0, \frac{1}{n\mathcal I})$, where $\mathcal I$ is the Fisher information of $f$. However, the $n$ required for convergence depends on $f$, and may be arbitrarily large. We build on the theory using *smoothed* estimators to bound the error for finite $n$ in terms of $\mathcal I_r$, the Fisher information of the $r$-smoothed distribution. As $n \to \infty$, $r \to 0$ at an explicit rate and this converges to the Cramér-Rao bound. We (1) improve the prior work for 1-dimensional $f$ to converge for constant failure probability in addition to high probability, and (2) extend the theory to high-dimensional distributions. In the process, we prove a new bound on the norm of a high-dimensional random variable whose 1-dimensional projections are subgamma, which may be of independent interest.
Author Information
Shivam Gupta (University of Texas at Austin)
Jasper Lee (University of Wisconsin-Madison)
Eric Price (UT-Austin)
More from the Same Authors
-
2022 Poster: Hardness and Algorithms for Robust and Sparse Optimization »
Eric Price · Sandeep Silwal · Samson Zhou -
2022 Spotlight: Hardness and Algorithms for Robust and Sparse Optimization »
Eric Price · Sandeep Silwal · Samson Zhou -
2022 Poster: Linear Bandit Algorithms with Sublinear Time Complexity »
Shuo Yang · Tongzheng Ren · Sanjay Shakkottai · Eric Price · Inderjit Dhillon · Sujay Sanghavi -
2022 Spotlight: Linear Bandit Algorithms with Sublinear Time Complexity »
Shuo Yang · Tongzheng Ren · Sanjay Shakkottai · Eric Price · Inderjit Dhillon · Sujay Sanghavi -
2021 Poster: Fairness for Image Generation with Uncertain Sensitive Attributes »
Ajil Jalal · Sushrut Karmalkar · Jessica Hoffmann · Alexandros Dimakis · Eric Price -
2021 Spotlight: Fairness for Image Generation with Uncertain Sensitive Attributes »
Ajil Jalal · Sushrut Karmalkar · Jessica Hoffmann · Alexandros Dimakis · Eric Price -
2021 Poster: Quantifying and Reducing Bias in Maximum Likelihood Estimation of Structured Anomalies »
Uthsav Chitra · Kimberly Ding · Jasper C.H. Lee · Benjamin Raphael -
2021 Poster: Instance-Optimal Compressed Sensing via Posterior Sampling »
Ajil Jalal · Sushrut Karmalkar · Alexandros Dimakis · Eric Price -
2021 Spotlight: Instance-Optimal Compressed Sensing via Posterior Sampling »
Ajil Jalal · Sushrut Karmalkar · Alexandros Dimakis · Eric Price -
2021 Spotlight: Quantifying and Reducing Bias in Maximum Likelihood Estimation of Structured Anomalies »
Uthsav Chitra · Kimberly Ding · Jasper C.H. Lee · Benjamin Raphael -
2020 Poster: On the Power of Compressed Sensing with Generative Models »
Akshay Kamath · Eric Price · Sushrut Karmalkar -
2019 Poster: Adversarial examples from computational constraints »
Sebastien Bubeck · Yin Tat Lee · Eric Price · Ilya Razenshteyn -
2019 Oral: Adversarial examples from computational constraints »
Sebastien Bubeck · Yin Tat Lee · Eric Price · Ilya Razenshteyn -
2017 Poster: Compressed Sensing using Generative Models »
Ashish Bora · Ajil Jalal · Eric Price · Alexandros Dimakis -
2017 Talk: Compressed Sensing using Generative Models »
Ashish Bora · Ajil Jalal · Eric Price · Alexandros Dimakis