Exploration-free Algorithms for Multi-group Mean Estimation
Abstract
Lay Summary
Many real-world studies need accurate estimates for several groups at once, such as different patient populations, survey groups, customer segments, or treatment options in an experiment. A common challenge is deciding how many samples to collect from each group when the total budget is limited and the uncertainty within each group is not known in advance. This paper studies this allocation problem and shows that, unlike settings where the goal is to find only the best option, accurate estimation requires collecting data from every group. We use this structure to design simple procedures that do not need a separate trial-and-error stage: the data collected to understand each group’s uncertainty also directly contributes to the final estimates. We also extend the idea to settings where extra information about each individual or situation is available, such as in personalized recommendations or online experiments. Our results show that these methods can allocate samples efficiently while keeping estimates accurate across groups. This can help make surveys, experiments, and data-driven decisions more reliable for diverse populations.