Bayesian Quantile Estimation and Regression with Martingale Posteriors

Bibliographic Details
Title: Bayesian Quantile Estimation and Regression with Martingale Posteriors
Authors: Fong, Edwin, Yiu, Andrew
Publication Year: 2024
Collection: Mathematics
Statistics
Subject Terms: Statistics - Methodology, Mathematics - Statistics Theory
More Details: Quantile estimation and regression within the Bayesian framework is challenging as the choice of likelihood and prior is not obvious. In this paper, we introduce a novel Bayesian nonparametric method for quantile estimation and regression based on the recently introduced martingale posterior (MP) framework. The core idea of the MP is that posterior sampling is equivalent to predictive imputation, which allows us to break free of the stringent likelihood-prior specification. We demonstrate that a recursive estimate of a smooth quantile function, subject to a martingale condition, is entirely sufficient for full nonparametric Bayesian inference. We term the resulting posterior distribution as the quantile martingale posterior (QMP), which arises from an implicit generative predictive distribution. Associated with the QMP is an expedient, MCMC-free and parallelizable posterior computation scheme, which can be further accelerated with an asymptotic approximation based on a Gaussian process. Furthermore, the well-known issue of monotonicity in quantile estimation is naturally alleviated through increasing rearrangement due to the connections to the Bayesian bootstrap. Finally, the QMP has a particularly tractable form that allows for comprehensive theoretical study, which forms a main focus of the work. We demonstrate the ease of posterior computation in simulations and real data experiments.
Comment: 29 pages (main), 84 pages (total), 12 figures
Document Type: Working Paper
Access URL: http://arxiv.org/abs/2406.03358
Accession Number: edsarx.2406.03358
Database: arXiv
More Details
Description not available.