A unified construction for series representations and finite approximations of completely random measures

Journal article

Infinite-activity completely random measures (CRMs) have become important building blocks of complex Bayesian nonparametric models. They have been successfully used in various applications such as clustering, density estimation, latent feature models, survival analysis or network science. Popular infinite-activity CRMs include the (generalised) gamma process and the (stable) beta process. However, except in some specific cases, exact simulation or scalable inference with these models is challenging and finite-dimensional approximations are often considered. In this work, we propose a general and unified framework to derive both series representations and finite-dimensional approximations of CRMs. Our framework can be seen as a generalisation of constructions based on size-biased sampling of Poisson point process (Probab. Theory Related Fields 92 (1992) 21–39). It includes as special cases several known series representations and finite approximations as well as novel ones. In particular, we show that one can get novel series representations for the generalised gamma process and the stable beta process. We show how these constructions can be used to derive novel algorithms for posterior inference, including a generalisation of the slice sampler for normalised CRMs mixture models introduced by (J. Comput. Graph. Statist. 20 (2011) 241–259). We also provide some analysis of the truncation error.

Authors: Lee, J; Miscouridou, X; Caron, F

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Bernoulli Society for Mathematical Statistics and Probability
• Journal: Bernoulli
• Volume: 29
• Issue: 3
• Pages: 2142-2166
• Publication date: 2023-04-27
• Acceptance date: 2022-08-08
• DOI: 10.3150/22-BEJ1536
• ISSN: 1350-7265
• Language: English
• Keywords: completely random measures; Poisson random measures; slice sampling; FFR; Bayesian nonparametrics; generalised gamma process