A Domain Theory for Statistical Probabilistic Programming
We give an adequate denotational semantics for languages with recursive higher-order types, continuous probability distributions, and soft constraints. These are expressive languages for building Bayesian models of the kinds used in computational statistics and machine learning. Among them are untyped languages, similar to Church and WebPPL, because our semantics allows recursive mixed-variance datatypes. Our semantics justifies important program equivalences including commutativity.
Our new semantic model is based on `quasi-Borel predomains’. These are a mixture of chain-complete partial orders (cpos) and quasi-Borel spaces. Quasi-Borel spaces are a recent model of probability theory that focuses on sets of admissible random elements. Probability is traditionally treated in cpo models using probabilistic powerdomains, but these are not known to be commutative on any class of cpos with higher order functions. By contrast, quasi-Borel predomains do support both a commutative probabilistic powerdomain and higher-order functions. As we show, quasi-Borel predomains form both a model of Fiore’s axiomatic domain theory and a model of Kock’s synthetic measure theory.
|A Domain Theory for Statistical Probabilistic Programming - slides (popl-2019.pdf)||2.36MiB|
Conference DayWed 16 JanDisplayed time zone: Belfast change
13:45 - 14:51
|Probabilistic Programming with Densities in SlicStan: Efficient, Flexible and Deterministic|
Maria I. GorinovaThe University of Edinburgh, Andrew D. GordonMicrosoft Research and University of Edinburgh, Charles SuttonUniversity of EdinburghLink to publication DOI Pre-print Media Attached File Attached
|A Domain Theory for Statistical Probabilistic ProgrammingDistinguished Paper|
Matthijs VákárUniversity of Oxford, Ohad KammarUniversity of Edinburgh, Sam StatonUniversity of OxfordLink to publication DOI Pre-print Media Attached File Attached
|Bayesian Synthesis of Probabilistic Programs for Automatic Data Modeling|
Feras A. SaadMassachusetts Institute of Technology, Marco Cusumano-TownerMIT-CSAIL, Ulrich SchaechtleMassachusetts Institute of Technology, USA, Martin C. RinardMassachusetts Institute of Technology, Vikash K. MansinghkaMITLink to publication DOI Media Attached File Attached