Valid and efficient imprecise-probabilistic inference with partial priors, I. First results

Abstract

Between Bayesian and frequentist inference, it's commonly believed that the former is for cases where one has a prior and the latter is for cases where one has no prior. But the prior/no-prior classification isn't exhaustive, and most real-world applications fit somewhere in between these two extremes. That neither of the two dominant schools of thought are suited for these applications creates confusion and slows progress. A key observation here is that ``no prior information'' actually means no prior distribution can be ruled out, so the classically-frequentist context is best characterized as every prior. From this perspective, it's now clear that there's an entire spectrum of contexts depending on what, if any, partial prior information is available, with Bayesian (one prior) and frequentist (every prior) on opposite extremes. This paper ties the two frameworks together by formally treating those cases where only partial prior information is available using the theory of imprecise probability. The end result is a unified framework of (imprecise-probabilistic) statistical inference with a new validity condition that implies both frequentist-style error rate control for derived procedures and Bayesian-style coherence properties, relative to the given partial prior information. This new theory contains both the Bayesian and frequentist frameworks as special cases, since they're both valid in this new sense relative to their respective partial priors. Different constructions of these valid inferential models are considered, and compared based on their efficiency.

Versions

➤  Version 6 (2022-11-23)

Citations

Ryan Martin (2021). Valid and efficient imprecise-probabilistic inference with partial priors, I. First results. Researchers.One. https://researchers.one/articles/21.05.00001v6

    Reviews & Substantive Comments

    4 Comments

  1. Ryan MartinMay 16th, 2022 at 01:19 pm

    This version (05/16/2022) is just a relatively minor revision. I added some details about the "every prior" characterization of frequentist inference which I think is helpful. Also, the results on the connection between validity and no-sure-loss have been strengthened. Comments welcome!

  2. Ryan MartinMarch 11th, 2022 at 09:43 pm

    This is a substantial revision to the first two versions. Basically it's an entirely different paper, with lots more details about how to define a notion of validity when partial prior information is available, what kind of properties the resulting inferential model has, and how to construct such an inferential model that's both valid and efficient. Comments welcome!

  3. Ryan MartinMay 25th, 2021 at 08:21 pm

    Version 2 (05/24/2021) corrects a non-trivial typo in Proposition 3 and includes proofs of the main results. This version is still preliminary, comments welcome!

  4. Ryan MartinMay 4th, 2021 at 09:35 pm

    This version (05/04/2021) of the article is preliminary; it has been submitted for inclusion in a conference proceedings, which is why it's so short and lacking detail. A full-length version, with proofs of the main results, additional explanations, and illustrations is in preparation. Comments welcome!

Add to the conversation

© 2018–2025 Researchers.One