SlideShare una empresa de Scribd logo
1 de 50
An
Introduction
to Bayesian
Statistics
Paul Herendeen
April 2013
0
2000
4000
6000
8000
1960 1970 1980 1990 2000 2010
WOS "Bayesian"
Citations by Year
The rise of Bayesian
statistics
So…What are Bayesian
Statistics?
So…What are Bayesian
Statistics?
1) A fundamentally different approach to
probability
So…What are Bayesian
Statistics?
1) A fundamentally different approach to
probability
2) An associated set of mathematical tools
Frequentists vs. Bayesian
Round 1
Parameters
fixed
Data
varies
Data
fixed
Parameters
Vary
Frequentists vs. Bayesian
Round 1
Frequentists vs. Bayesian
Round 1
Confidence
Interval
Credible
Interval
Conditional Probability
in 2 minutes
Conditional Probability
in 2 minutes
All possible outcomes
Conditional Probability
in 2 minutes
Conditional Probability
in 2 minutes
Conditional Probability
in 2 minutes
Conditional Probability
in 2 minutes
Conditional Probability
in 2 minutes
Bayes’ Theorem
Bayes’ Theorem
Prior
Bayes’ Theorem
Likelihood
Prior
Bayes’ Theorem
Likelihood
Prior
Evidence
Bayes’ Theorem
Likelihood
Prior
Posterior
Evidence
Frequentist vs. Bayesian
Round 2
“The Strength of the Prior”
Sparse
Data
Abundant
Data
Uniform
Prior
Where do Priors Come
From?
So…What are Bayesian
Statistics?
1) A fundamentally different approach to
probability
2) An associated set of mathematical tools
How do you actually
do this?
So how do you actually
do this?
1. Analytical methods
So how do you actually
do this?
1. Analytical methods
2. Grid approximation
So how do you actually
do this?
1. Analytical methods
2. Grid approximation
3. Markov Chain Monte Carlo
MCMC
• Algorithm for exploring parameter space
MCMC
• Algorithm for exploring parameter space
1.Pick a starting point
MCMC
• Algorithm for exploring parameter space
1.Pick a starting point
2.Propose a move
MCMC
• Algorithm for exploring parameter space
1.Pick a starting point
2.Propose a move
3.Accept or decline move based on
probability
MCMC
• Algorithm for exploring parameter space
1.Pick a starting point
2.Propose a move
3.Accept or decline move based on
probability
• Time spent at each point approximates
parameter distribution
MCMC
• Algorithm for exploring parameter space
1.Pick a starting point
2.Propose a move
3.Accept or decline move based on
probability
• Time spent at each point approximates
parameter distribution
• E.g. Metropolis-Hastings, Gibbs sampling
MCMC
2D example
MCMC
2D example
So what does all this
get us?
Bayesian methods
really shine in complex
(hierarchical) models…
For example,
Individual
Fecundity
Group
Effect
Population
Effect
Foraging
success
Environment
or…
Individual
Fecundity
Group
Effect
Population
Effect
Environment
Many benefits to this
approach
• Simultaneously estimate parameters
• …as well as parameter relationships
• “Borrow” strength across studies
• Model comparison
So, is it a Bayesian
Revolution?
Bayesian stats can do
most things
frequentist,
Bayesian stats can do
most things
frequentist, but…
• Many simple models don‟t gain much
• Better do something „boring‟ well than
something exciting poorly
Bayesian stats can do
most things
frequentist, but…
• Many simple models don‟t gain much
• Better do something „boring‟ well than
something exciting poorly
• Don‟t be this guy
DO use Bayesian
methods if
• You have a complex model with many
interacting parameters
• You have „messy‟ data
• You don‟t want to make assumptions
about distributions
In Conclusion
• Bayesian methods are powerful tools
for ecological research
• Like most things statistical, they are
no substitute for thinking
• They are here to stay, and you should
at least be familiar with them
Great, I want to learn
more!
JAGS
(Just Another Gibbs Sampler)

Más contenido relacionado

La actualidad más candente

Bayesian decision making in clinical research
Bayesian decision making in clinical researchBayesian decision making in clinical research
Bayesian decision making in clinical research
Bhaswat Chakraborty
 
Maximum Likelihood Estimation
Maximum Likelihood EstimationMaximum Likelihood Estimation
Maximum Likelihood Estimation
guestfee8698
 
Categorical data analysis.pptx
Categorical data analysis.pptxCategorical data analysis.pptx
Categorical data analysis.pptx
Begashaw3
 
Bayesian model choice (and some alternatives)
Bayesian model choice (and some alternatives)Bayesian model choice (and some alternatives)
Bayesian model choice (and some alternatives)
Christian Robert
 

La actualidad más candente (20)

An introduction to Bayesian Statistics using Python
An introduction to Bayesian Statistics using PythonAn introduction to Bayesian Statistics using Python
An introduction to Bayesian Statistics using Python
 
Bayesian decision making in clinical research
Bayesian decision making in clinical researchBayesian decision making in clinical research
Bayesian decision making in clinical research
 
Bayesian statistics for biologists and ecologists
Bayesian statistics for biologists and ecologistsBayesian statistics for biologists and ecologists
Bayesian statistics for biologists and ecologists
 
2.03 bayesian estimation
2.03 bayesian estimation2.03 bayesian estimation
2.03 bayesian estimation
 
Multivariate and Conditional Distribution
Multivariate and Conditional DistributionMultivariate and Conditional Distribution
Multivariate and Conditional Distribution
 
Bayes' theorem
Bayes' theoremBayes' theorem
Bayes' theorem
 
Maximum Likelihood Estimation
Maximum Likelihood EstimationMaximum Likelihood Estimation
Maximum Likelihood Estimation
 
Categorical data analysis.pptx
Categorical data analysis.pptxCategorical data analysis.pptx
Categorical data analysis.pptx
 
Introduction to Bayesian Inference
Introduction to Bayesian InferenceIntroduction to Bayesian Inference
Introduction to Bayesian Inference
 
Probability Distributions
Probability DistributionsProbability Distributions
Probability Distributions
 
The binomial distributions
The binomial distributionsThe binomial distributions
The binomial distributions
 
Regularization and variable selection via elastic net
Regularization and variable selection via elastic netRegularization and variable selection via elastic net
Regularization and variable selection via elastic net
 
Logistic regression
Logistic regressionLogistic regression
Logistic regression
 
Probability&Bayes theorem
Probability&Bayes theoremProbability&Bayes theorem
Probability&Bayes theorem
 
Bayesian model choice (and some alternatives)
Bayesian model choice (and some alternatives)Bayesian model choice (and some alternatives)
Bayesian model choice (and some alternatives)
 
Binomial probability distributions
Binomial probability distributions  Binomial probability distributions
Binomial probability distributions
 
Ordinal logistic regression
Ordinal logistic regression Ordinal logistic regression
Ordinal logistic regression
 
Bayes rule (Bayes Law)
Bayes rule (Bayes Law)Bayes rule (Bayes Law)
Bayes rule (Bayes Law)
 
An overview of Bayesian testing
An overview of Bayesian testingAn overview of Bayesian testing
An overview of Bayesian testing
 
Bayesian classification
Bayesian classificationBayesian classification
Bayesian classification
 

Similar a An introduction to bayesian statistics

D. Mayo: Philosophical Interventions in the Statistics Wars
D. Mayo: Philosophical Interventions in the Statistics WarsD. Mayo: Philosophical Interventions in the Statistics Wars
D. Mayo: Philosophical Interventions in the Statistics Wars
jemille6
 
What should we expect from reproducibiliry
What should we expect from reproducibiliryWhat should we expect from reproducibiliry
What should we expect from reproducibiliry
Stephen Senn
 
Applied bayesian statistics
Applied bayesian statisticsApplied bayesian statistics
Applied bayesian statistics
Springer
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
StephenSenn2
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
jemille6
 

Similar a An introduction to bayesian statistics (20)

Berger 2000
Berger 2000Berger 2000
Berger 2000
 
Thinking statistically v3
Thinking statistically v3Thinking statistically v3
Thinking statistically v3
 
tjosullivanThesis
tjosullivanThesistjosullivanThesis
tjosullivanThesis
 
Machine learning clisification algorthims
Machine learning clisification algorthimsMachine learning clisification algorthims
Machine learning clisification algorthims
 
D. Mayo: Philosophical Interventions in the Statistics Wars
D. Mayo: Philosophical Interventions in the Statistics WarsD. Mayo: Philosophical Interventions in the Statistics Wars
D. Mayo: Philosophical Interventions in the Statistics Wars
 
Mayod@psa 21(na)
Mayod@psa 21(na)Mayod@psa 21(na)
Mayod@psa 21(na)
 
On being Bayesian
On being BayesianOn being Bayesian
On being Bayesian
 
beyond objectivity and subjectivity; a discussion paper
beyond objectivity and subjectivity; a discussion paperbeyond objectivity and subjectivity; a discussion paper
beyond objectivity and subjectivity; a discussion paper
 
Crisis of confidence, p-hacking and the future of psychology
Crisis of confidence, p-hacking and the future of psychologyCrisis of confidence, p-hacking and the future of psychology
Crisis of confidence, p-hacking and the future of psychology
 
What should we expect from reproducibiliry
What should we expect from reproducibiliryWhat should we expect from reproducibiliry
What should we expect from reproducibiliry
 
Probabilistic modeling in deep learning
Probabilistic modeling in deep learningProbabilistic modeling in deep learning
Probabilistic modeling in deep learning
 
Resolving e commerce challenges with probabilistic programming
Resolving e commerce challenges with probabilistic programmingResolving e commerce challenges with probabilistic programming
Resolving e commerce challenges with probabilistic programming
 
Discussion a 4th BFFF Harvard
Discussion a 4th BFFF HarvardDiscussion a 4th BFFF Harvard
Discussion a 4th BFFF Harvard
 
Signal and noise
Signal and noiseSignal and noise
Signal and noise
 
Applied bayesian statistics
Applied bayesian statisticsApplied bayesian statistics
Applied bayesian statistics
 
probability.pptx
probability.pptxprobability.pptx
probability.pptx
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
 
The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...The replication crisis: are P-values the problem and are Bayes factors the so...
The replication crisis: are P-values the problem and are Bayes factors the so...
 
0 methods for multiple treatment comparisons
0 methods for multiple treatment comparisons0 methods for multiple treatment comparisons
0 methods for multiple treatment comparisons
 
Software estimation is crap
Software estimation is crapSoftware estimation is crap
Software estimation is crap
 

Último

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
fonyou31
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 

Último (20)

Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
fourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writingfourth grading exam for kindergarten in writing
fourth grading exam for kindergarten in writing
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
General AI for Medical Educators April 2024
General AI for Medical Educators April 2024General AI for Medical Educators April 2024
General AI for Medical Educators April 2024
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 

An introduction to bayesian statistics