Submit Search
Upload
04 regression
•
Download as PPT, PDF
•
3 likes
•
5,106 views
Firas Husseini
Follow
Quantitative Analysis for Management, 11e (Render)
Read less
Read more
Business
Report
Share
Report
Share
1 of 75
Download now
Recommended
05 forecasting
05 forecasting
Firas Husseini
Rsh qam11 ch04 ge
Rsh qam11 ch04 ge
Firas Husseini
Spearman Rank
Spearman Rank
i-study-co-uk
Regression analysis
Regression analysis
Teachers Mitraa
Single linear regression
Single linear regression
Ken Plummer
Probability Distributions
Probability Distributions
CIToolkit
regression and correlation
regression and correlation
Priya Sharma
correlation and regression
correlation and regression
Unsa Shakir
Recommended
05 forecasting
05 forecasting
Firas Husseini
Rsh qam11 ch04 ge
Rsh qam11 ch04 ge
Firas Husseini
Spearman Rank
Spearman Rank
i-study-co-uk
Regression analysis
Regression analysis
Teachers Mitraa
Single linear regression
Single linear regression
Ken Plummer
Probability Distributions
Probability Distributions
CIToolkit
regression and correlation
regression and correlation
Priya Sharma
correlation and regression
correlation and regression
Unsa Shakir
Regression analysis
Regression analysis
Shameer P Hamsa
Linear regression
Linear regression
vermaumeshverma
An Overview of Simple Linear Regression
An Overview of Simple Linear Regression
Georgian Court University
Regression analysis
Regression analysis
University of Jaffna
Correlation & Regression Analysis using SPSS
Correlation & Regression Analysis using SPSS
Parag Shah
Multivariate analyses
Multivariate analyses
Naveen Deswal
Correlation and regression
Correlation and regression
Abdelaziz Tayoun
Kendall rank correlation
Kendall rank correlation
Islamia College University Peshawar
Multiple Regression.ppt
Multiple Regression.ppt
TanyaWadhwani4
Time Series Analysis Ravi
Time Series Analysis Ravi
RAVINDRA KUMAR KUMAWAT
MANOVA SPSS
MANOVA SPSS
Dr Athar Khan
Correlation and regression
Correlation and regression
Mohit Asija
Spearman’s Rank Correlation Coefficient
Spearman’s Rank Correlation Coefficient
Sharlaine Ruth
Regression
Regression
Andi Koentary
Basics of Regression analysis
Basics of Regression analysis
Mahak Vijayvargiya
Simple linear regression and correlation
Simple linear regression and correlation
Shakeel Nouman
Measures of Variation
Measures of Variation
Rica Joy Pontilar
Regression analysis.
Regression analysis.
sonia gupta
Logistic regression analysis
Logistic regression analysis
Dhritiman Chakrabarti
Simple Linier Regression
Simple Linier Regression
dessybudiyanti
Chapter 4 power point presentation Regression models
Chapter 4 power point presentation Regression models
JustinXerri
2.1 regression
2.1 regression
Manish Gupta
More Related Content
What's hot
Regression analysis
Regression analysis
Shameer P Hamsa
Linear regression
Linear regression
vermaumeshverma
An Overview of Simple Linear Regression
An Overview of Simple Linear Regression
Georgian Court University
Regression analysis
Regression analysis
University of Jaffna
Correlation & Regression Analysis using SPSS
Correlation & Regression Analysis using SPSS
Parag Shah
Multivariate analyses
Multivariate analyses
Naveen Deswal
Correlation and regression
Correlation and regression
Abdelaziz Tayoun
Kendall rank correlation
Kendall rank correlation
Islamia College University Peshawar
Multiple Regression.ppt
Multiple Regression.ppt
TanyaWadhwani4
Time Series Analysis Ravi
Time Series Analysis Ravi
RAVINDRA KUMAR KUMAWAT
MANOVA SPSS
MANOVA SPSS
Dr Athar Khan
Correlation and regression
Correlation and regression
Mohit Asija
Spearman’s Rank Correlation Coefficient
Spearman’s Rank Correlation Coefficient
Sharlaine Ruth
Regression
Regression
Andi Koentary
Basics of Regression analysis
Basics of Regression analysis
Mahak Vijayvargiya
Simple linear regression and correlation
Simple linear regression and correlation
Shakeel Nouman
Measures of Variation
Measures of Variation
Rica Joy Pontilar
Regression analysis.
Regression analysis.
sonia gupta
Logistic regression analysis
Logistic regression analysis
Dhritiman Chakrabarti
Simple Linier Regression
Simple Linier Regression
dessybudiyanti
What's hot
(20)
Regression analysis
Regression analysis
Linear regression
Linear regression
An Overview of Simple Linear Regression
An Overview of Simple Linear Regression
Regression analysis
Regression analysis
Correlation & Regression Analysis using SPSS
Correlation & Regression Analysis using SPSS
Multivariate analyses
Multivariate analyses
Correlation and regression
Correlation and regression
Kendall rank correlation
Kendall rank correlation
Multiple Regression.ppt
Multiple Regression.ppt
Time Series Analysis Ravi
Time Series Analysis Ravi
MANOVA SPSS
MANOVA SPSS
Correlation and regression
Correlation and regression
Spearman’s Rank Correlation Coefficient
Spearman’s Rank Correlation Coefficient
Regression
Regression
Basics of Regression analysis
Basics of Regression analysis
Simple linear regression and correlation
Simple linear regression and correlation
Measures of Variation
Measures of Variation
Regression analysis.
Regression analysis.
Logistic regression analysis
Logistic regression analysis
Simple Linier Regression
Simple Linier Regression
Similar to 04 regression
Chapter 4 power point presentation Regression models
Chapter 4 power point presentation Regression models
JustinXerri
2.1 regression
2.1 regression
Manish Gupta
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
LynellBull52
Bba 3274 qm week 6 part 1 regression models
Bba 3274 qm week 6 part 1 regression models
Stephen Ong
Tbs910 regression models
Tbs910 regression models
Stephen Ong
Quantitative Analysis for Management new ppt
Quantitative Analysis for Management new ppt
krrish242
161783709 chapter-04-answers
161783709 chapter-04-answers
BookStoreLib
161783709 chapter-04-answers
161783709 chapter-04-answers
Firas Husseini
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
hildredzr1di
Regression analysis
Regression analysis
Srikant001p
lanen_5e_ch05_student.ppt
lanen_5e_ch05_student.ppt
SURAJITDASBAURI
multiple regression model building
multiple regression model building
Yesica Adicondro
Modules Linear Algebra Drills
Modules Linear Algebra Drills
Daniel Bragais
Fst ch3 notes
Fst ch3 notes
David Tchozewski
Chap14 multiple regression model building
Chap14 multiple regression model building
Uni Azza Aunillah
Pat05 ppt 0105
Pat05 ppt 0105
wzuri
SupportVectorRegression
SupportVectorRegression
Daniel K
Exploring Support Vector Regression - Signals and Systems Project
Exploring Support Vector Regression - Signals and Systems Project
Surya Chandra
Chap12 simple regression
Chap12 simple regression
Uni Azza Aunillah
Lecture 14.ppt
Lecture 14.ppt
TanvirIslam461642
Similar to 04 regression
(20)
Chapter 4 power point presentation Regression models
Chapter 4 power point presentation Regression models
2.1 regression
2.1 regression
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
© 2008 Prentice-Hall, Inc.Regression ModelsChapter 4.docx
Bba 3274 qm week 6 part 1 regression models
Bba 3274 qm week 6 part 1 regression models
Tbs910 regression models
Tbs910 regression models
Quantitative Analysis for Management new ppt
Quantitative Analysis for Management new ppt
161783709 chapter-04-answers
161783709 chapter-04-answers
161783709 chapter-04-answers
161783709 chapter-04-answers
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
Quantitative Analysis for ManagementThirteenth EditionLesson.docx
Regression analysis
Regression analysis
lanen_5e_ch05_student.ppt
lanen_5e_ch05_student.ppt
multiple regression model building
multiple regression model building
Modules Linear Algebra Drills
Modules Linear Algebra Drills
Fst ch3 notes
Fst ch3 notes
Chap14 multiple regression model building
Chap14 multiple regression model building
Pat05 ppt 0105
Pat05 ppt 0105
SupportVectorRegression
SupportVectorRegression
Exploring Support Vector Regression - Signals and Systems Project
Exploring Support Vector Regression - Signals and Systems Project
Chap12 simple regression
Chap12 simple regression
Lecture 14.ppt
Lecture 14.ppt
More from Firas Husseini
Ali M Fadel CV
Ali M Fadel CV
Firas Husseini
Transportation problems1
Transportation problems1
Firas Husseini
Slides for ch08
Slides for ch08
Firas Husseini
Slides for ch07
Slides for ch07
Firas Husseini
Slides for ch06
Slides for ch06
Firas Husseini
Slides for ch05
Slides for ch05
Firas Husseini
Rsh qam11 ch10 ge
Rsh qam11 ch10 ge
Firas Husseini
Rsh qam11 ch09 ge
Rsh qam11 ch09 ge
Firas Husseini
Rsh qam11 ch08 ge
Rsh qam11 ch08 ge
Firas Husseini
Rsh qam11 ch07 ge
Rsh qam11 ch07 ge
Firas Husseini
Rsh qam11 ch06 ge
Rsh qam11 ch06 ge
Firas Husseini
Rsh qam11 ch05 ge
Rsh qam11 ch05 ge
Firas Husseini
Rsh qam11 ch03
Rsh qam11 ch03
Firas Husseini
Rsh qam11 ch03 ge
Rsh qam11 ch03 ge
Firas Husseini
Rsh qam11 ch02
Rsh qam11 ch02
Firas Husseini
Rsh qam11 ch01
Rsh qam11 ch01
Firas Husseini
Render03 140622012601-phpapp02
Render03 140622012601-phpapp02
Firas Husseini
Render03 140622012601-phpapp02 (1)
Render03 140622012601-phpapp02 (1)
Firas Husseini
Render01edited 121120194704-phpapp02
Render01edited 121120194704-phpapp02
Firas Husseini
Render 09
Render 09
Firas Husseini
More from Firas Husseini
(20)
Ali M Fadel CV
Ali M Fadel CV
Transportation problems1
Transportation problems1
Slides for ch08
Slides for ch08
Slides for ch07
Slides for ch07
Slides for ch06
Slides for ch06
Slides for ch05
Slides for ch05
Rsh qam11 ch10 ge
Rsh qam11 ch10 ge
Rsh qam11 ch09 ge
Rsh qam11 ch09 ge
Rsh qam11 ch08 ge
Rsh qam11 ch08 ge
Rsh qam11 ch07 ge
Rsh qam11 ch07 ge
Rsh qam11 ch06 ge
Rsh qam11 ch06 ge
Rsh qam11 ch05 ge
Rsh qam11 ch05 ge
Rsh qam11 ch03
Rsh qam11 ch03
Rsh qam11 ch03 ge
Rsh qam11 ch03 ge
Rsh qam11 ch02
Rsh qam11 ch02
Rsh qam11 ch01
Rsh qam11 ch01
Render03 140622012601-phpapp02
Render03 140622012601-phpapp02
Render03 140622012601-phpapp02 (1)
Render03 140622012601-phpapp02 (1)
Render01edited 121120194704-phpapp02
Render01edited 121120194704-phpapp02
Render 09
Render 09
Recently uploaded
GD Birla and his contribution in management
GD Birla and his contribution in management
chhavia330
HONOR Veterans Event Keynote by Michael Hawkins
HONOR Veterans Event Keynote by Michael Hawkins
Michael W. Hawkins
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...
Roland Driesen
Forklift Operations: Safety through Cartoons
Forklift Operations: Safety through Cartoons
Forklift Trucks in Minnesota
Understanding the Pakistan Budgeting Process: Basics and Key Insights
Understanding the Pakistan Budgeting Process: Basics and Key Insights
seribangash
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
karancommunications
M.C Lodges -- Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.
Aaiza Hassan
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
lizamodels9
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMAN
IlamathiKannappan
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Apsara Of India
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
KeppelCorporation
The Coffee Bean & Tea Leaf(CBTL), Business strategy case study
The Coffee Bean & Tea Leaf(CBTL), Business strategy case study
Ethan lee
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
P&CO
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
Call Girls In Delhi Whatsup 9873940964 Enjoy Unlimited Pleasure
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Tina Ji
Unlocking the Secrets of Affiliate Marketing.pdf
Unlocking the Secrets of Affiliate Marketing.pdf
Online Income Engine
VIP Call Girls In Saharaganj ( Lucknow ) 🔝 8923113531 🔝 Cash Payment (COD) 👒
VIP Call Girls In Saharaganj ( Lucknow ) 🔝 8923113531 🔝 Cash Payment (COD) 👒
anilsa9823
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023
Neil Kimberley
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
Seo
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
divyansh0kumar0
Recently uploaded
(20)
GD Birla and his contribution in management
GD Birla and his contribution in management
HONOR Veterans Event Keynote by Michael Hawkins
HONOR Veterans Event Keynote by Michael Hawkins
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...
Forklift Operations: Safety through Cartoons
Forklift Operations: Safety through Cartoons
Understanding the Pakistan Budgeting Process: Basics and Key Insights
Understanding the Pakistan Budgeting Process: Basics and Key Insights
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
M.C Lodges -- Guest House in Jhang.
M.C Lodges -- Guest House in Jhang.
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
Call Girls In DLf Gurgaon ➥99902@11544 ( Best price)100% Genuine Escort In 24...
A DAY IN THE LIFE OF A SALESMAN / WOMAN
A DAY IN THE LIFE OF A SALESMAN / WOMAN
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
The Coffee Bean & Tea Leaf(CBTL), Business strategy case study
The Coffee Bean & Tea Leaf(CBTL), Business strategy case study
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Russian Faridabad Call Girls(Badarpur) : ☎ 8168257667, @4999
Unlocking the Secrets of Affiliate Marketing.pdf
Unlocking the Secrets of Affiliate Marketing.pdf
VIP Call Girls In Saharaganj ( Lucknow ) 🔝 8923113531 🔝 Cash Payment (COD) 👒
VIP Call Girls In Saharaganj ( Lucknow ) 🔝 8923113531 🔝 Cash Payment (COD) 👒
Mondelez State of Snacking and Future Trends 2023
Mondelez State of Snacking and Future Trends 2023
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
04 regression
1.
© 2008 Prentice-Hall,
Inc. Chapter 4 To accompany Quantitative Analysis for Management, Tenth Edition, by Render, Stair, and Hanna Power Point slides created by Jeff Heyl Regression Models © 2009 Prentice-Hall, Inc.
2.
© 2009 Prentice-Hall,
Inc. 4 – 2 Learning Objectives 1. Identify variables and use them in a regression model 2. Develop simple linear regression equations from sample data and interpret the slope and intercept 3. Compute the coefficient of determination and the coefficient of correlation and interpret their meanings 4. Interpret the F-test in a linear regression model 5. List the assumptions used in regression and use residual plots to identify problems After completing this chapter, students will be able to:After completing this chapter, students will be able to:
3.
© 2009 Prentice-Hall,
Inc. 4 – 3 Learning Objectives 6. Develop a multiple regression model and use it to predict 7. Use dummy variables to model categorical data 8. Determine which variables should be included in a multiple regression model 9. Transform a nonlinear function into a linear one for use in regression 10. Understand and avoid common mistakes made in the use of regression analysis After completing this chapter, students will be able to:After completing this chapter, students will be able to:
4.
© 2009 Prentice-Hall,
Inc. 4 – 4 Chapter Outline 4.1 Introduction 4.2 Scatter Diagrams 4.3 Simple Linear Regression 4.4 Measuring the Fit of the Regression Model 4.5 Using Computer Software for Regression 4.6 Assumptions of the Regression Model
5.
© 2009 Prentice-Hall,
Inc. 4 – 5 Chapter Outline 4.7 Testing the Model for Significance 4.8 Multiple Regression Analysis 4.9 Binary or Dummy Variables 4.10 Model Building 4.11 Nonlinear Regression 4.12 Cautions and Pitfalls in Regression Analysis
6.
© 2009 Prentice-Hall,
Inc. 4 – 6 Introduction Regression analysisRegression analysis is a very valuable tool for a manager Regression can be used to Understand the relationship between variables Predict the value of one variable based on another variable Examples Determining best location for a new store Studying the effectiveness of advertising dollars in increasing sales volume
7.
© 2009 Prentice-Hall,
Inc. 4 – 7 Introduction The variable to be predicted is called the dependent variabledependent variable Sometimes called the response variableresponse variable The value of this variable depends on the value of the independent variableindependent variable Sometimes called the explanatoryexplanatory or predictor variablepredictor variable Independent variable Dependent variable Independent variable = +
8.
© 2009 Prentice-Hall,
Inc. 4 – 8 Scatter Diagram Graphing is a helpful way to investigate the relationship between variables A scatter diagramscatter diagram or scatter plotscatter plot is often used The independent variable is normally plotted on the X axis The dependent variable is normally plotted on the Y axis
9.
© 2009 Prentice-Hall,
Inc. 4 – 9 Triple A Construction Triple A Construction renovates old homes They have found that the dollar volume of renovation work is dependent on the area payroll TRIPLE A’S SALES ($100,000’s) LOCAL PAYROLL ($100,000,000’s) 6 3 8 4 9 6 5 4 4.5 2 9.5 5 Table 4.1
10.
© 2009 Prentice-Hall,
Inc. 4 – 10 Triple A Construction Figure 4.1 12 – 10 – 8 – 6 – 4 – 2 – 0 – Sales($100,000) Payroll ($100 million) | | | | | | | | 0 1 2 3 4 5 6 7 8
11.
© 2009 Prentice-Hall,
Inc. 4 – 11 Simple Linear Regression where Y = dependent variable (response) X = independent variable (predictor or explanatory) β0 = intercept (value of Y when X = 0) β1 = slope of the regression line ε = random error Regression models are used to test if there is a relationship between variables (predict sales based on payroll) There is some random error that cannot be predicted εββ ++= XY 10
12.
© 2009 Prentice-Hall,
Inc. 4 – 12 Simple Linear Regression True values for the slope and intercept are not known so they are estimated using sample data XbbY 10 +=ˆ where Y = dependent variable (response) X = independent variable (predictor or explanatory) b0 = intercept (value of Y when X = 0) b1 = slope of the regression line ^
13.
© 2009 Prentice-Hall,
Inc. 4 – 13 Triple A Construction Triple A Construction is trying to predict sales based on area payroll Y = Sales X = Area payroll The line chosen in Figure 4.1 is the one that minimizes the errors Error = (Actual value) – (Predicted value) YYe ˆ−=
14.
© 2009 Prentice-Hall,
Inc. 4 – 14 Least Squares Regression Errors can be positive or negative so the average error could be zero even though individual errors could be large. Least squares regression minimizes the sum of the squared errors. Payroll Line Fit Plot 0 2 4 6 8 10 0 2 4 6 8 Payroll ($100.000,000's) Sales ($100,000)
15.
© 2009 Prentice-Hall,
Inc. 4 – 15 Triple A Construction For the simple linear regression model, the values of the intercept and slope can be calculated using the formulas below XbbY 10 +=ˆ valuesof(mean)average X n X X == ∑ valuesof(mean)average Y n Y Y == ∑ ∑ ∑ − −− = 21 )( ))(( XX YYXX b XbYb 10 −=
16.
© 2009 Prentice-Hall,
Inc. 4 – 16 Triple A Construction Y X (X – X)2 (X – X)(Y – Y) 6 3 (3 – 4)2 = 1 (3 – 4)(6 – 7) = 1 8 4 (4 – 4)2 = 0 (4 – 4)(8 – 7) = 0 9 6 (6 – 4)2 = 4 (6 – 4)(9 – 7) = 4 5 4 (4 – 4)2 = 0 (4 – 4)(5 – 7) = 0 4.5 2 (2 – 4)2 = 4 (2 – 4)(4.5 – 7) = 5 9.5 5 (5 – 4)2 = 1 (5 – 4)(9.5 – 7) = 2.5 ΣY = 42 Y = 42/6 = 7 ΣX = 24 X = 24/6 = 4 Σ(X – X)2 = 10 Σ(X – X)(Y – Y) = 12.5 Table 4.2 Regression calculations
17.
© 2009 Prentice-Hall,
Inc. 4 – 17 Triple A Construction 4 6 24 6 === ∑ X X 7 6 42 6 === ∑Y Y 251 10 512 21 . . )( ))(( == − −− = ∑ ∑ XX YYXX b 24251710 =−=−= ))(.(XbYb Regression calculations XY 2512 .ˆ +=Therefore
18.
© 2009 Prentice-Hall,
Inc. 4 – 18 Triple A Construction 4 6 24 6 === ∑ X X 7 6 42 6 === ∑Y Y 251 10 512 21 . . )( ))(( == − −− = ∑ ∑ XX YYXX b 24251710 =−=−= ))(.(XbYb Regression calculations XY 2512 .ˆ +=Therefore sales = 2 + 1.25(payroll) If the payroll next year is $600 million 000950$or5962512 ,.)(.ˆ =+=Y
19.
© 2009 Prentice-Hall,
Inc. 4 – 19 Measuring the Fit of the Regression Model Regression models can be developed for any variables X and Y How do we know the model is actually helpful in predicting Y based on X? We could just take the average error, but the positive and negative errors would cancel each other out Three measures of variability are SST – Total variability about the mean SSE – Variability about the regression line SSR – Total variability that is explained by the model
20.
© 2009 Prentice-Hall,
Inc. 4 – 20 Measuring the Fit of the Regression Model Sum of the squares total 2 )(∑ −= YYSST Sum of the squared error ∑ ∑ −== 22 )ˆ( YYeSSE Sum of squares due to regression ∑ −= 2 )ˆ( YYSSR An important relationship SSESSRSST +=
21.
© 2009 Prentice-Hall,
Inc. 4 – 21 Measuring the Fit of the Regression Model Y X (Y – Y)2 Y (Y – Y)2 (Y – Y)2 6 3 (6 – 7)2 = 1 2 + 1.25(3) = 5.75 0.0625 1.563 8 4 (8 – 7)2 = 1 2 + 1.25(4) = 7.00 1 0 9 6 (9 – 7)2 = 4 2 + 1.25(6) = 9.50 0.25 6.25 5 4 (5 – 7)2 = 4 2 + 1.25(4) = 7.00 4 0 4.5 2 (4.5 – 7)2 = 6.25 2 + 1.25(2) = 4.50 0 6.25 9.5 5 (9.5 – 7)2 = 6.25 2 + 1.25(5) = 8.25 1.5625 1.563 ∑(Y – Y)2 = 22.5 ∑(Y – Y)2 = 6.875 ∑(Y – Y)2 = 15.625 Y = 7 SST = 22.5 SSE = 6.875 SSR = 15.625 ^ ^^ ^^ Table 4.3
22.
© 2009 Prentice-Hall,
Inc. 4 – 22 Sum of the squares total 2 )(∑ −= YYSST Sum of the squared error ∑ ∑ −== 22 )ˆ( YYeSSE Sum of squares due to regression ∑ −= 2 )ˆ( YYSSR An important relationship SSR – explained variability SSE – unexplained variability SSESSRSST += Measuring the Fit of the Regression Model For Triple A Construction SST = 22.5 SSE = 6.875 SSR = 15.625
23.
© 2009 Prentice-Hall,
Inc. 4 – 23 Measuring the Fit of the Regression Model Figure 4.2 12 – 10 – 8 – 6 – 4 – 2 – 0 – Sales($100,000) Payroll ($100 million) | | | | | | | | 0 1 2 3 4 5 6 7 8 Y = 2 + 1.25X ^ Y – Y Y – Y ^ YY – Y ^
24.
© 2009 Prentice-Hall,
Inc. 4 – 24 Coefficient of Determination The proportion of the variability in Y explained by regression equation is called the coefficient ofcoefficient of determinationdetermination The coefficient of determination is r2 SST SSE SST SSR r −== 12 For Triple A Construction 69440 522 625152 . . . ==r About 69% of the variability in Y is explained by the equation based on payroll (X)
25.
© 2009 Prentice-Hall,
Inc. 4 – 25 Correlation Coefficient The correlation coefficientcorrelation coefficient is an expression of the strength of the linear relationship It will always be between +1 and –1 The correlation coefficient is r 2 rr = For Triple A Construction 8333069440 .. ==r
26.
© 2009 Prentice-Hall,
Inc. 4 – 26 Correlation Coefficient * * * * (a) Perfect Positive Correlation: r = +1 X Y * * * * (c) No Correlation: r = 0 X Y * * * * * * * ** * (d) Perfect Negative Correlation: r = –1 X Y * * * * * * * * * (b) Positive Correlation: 0 < r < 1 X Y * * * * * * * Figure 4.3
27.
© 2009 Prentice-Hall,
Inc. 4 – 27 Using Computer Software for Regression Program 4.1A
28.
© 2009 Prentice-Hall,
Inc. 4 – 28 Using Computer Software for Regression Program 4.1B
29.
© 2009 Prentice-Hall,
Inc. 4 – 29 Using Computer Software for Regression Program 4.1C
30.
© 2009 Prentice-Hall,
Inc. 4 – 30 Using Computer Software for Regression Program 4.1D
31.
© 2009 Prentice-Hall,
Inc. 4 – 31 Using Computer Software for Regression Program 4.1D Correlation coefficient is called Multiple R in Excel
32.
© 2009 Prentice-Hall,
Inc. 4 – 32 Assumptions of the Regression Model 1. Errors are independent 2. Errors are normally distributed 3. Errors have a mean of zero 4. Errors have a constant variance If we make certain assumptions about the errors in a regression model, we can perform statistical tests to determine if the model is useful A plot of the residuals (errors) will often highlight any glaring violations of the assumption
33.
© 2009 Prentice-Hall,
Inc. 4 – 33 Residual Plots A random plot of residuals Figure 4.4A Error X
34.
© 2009 Prentice-Hall,
Inc. 4 – 34 Residual Plots Nonconstant error variance Errors increase as X increases, violating the constant variance assumption Figure 4.4B Error X
35.
© 2009 Prentice-Hall,
Inc. 4 – 35 Residual Plots Nonlinear relationship Errors consistently increasing and then consistentlyErrors consistently increasing and then consistently decreasing indicate that the model is not lineardecreasing indicate that the model is not linear Figure 4.4C Error X
36.
© 2009 Prentice-Hall,
Inc. 4 – 36 Estimating the Variance Errors are assumed to have a constant variance (σ 2 ), but we usually don’t know this It can be estimated using the meanmean squared errorsquared error (MSEMSE), s2 1 2 −− == kn SSE MSEs where n = number of observations in the sample k = number of independent variables
37.
© 2009 Prentice-Hall,
Inc. 4 – 37 Estimating the Variance For Triple A Construction 71881 4 87506 116 87506 1 2 . .. == −− = −− == kn SSE MSEs We can estimate the standard deviation, s This is also called the standard error of thestandard error of the estimateestimate or the standard deviation of thestandard deviation of the regressionregression 31171881 .. === MSEs
38.
© 2009 Prentice-Hall,
Inc. 4 – 38 Testing the Model for Significance When the sample size is too small, you can get good values for MSE and r2 even if there is no relationship between the variables Testing the model for significance helps determine if the values are meaningful We do this by performing a statistical hypothesis test
39.
© 2009 Prentice-Hall,
Inc. 4 – 39 Testing the Model for Significance We start with the general linear model εββ ++= XY 10 If β1 = 0, the null hypothesis is that there is nono relationship between X and Y The alternate hypothesis is that there isis a linear relationship (β1 ≠ 0) If the null hypothesis can be rejected, we have proven there is a relationship We use the F statistic for this test
40.
© 2009 Prentice-Hall,
Inc. 4 – 40 Testing the Model for Significance The F statistic is based on the MSE and MSR k SSR MSR = where k = number of independent variables in the model The F statistic is MSE MSR F = This describes an F distribution with degrees of freedom for the numerator = df1 = k degrees of freedom for the denominator = df2 = n – k – 1
41.
© 2009 Prentice-Hall,
Inc. 4 – 41 Testing the Model for Significance If there is very little error, the MSE would be small and the F-statistic would be large indicating the model is useful If the F-statistic is large, the significance level (p-value) will be low, indicating it is unlikely this would have occurred by chance So when the F-value is large, we can reject the null hypothesis and accept that there is a linear relationship between X and Y and the values of the MSE and r2 are meaningful
42.
© 2009 Prentice-Hall,
Inc. 4 – 42 Steps in a Hypothesis Test 1. Specify null and alternative hypotheses 010 =β:H 011 ≠β:H 2. Select the level of significance (α). Common values are 0.01 and 0.05 3. Calculate the value of the test statistic using the formula MSE MSR F =
43.
© 2009 Prentice-Hall,
Inc. 4 – 43 Steps in a Hypothesis Test 4. Make a decision using one of the following methods a) Reject the null hypothesis if the test statistic is greater than the F-value from the table in Appendix D. Otherwise, do not reject the null hypothesis: 21 ifReject dfdfcalculated FF ,,α> kdf =1 12 −−= kndf b) Reject the null hypothesis if the observed significance level, or p-value, is less than the level of significance (α). Otherwise, do not reject the null hypothesis: )( statistictestcalculatedvalue- >= FPp α<value-ifReject p
44.
© 2009 Prentice-Hall,
Inc. 4 – 44 Triple A Construction Step 1.Step 1. H0: β1 = 0 (no linear relationship between X and Y) H1: β1 ≠ 0 (linear relationship exists between X and Y)Step 2.Step 2. Select α = 0.05 625015 1 625015 . . === k SSR MSR 099 71881 625015 . . . === MSE MSR F Step 3.Step 3. Calculate the value of the test statistic
45.
© 2009 Prentice-Hall,
Inc. 4 – 45 Triple A Construction Step 4.Step 4. Reject the null hypothesis if the test statistic is greater than the F-value in Appendix D df1 = k = 1 df2 = n – k – 1 = 6 – 1 – 1 = 4 The value of F associated with a 5% level of significance and with degrees of freedom 1 and 4 is found in Appendix D F0.05,1,4 = 7.71 Fcalculated = 9.09 Reject H0 because 9.09 > 7.71
46.
© 2009 Prentice-Hall,
Inc. 4 – 46 F = 7.71 0.05 9.09 Triple A Construction Figure 4.5 We can conclude there is a statistically significant relationship between X and Y The r2 value of 0.69 means about 69% of the variability in sales (Y) is explained by local payroll (X)
47.
© 2009 Prentice-Hall,
Inc. 4 – 47 r2 coefficient of determination The F-test determines whether or not there is a relationship between the variables. r2 (coefficient of determination) is the best measure of the strength of the prediction relationship between the X and Y variables. • Values closer to 1 indicate a strong prediction relationship. • Good regression models have a low significance level for the F-test and high r2 value.
48.
© 2009 Prentice-Hall,
Inc. 4 – 48 Coefficient Hypotheses Statistical tests of significance can be performed on the coefficients. The null hypothesis is that the coefficient of X (i.e., the slope of the line) is 0 i.e., X is not useful in predicting Y P values are the observed significance level and can be used to test the null hypothesis. Values less than 5% negate the null hypothesis and indicate that X is useful in predicting Y For a simple linear regression, the test of the regression coefficients gives the same information as the F-test.
49.
© 2009 Prentice-Hall,
Inc. 4 – 49 Analysis of Variance (ANOVA) Table When software is used to develop a regression model, an ANOVA table is typically created that shows the observed significance level (p-value) for the calculated F value This can be compared to the level of significance (α) to make a decision DF SS MS F SIGNIFICANCE Regression k SSR MSR = SSR/k MSR/MSE P(F > MSR/MSE) Residual n - k - 1 SSE MSE = SSE/(n - k - 1) Total n - 1 SST Table 4.4
50.
© 2009 Prentice-Hall,
Inc. 4 – 50 ANOVA for Triple A Construction Because this probability is less than 0.05, we reject the null hypothesis of no linear relationship and conclude there is a linear relationship between X and Y Program 4.1D (partial) P(F > 9.0909) = 0.0394
51.
© 2009 Prentice-Hall,
Inc. 4 – 51 Multiple Regression Analysis Multiple regression modelsMultiple regression models are extensions to the simple linear model and allow the creation of models with several independent variables Y = β0 + β1X1 + β2X2 + … + βkXk + ε where Y = dependent variable (response variable) Xi = ith independent variable (predictor or explanatory variable) β0 = intercept (value of Y when all Xi = 0) βI = coefficient of the ith independent variable k = number of independent variables ε = random error
52.
© 2009 Prentice-Hall,
Inc. 4 – 52 Multiple Regression Analysis To estimate these values, a sample is taken the following equation developed kk XbXbXbbY ++++= ...ˆ 22110 where = predicted value of Y b0 = sample intercept (and is an estimate of β0) bi = sample coefficient of the ith variable (and is an estimate of βi) Yˆ
53.
© 2009 Prentice-Hall,
Inc. 4 – 53 Jenny Wilson Realty Jenny Wilson wants to develop a model to determine the suggested listing price for houses based on the size and age of the house kk XbXbXbbY ++++= ...ˆ 22110 where = predicted value of dependent variable (selling price) b0 = Y intercept X1 and X2 = value of the two independent variables (square footage and age) respectively b1 and b2 = slopes for X1 and X2 respectively Yˆ She selects a sample of houses that have sold recently and records the data shown in Table 4.5
54.
© 2009 Prentice-Hall,
Inc. 4 – 54 Jenny Wilson Realty SELLING PRICE ($) SQUARE FOOTAGE AGE CONDITION 95,000 1,926 30 Good 119,000 2,069 40 Excellent 124,800 1,720 30 Excellent 135,000 1,396 15 Good 142,000 1,706 32 Mint 145,000 1,847 38 Mint 159,000 1,950 27 Mint 165,000 2,323 30 Excellent 182,000 2,285 26 Mint 183,000 3,752 35 Good 200,000 2,300 18 Good 211,000 2,525 17 Good 215,000 3,800 40 Excellent 219,000 1,740 12 Mint Table 4.5
55.
© 2009 Prentice-Hall,
Inc. 4 – 55 Jenny Wilson Realty Program 4.2 21 289944146631 XXY −+=ˆ
56.
© 2009 Prentice-Hall,
Inc. 4 – 56 Evaluating Multiple Regression Models Evaluation is similar to simple linear regression models The p-value for the F-test and r2 are interpreted the same The hypothesis is different because there is more than one independent variable The F-test is investigating whether all the coefficients are equal to 0
57.
© 2009 Prentice-Hall,
Inc. 4 – 57 Evaluating Multiple Regression Models To determine which independent variables are significant, tests are performed for each variable 010 =β:H 011 ≠β:H The test statistic is calculated and if the p-value is lower than the level of significance (α), the null hypothesis is rejected
58.
© 2009 Prentice-Hall,
Inc. 4 – 58 Jenny Wilson Realty The model is statistically significant The p-value for the F-test is 0.002 r2 = 0.6719 so the model explains about 67% of the variation in selling price (Y) But the F-test is for the entire model and we can’t tell if one or both of the independent variables are significant By calculating the p-value of each variable, we can assess the significance of the individual variables Since the p-value for X1 (square footage) and X2 (age) are both less than the significance level of 0.05, both null hypotheses can be rejected
59.
© 2009 Prentice-Hall,
Inc. 4 – 59 Binary or Dummy Variables BinaryBinary (or dummydummy or indicatorindicator) variables are special variables created for qualitative data A dummy variable is assigned a value of 1 if a particular condition is met and a value of 0 otherwise The number of dummy variables must equal one less than the number of categories of the qualitative variable
60.
© 2009 Prentice-Hall,
Inc. 4 – 60 Jenny Wilson Realty Jenny believes a better model can be developed if she includes information about the condition of the property X3 = 1 if house is in excellent condition = 0 otherwise X4 = 1 if house is in mint condition = 0 otherwise Two dummy variables are used to describe the three categories of condition No variable is needed for “good” condition since if both X3 and X4 = 0, the house must be in good condition
61.
© 2009 Prentice-Hall,
Inc. 4 – 61 Jenny Wilson Realty Program 4.3
62.
© 2009 Prentice-Hall,
Inc. 4 – 62 Jenny Wilson Realty Program 4.3 Model explains about 90% of the variation in selling price F-value indicates significance Low p-values indicate each variable is significant 4321 369471623396234356658121 XXXXY ,,,.,ˆ ++−+=
63.
© 2009 Prentice-Hall,
Inc. 4 – 63 Model Building The best model is a statistically significant model with a high r2 and few variables As more variables are added to the model, the r2 -value usually increases For this reason, the adjustedadjusted rr22 value is often used to determine the usefulness of an additional variable The adjusted r2 takes into account the number of independent variables in the model When variables are added to the model, the value of r2 can never decrease; however, the adjusted r2 may decrease.
64.
© 2009 Prentice-Hall,
Inc. 4 – 64 Model Building SST SSE SST SSR −== 12 r The formula for r2 The formula for adjusted r2 )/(SST )/(SSE 1 1 1Adjusted 2 − −− −= n kn r As the number of variables increases, the adjusted r2 gets smaller unless the increase due to the new variable is large enough to offset the change in k
65.
© 2009 Prentice-Hall,
Inc. 4 – 65 Model Building It is tempting to keep adding variables to a model to try to increase r2 The adjusted r2 will decrease if additional independent variables are not beneficial. As the number of variables (k) increases, n-k-1 decreases. This causes SSE/(n-k-1) to increase which in turn decreases the adjusted r2 unless the extra variable causes a significant decrease in SSE The reduction in error (and SSE) must be sufficient to offset the change in k
66.
© 2009 Prentice-Hall,
Inc. 4 – 66 Model Building In general, if a new variable increases the adjusted r2 , it should probably be included in the model In some cases, variables contain duplicate information When two independent variables are correlated, they are said to be collinearcollinear (e.g., monthly salary(e.g., monthly salary expenses and annual salary expenses)expenses and annual salary expenses) When more than two independent variables are correlated, multicollinearitymulticollinearity exists When multicollinearity is present, hypothesis tests for the individual coefficients are not valid but the model may still be useful
67.
© 2009 Prentice-Hall,
Inc. 4 – 67 Nonlinear Regression In some situations, variables are not linear Transformations may be used to turn a nonlinear model into a linear model * * ** ** * * * Linear relationship Nonlinear relationship * * ** ** * * ** *
68.
© 2009 Prentice-Hall,
Inc. 4 – 68 Colonel Motors The engineers want to use regression analysis to improve fuel efficiency They have been asked to study the impact of weight on miles per gallon (MPG) MPG WEIGHT (1,000 LBS.) MPG WEIGHT (1,000 LBS.) 12 4.58 20 3.18 13 4.66 23 2.68 15 4.02 24 2.65 18 2.53 33 1.70 19 3.09 36 1.95 19 3.11 42 1.92 Table 4.6
69.
© 2009 Prentice-Hall,
Inc. 4 – 69 Colonel Motors Figure 4.6A 45 – 40 – 35 – 30 – 25 – 20 – 15 – 10 – 5 – 0 – | | | | | 1.00 2.00 3.00 4.00 5.00 MPG Weight (1,000 lb.) Linear model 110 XbbY +=ˆ
70.
© 2009 Prentice-Hall,
Inc. 4 – 70 Colonel Motors Program 4.4 A useful model with a small F-test for significance and a good r2 value
71.
© 2009 Prentice-Hall,
Inc. 4 – 71 Colonel Motors Figure 4.6B 45 – 40 – 35 – 30 – 25 – 20 – 15 – 10 – 5 – 0 – | | | | | 1.00 2.00 3.00 4.00 5.00 MPG Weight (1,000 lb.) Nonlinear model 2 210 weightweight )()(MPG bbb ++=
72.
© 2009 Prentice-Hall,
Inc. 4 – 72 Colonel Motors The nonlinear model is a quadratic model The easiest way to work with this model is to develop a new variable 2 2 weight)(=X This gives us a model that can be solved with linear regression software 22110 XbXbbY ++=ˆ
73.
© 2009 Prentice-Hall,
Inc. 4 – 73 Colonel Motors Program 4.5 A better model with a smaller F-test for significance and a larger adjusted r2 value 21 43230879 XXY ...ˆ +−=
74.
© 2009 Prentice-Hall,
Inc. 4 – 74 Cautions and Pitfalls If the assumptions are not met, the statistical test may not be valid Correlation does not necessarily mean causation Your annual salary and the price of cars may be correlated but one does not cause the other Multicollinearity makes interpreting coefficients problematic, but the model may still be good Using a regression model beyond the range of X is questionable, the relationship may not hold outside the sample data
75.
© 2009 Prentice-Hall,
Inc. 4 – 75 Cautions and Pitfalls t-tests for the intercept (b0) may be ignored as this point is often outside the range of the model A linear relationship may not be the best relationship, even if the F-test returns an acceptable value A nonlinear relationship can exist even if a linear relationship does not Just because a relationship is statistically significant doesn't mean it has any practical value
Download now