SlideShare una empresa de Scribd logo
1 de 19
Copyright © 2008, SAS Institute Inc. All rights reserved.
Practical Design for
Discrete Choice
Experiments
Bradley Jones, SAS Institute
August 13, 2008
Copyright © 2008, SAS Institute Inc. All rights reserved.
DEMA 2008, August 2008,
Cambridge
2
 Respondents indicate the alternative they prefer most in
each choice set
 Alternatives are called profiles
 Each profile is a combination of attribute levels
 Choice sets typically consist of two, three or four profiles
Discrete Choice Experiment Setup
Copyright © 2008, SAS Institute Inc. All rights reserved.
Example: Marketing a new laptop computer
Attributes Levels
Hard Drive 40 GB 80 GB
Speed 1.5 GHz 2.0 GHz
Battery Life 4 hours6 hours
Price $1,000 $1,200 $1,500
DEMA 2008, August 2008,
Cambridge
3
Copyright © 2008, SAS Institute Inc. All rights reserved.
Sample Choice Set
Hard Disk Speed Battery Price
40Gig 1.5GHz 6hours $1,000
40Gig 2.0GHz 4hours $1,500
Check the box for the laptop you prefer.
Profile 1
Profile 2
4DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
5
multinomial logit model
based on the random utilities model
where xjs represents the attribute levels and β is the set of
parameter values
probability of choosing alternative j in choice set s
Statistical model
ε′= +js js jsU xβ
=1
option chosen
in choice set
js
ts
js J
t
j e
p
s e
′
′
 
= ÷
  ∑
xβ
xβ
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
D criterion - minimize the determinant of the variance matrix of
the estimators:
( )( )1
det −
M Xβ,
Design optimality criterion
DEMA 2008, August 2008,
Cambridge
6
Equivalently – maximize the determinant of the
information matrix, M.
Copyright © 2008, SAS Institute Inc. All rights reserved.
7
Bayesian optimal designs:
• construct a prior distribution for the parameters
• find design that performs best on average
• Sándor & Wedel (2001, 2002, 2005)
Dependence on the unknown parameter, β
( ) ( ) ( ) ( )( )
1
,
S
s s s s s
s=
′ ′= −∑M Xβ X P β p β p β X
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Design for Nonlinear Models
To design an informative experiment …..
You need to know something about the response function …..
And about the parameter values.
8DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian D-Optimal Design
Bayesian ideas are natural to cope with the fact that
the information matrix, M, depends on β.
Chaloner and Larntz (1986) developed a Bayesian D-
Optimality criterion:
Φ(d) = ∫ log det [M(β;d)] p(β) dβ
9DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Computing Bayesian D-Optimal Designs
A major impediment to Bayesian D-optimal design
has been COMPUTATIONAL.
The integral over β can be VERY SLOW.
It must be computed MANY TIMES in the course of
finding an optimal design.
10DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian Computations
Gotwalt, Jones and Steinberg (2007) use a quadrature
method, due to Mysovskikh.
This method is guaranteed to exactly integrate all
polynomials up to 5th degree and all odd-degree
monomials.
With p parameters, it requires just O(p2) function evaluations.
11DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature
Assume a normal prior with independence.
• Center the integral about the prior mean.
• Scale each variable by its standard deviation.
• Integrate over distance from the prior mean and, at
each distance, over a spherical shell.
12DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature continued…
Radial integral: Generalized Gauss-LaGuerre
quadrature, with an extra point at the origin.
Spherical integrals: The Mysovskikh quadrature
scheme.
13DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Spherical integral
A simplex, its edge midpoints on the sphere, and
the inverses of all of these points.
Simplex point weights: p(7-p)/2(p+1)2(p+2).
Mid-point weights: 2(p-1)2/p(p+1)2(p+2).
14DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Simplex point
Mid-point
Each point is both a simplex
point and a mid-point.
All weights equal1/6.
Quadrature points in two dimensions
15DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Study Description
16 Respondents – 8 developers 8 sales & marketing
9 Male 7 Female
2 Surveys with 6 choice sets in each
Respondents were assigned randomly to surveys
blocked by job function
16DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Software Demonstration
17DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Conclusions
1) Discrete Choice Conjoint Experiments require design
methods for nonlinear models.
2) D-Optimal Bayesian designs reduce the dependence
of the design on the unknown parameters.
3) New quadrature methods make computation of these
designs much faster.
4) Commercial software makes carrying out such
studies simple and efficient.
18DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
References
Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press.
Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero
Ordinate,” Mathematics ofComputation, 19, 287-296.
Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304.
Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete
choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L.,
eds. Amsterdam: JAI Press, 93-117.
Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings
accepted at Technometrics.
Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307-
317.
McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New
York: Academic Press, 105-142.
Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs,
Technometrics 37: 60-69.
Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical
Association 92: 664-674.
Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research
38: 430-444.
19DEMA 2008, August 2008,
Cambridge

Más contenido relacionado

Destacado

Pre production 1
Pre production 1Pre production 1
Pre production 1ecsmedia
 
Acre test and catholic schools
Acre test and catholic schoolsAcre test and catholic schools
Acre test and catholic schoolsmarmartin6
 
fisiogramas
fisiogramasfisiogramas
fisiogramasmulanci
 
Taller de cuina
Taller de cuinaTaller de cuina
Taller de cuinacolonovi
 
Digi rex 1
Digi rex 1Digi rex 1
Digi rex 1Anamirza
 
20091109 EC Gaal Broadcasting Tvi
20091109 EC Gaal Broadcasting Tvi20091109 EC Gaal Broadcasting Tvi
20091109 EC Gaal Broadcasting Tvigaalnorb
 
Présentation Gradle au LyonJUG par Grégory Boissinot - Zenika
Présentation Gradle au LyonJUG par Grégory Boissinot - ZenikaPrésentation Gradle au LyonJUG par Grégory Boissinot - Zenika
Présentation Gradle au LyonJUG par Grégory Boissinot - ZenikaZenika
 
questionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txtquestionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txtsahilsahoo85
 
Azure in Developer Perspective
Azure in Developer PerspectiveAzure in Developer Perspective
Azure in Developer Perspectiverizaon
 
JavaScript Tools Overview
JavaScript Tools OverviewJavaScript Tools Overview
JavaScript Tools OverviewScott Povlot
 
Aging and caring
Aging and caringAging and caring
Aging and caringsrischer
 
La Fète des cerisesSavio cereijo, veronica
La Fète des cerisesSavio cereijo, veronicaLa Fète des cerisesSavio cereijo, veronica
La Fète des cerisesSavio cereijo, veronicakedougou
 
12 chris larkin six month reviews
12 chris larkin six month reviews12 chris larkin six month reviews
12 chris larkin six month reviewsbluebuilding
 
ADAPTACIÓ A L'ESCOLA P3 2011-2012
ADAPTACIÓ A L'ESCOLA P3 2011-2012ADAPTACIÓ A L'ESCOLA P3 2011-2012
ADAPTACIÓ A L'ESCOLA P3 2011-2012maribelcuevas
 
Dieci Domande Che Dio Non Ti Farà
Dieci Domande Che  Dio Non Ti FaràDieci Domande Che  Dio Non Ti Farà
Dieci Domande Che Dio Non Ti Faràbit15
 

Destacado (20)

Pre production 1
Pre production 1Pre production 1
Pre production 1
 
Acre test and catholic schools
Acre test and catholic schoolsAcre test and catholic schools
Acre test and catholic schools
 
fisiogramas
fisiogramasfisiogramas
fisiogramas
 
Taller de cuina
Taller de cuinaTaller de cuina
Taller de cuina
 
Digi rex 1
Digi rex 1Digi rex 1
Digi rex 1
 
20091109 EC Gaal Broadcasting Tvi
20091109 EC Gaal Broadcasting Tvi20091109 EC Gaal Broadcasting Tvi
20091109 EC Gaal Broadcasting Tvi
 
Friendshp
FriendshpFriendshp
Friendshp
 
My Portfolio
My PortfolioMy Portfolio
My Portfolio
 
Shop and pump track
Shop and pump trackShop and pump track
Shop and pump track
 
Présentation Gradle au LyonJUG par Grégory Boissinot - Zenika
Présentation Gradle au LyonJUG par Grégory Boissinot - ZenikaPrésentation Gradle au LyonJUG par Grégory Boissinot - Zenika
Présentation Gradle au LyonJUG par Grégory Boissinot - Zenika
 
questionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txtquestionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txt
 
Azure in Developer Perspective
Azure in Developer PerspectiveAzure in Developer Perspective
Azure in Developer Perspective
 
JavaScript Tools Overview
JavaScript Tools OverviewJavaScript Tools Overview
JavaScript Tools Overview
 
Aging and caring
Aging and caringAging and caring
Aging and caring
 
La Fète des cerisesSavio cereijo, veronica
La Fète des cerisesSavio cereijo, veronicaLa Fète des cerisesSavio cereijo, veronica
La Fète des cerisesSavio cereijo, veronica
 
Datasheet
DatasheetDatasheet
Datasheet
 
12 chris larkin six month reviews
12 chris larkin six month reviews12 chris larkin six month reviews
12 chris larkin six month reviews
 
upload test2
upload test2upload test2
upload test2
 
ADAPTACIÓ A L'ESCOLA P3 2011-2012
ADAPTACIÓ A L'ESCOLA P3 2011-2012ADAPTACIÓ A L'ESCOLA P3 2011-2012
ADAPTACIÓ A L'ESCOLA P3 2011-2012
 
Dieci Domande Che Dio Non Ti Farà
Dieci Domande Che  Dio Non Ti FaràDieci Domande Che  Dio Non Ti Farà
Dieci Domande Che Dio Non Ti Farà
 

Similar a upload test2

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Anubhav Jain
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testingSteven Li
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1David Panek
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsUniversity of Washington
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15MLconf
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsYoung-Geun Choi
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientFabian Pedregosa
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAnubhav Jain
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 018threspecter
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic HashingIkuro Sato
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Ali Shahed
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...gregoryg
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...Phuong Dx
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET Journal
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...aimsnist
 

Similar a upload test2 (20)

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testing
 
Srikanta Mishra
Srikanta MishraSrikanta Mishra
Srikanta Mishra
 
Vldb14
Vldb14Vldb14
Vldb14
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1
 
Staad pro
Staad proStaad pro
Staad pro
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD Models
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep models
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradient
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design Problems
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 01
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic Hashing
 
Real Time Geodemographics
Real Time GeodemographicsReal Time Geodemographics
Real Time Geodemographics
 
Licentiate Defense Slide
Licentiate Defense SlideLicentiate Defense Slide
Licentiate Defense Slide
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...
 

Más de sahilsahoo85 (20)

sigproc-sp.pdf
sigproc-sp.pdfsigproc-sp.pdf
sigproc-sp.pdf
 
CHANGELOG.txt
CHANGELOG.txtCHANGELOG.txt
CHANGELOG.txt
 
testing_7.ppt
testing_7.ppttesting_7.ppt
testing_7.ppt
 
testing_6.ppt
testing_6.ppttesting_6.ppt
testing_6.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_4.ppt
testing_4.ppttesting_4.ppt
testing_4.ppt
 
testing_3.ppt
testing_3.ppttesting_3.ppt
testing_3.ppt
 
testing_2.ppt
testing_2.ppttesting_2.ppt
testing_2.ppt
 
testing_1.ppt
testing_1.ppttesting_1.ppt
testing_1.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
ccccccc.ppt
ccccccc.pptccccccc.ppt
ccccccc.ppt
 
testing.ppt
testing.ppttesting.ppt
testing.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
upload test2
upload test2upload test2
upload test2
 
upload test2
upload test2upload test2
upload test2
 

upload test2

  • 1. Copyright © 2008, SAS Institute Inc. All rights reserved. Practical Design for Discrete Choice Experiments Bradley Jones, SAS Institute August 13, 2008
  • 2. Copyright © 2008, SAS Institute Inc. All rights reserved. DEMA 2008, August 2008, Cambridge 2  Respondents indicate the alternative they prefer most in each choice set  Alternatives are called profiles  Each profile is a combination of attribute levels  Choice sets typically consist of two, three or four profiles Discrete Choice Experiment Setup
  • 3. Copyright © 2008, SAS Institute Inc. All rights reserved. Example: Marketing a new laptop computer Attributes Levels Hard Drive 40 GB 80 GB Speed 1.5 GHz 2.0 GHz Battery Life 4 hours6 hours Price $1,000 $1,200 $1,500 DEMA 2008, August 2008, Cambridge 3
  • 4. Copyright © 2008, SAS Institute Inc. All rights reserved. Sample Choice Set Hard Disk Speed Battery Price 40Gig 1.5GHz 6hours $1,000 40Gig 2.0GHz 4hours $1,500 Check the box for the laptop you prefer. Profile 1 Profile 2 4DEMA 2008, August 2008, Cambridge
  • 5. Copyright © 2008, SAS Institute Inc. All rights reserved. 5 multinomial logit model based on the random utilities model where xjs represents the attribute levels and β is the set of parameter values probability of choosing alternative j in choice set s Statistical model ε′= +js js jsU xβ =1 option chosen in choice set js ts js J t j e p s e ′ ′   = ÷   ∑ xβ xβ DEMA 2008, August 2008, Cambridge
  • 6. Copyright © 2008, SAS Institute Inc. All rights reserved. D criterion - minimize the determinant of the variance matrix of the estimators: ( )( )1 det − M Xβ, Design optimality criterion DEMA 2008, August 2008, Cambridge 6 Equivalently – maximize the determinant of the information matrix, M.
  • 7. Copyright © 2008, SAS Institute Inc. All rights reserved. 7 Bayesian optimal designs: • construct a prior distribution for the parameters • find design that performs best on average • Sándor & Wedel (2001, 2002, 2005) Dependence on the unknown parameter, β ( ) ( ) ( ) ( )( ) 1 , S s s s s s s= ′ ′= −∑M Xβ X P β p β p β X DEMA 2008, August 2008, Cambridge
  • 8. Copyright © 2008, SAS Institute Inc. All rights reserved. Design for Nonlinear Models To design an informative experiment ….. You need to know something about the response function ….. And about the parameter values. 8DEMA 2008, August 2008, Cambridge
  • 9. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian D-Optimal Design Bayesian ideas are natural to cope with the fact that the information matrix, M, depends on β. Chaloner and Larntz (1986) developed a Bayesian D- Optimality criterion: Φ(d) = ∫ log det [M(β;d)] p(β) dβ 9DEMA 2008, August 2008, Cambridge
  • 10. Copyright © 2008, SAS Institute Inc. All rights reserved. Computing Bayesian D-Optimal Designs A major impediment to Bayesian D-optimal design has been COMPUTATIONAL. The integral over β can be VERY SLOW. It must be computed MANY TIMES in the course of finding an optimal design. 10DEMA 2008, August 2008, Cambridge
  • 11. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian Computations Gotwalt, Jones and Steinberg (2007) use a quadrature method, due to Mysovskikh. This method is guaranteed to exactly integrate all polynomials up to 5th degree and all odd-degree monomials. With p parameters, it requires just O(p2) function evaluations. 11DEMA 2008, August 2008, Cambridge
  • 12. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature Assume a normal prior with independence. • Center the integral about the prior mean. • Scale each variable by its standard deviation. • Integrate over distance from the prior mean and, at each distance, over a spherical shell. 12DEMA 2008, August 2008, Cambridge
  • 13. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature continued… Radial integral: Generalized Gauss-LaGuerre quadrature, with an extra point at the origin. Spherical integrals: The Mysovskikh quadrature scheme. 13DEMA 2008, August 2008, Cambridge
  • 14. Copyright © 2008, SAS Institute Inc. All rights reserved. Spherical integral A simplex, its edge midpoints on the sphere, and the inverses of all of these points. Simplex point weights: p(7-p)/2(p+1)2(p+2). Mid-point weights: 2(p-1)2/p(p+1)2(p+2). 14DEMA 2008, August 2008, Cambridge
  • 15. Copyright © 2008, SAS Institute Inc. All rights reserved. Simplex point Mid-point Each point is both a simplex point and a mid-point. All weights equal1/6. Quadrature points in two dimensions 15DEMA 2008, August 2008, Cambridge
  • 16. Copyright © 2008, SAS Institute Inc. All rights reserved. Study Description 16 Respondents – 8 developers 8 sales & marketing 9 Male 7 Female 2 Surveys with 6 choice sets in each Respondents were assigned randomly to surveys blocked by job function 16DEMA 2008, August 2008, Cambridge
  • 17. Copyright © 2008, SAS Institute Inc. All rights reserved. Software Demonstration 17DEMA 2008, August 2008, Cambridge
  • 18. Copyright © 2008, SAS Institute Inc. All rights reserved. Conclusions 1) Discrete Choice Conjoint Experiments require design methods for nonlinear models. 2) D-Optimal Bayesian designs reduce the dependence of the design on the unknown parameters. 3) New quadrature methods make computation of these designs much faster. 4) Commercial software makes carrying out such studies simple and efficient. 18DEMA 2008, August 2008, Cambridge
  • 19. Copyright © 2008, SAS Institute Inc. All rights reserved. References Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press. Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero Ordinate,” Mathematics ofComputation, 19, 287-296. Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304. Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L., eds. Amsterdam: JAI Press, 93-117. Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings accepted at Technometrics. Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307- 317. McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New York: Academic Press, 105-142. Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs, Technometrics 37: 60-69. Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical Association 92: 664-674. Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research 38: 430-444. 19DEMA 2008, August 2008, Cambridge