SlideShare a Scribd company logo
1 of 40
Download to read offline
Mixed methods in social
and behavioral sciences
ARNOND SAKWORAWICH, PH.D.
Origin of mixed methods
MTMM (Multi-trait multi-method)
Campbell and Fiske (1959)
-Convergent validity (Same trait, different methods →relatively high
correlation)
-Discriminant validity (Different traits, same method → low correlation)
-Method variance (Correlation among different traits and same method
is way higher than correlation among different traits and different
methods)
Origin of mixed methods
Triangulation
From military (and history)
-Time, space, context, motivation
Instrument Development
- Critical incident technique (Flanagan)
Behavioral Event Interview (Competency modeling by McCleland)
Positivism versus Phenomenology
• Quantitative
• Empirical data
• Scientific approach
• Try to measure and
quantify
• Study the issue by
isolating (et cetera
puberis)
• Aims at uncovering
causal relationships
among variables
• Qualitative
• Experience, insight,
intuition
• Meaning and
interpretation
• Connectedness and
complexity
• Holistic approach
• Aims at describing and
understanding
phenomenon
Why we need mixed methods?
- Dialectical perspective
◦ -Confirmation, disconfirmation
◦ - Wearing different eyeglasses, Can we still see the same thing?
◦ - What make the differences and similarities?
- Pragmatic perspective
◦ - Whatever works best for results?
◦ - Use different tools suitable for different job
◦ - Strengthen results by compensating weaknesses from one method
Fundamental components of mixed method design
Fundamental components of mixed method design
1. Timing
◦ -Concurrent
◦ - Sequential
◦ Quan then Qual
◦ Qual then Quan
2. Weighting
◦ Equal weight
◦ QUAN>qual
◦ QUAL>quan
3. Mixing
◦ -Connecting
◦ - Integrating
◦ -Embedding
4. Theorizing
◦ Explicit
◦ Implicit
Fundamental components of mixed method design
3. Mixing (between QUAN and QUAL results)
- Integrating
◦ Quantify qualitative data into quantitative data
◦ Counting, Content analysis, Frequency distribution
◦ Coding then statistical analysis
◦ Text mining
◦ Inference and disputed authorship
◦ – Federalist paper (85 papers)
◦ Alexander Hamilton
◦ James Madison
◦ John Jay
◦ Promoting ratification of the USA
Fundamental components of mixed method design
3. Mixing (between QUAN and QUAL results)
- Integrating
◦ Qualify quantitative data into qualitative data
◦ Exploratory factor analysis to investigate how variables hang together!
◦ Naming factor – make it interpretable
◦ First factor, modernism, consists of haughty, modern, lavish, clean, disciplinary, self-
confident, creative, courteous, romantic, clever, competent, and independent. Five
countries with highest score on this factor are England, France, Japan, Italy, and USA,
while five countries with lowest score are Iraq, Mexico, Brazil, Iran, and Chile.
◦ Second factor, need for power encompasses tricky, invasive, authoritarian, exploitative,
selfish, brutal, aggressive-minded, nationalistic, and brave. Five countries with higher
score on this factor are USA, Iraq, Myanmar, Iran, and Israel, while five countries with
lowest score are Ethiopia, Egypt, Italy, Singapore, and Chile.
Fundamental components of mixed method design
3. Mixing (between QUAN and QUAL results)
- Integrating
◦ Qualify quantitative data into qualitative data
◦ Third factor, namely work value, comprises avaricious, diligent, patient, economical, boisterous,
and business-minded. Five countries with highest score on this factor are China, Japan, Vietnam,
Taiwan, and Singapore, while five countries with lowest score are New Zealand, Australia, France,
Venezuela, and Italy.
◦ Fourth factor, namely positive relationship, is formed of generous, kindhearted, gregarious,
pacific, simple, and honest. Five countries with highest score on this factor are New Zealand,
Australia, Laos, Vietnam, and Canada, while five countries, while five countries with lowest score
are India, Ethiopia, Saudi Arabia, Russia, and France.
◦ Fifth factor, namely less developed, is composed of stupid, lazy, poor, and dirty. Five countries
with highest score on this factor are Laos, Cambodia, Myanmar, Ethiopia, and India, while five
countries with lowest score are Brazil, Australia, Mexico, Israel, and Taiwan.
◦ Sixth factor, namely happy go lucky-sober, includes enjoyable and pious.
◦ Five countries with highest score on this factor are USA, Brazil, while five countries with lowest
score are Iran, Iraq, Israel, England, and Vietnam.
Fundamental components of mixed method design
3. Mixing (between QUAN and QUAL results)
- Integrating
◦ Qualify quantitative data into qualitative data
◦ Cluster analysis to investigate how people or object are clustered together
-First cluster, non-salient countries
-Latin American sub-cluster
- Venezuela, Argentina, Brazil, Mexico, and Chile
-Developing sub-cluster
-Malaysia, Russia, South Korea, Germany, and Taiwan
-Second cluster, underdeveloped countries
-India, Cambodia, Myanmar, South Africa, Saudi
Arabia, and Ethiopia.
-Third cluster, warrior
-Iraq, Iran, and Israel.
-Fourth cluster, developed countries
-Italy, Singapore, Japan, France, and England
-Fifth cluster peaceful countries
-Australia, New Zealand, Canada, Laos, and Vietnam
Fundamental components of mixed method design
3. Mixing (between QUAN and QUAL results)
- Connecting
◦ - Results from QUAN are used in QUAL
◦ - Results from QUAL are used in QUAN
◦ Critical incident technique
◦ Performance appraisal form construction
- Embedding
◦ QUAN supports QUAL
◦ QUAL supports QUAN
Fundamental components of mixed method design
4. Theorizing
- Explicit
◦ Used theory (ies) or lens to guide data collection and analysis
◦ Critical theory, Postmodern, Feminist, PAR, Empowerment etc.
- Implicit
◦ Bracketing oneself!
Six basic designs for mixed method
1. Sequential Explanatory Design
- Popular among quantitative researchers
- Explain quantitative results especially unexpected results
- Typically weights QUAN more than qual.
- Mixing through connecting
- Explicit theory may or may not inform the overall procedure.
1. Sequential Explanatory Design (Example)
Hawthrone Experiment
-Illumination and relay assemble
-The darker light, the higher productivity
- Confounding
- Follow-up interview
- Human relation movement
- Elton Mayo
- Human are not machine, we need love
and care!
Another examples
-Psychological tests and assessment were administered.
- Extreme scorers were followed up by in-depth interview and
longitudinal study.
- Study of psychopathology and its prognosis and treatment.
Another examples
- Industrial survey
- Benchmarking
- Case study (success and failure, best practice and worst practice)
1. Sequential Explanatory Design
- Easy to implement
- Easy to describe and report
- Ex post facto (if QUAN is experiment)
- Lengthy duration
2. Sequential exploratory strategy
- Appropriate to study something new and we don’t know much about it.
- QUAL →quan
- Typically weights QUAL more than quan.
- Usually data are mixed through connecting. QUAL data are mixed into quan
data in a later phase.
- Design may not be implemented through theoretical perspective.
2. Sequential exploratory strategy
- Item development
- construct clarification through qualitative research
- Item are from either critical incidents or interview transcription
- Survey
- Item analysis
- Reliability analysis
- Validation
- Big Five and Lexicon approach
2. Sequential exploratory strategy
- Easy to implement
- Easy to describe and report
- Appropriate for construct / theory clarification
- Appropriate for model/theory building then model/theory testing
- QUAN can help increase external validity and generalization to another
population
- Take times
3. Sequential transformative strategy
- QUAL → quan or QUAN→qual
- Mixing through connecting
- Theoretical framework is used to guide overall research design.
4. Concurrent triangulation strategy
- Compare different approach to investigate convergence/dissimilarities
- Confirmation, disconfirmation, cross-validation, corroboration
- Typically weights equally
- Usually mix data through integration/Side-by-side comparison
(1) The group counselling offered us support which was different from the support we received from friends and family.
(4) It takes time to adjust to being HIV + and group counselling provided us with the time and opportunity to come to terms
with our new status.
(5) Group counselling was the most effective method we found in changing our behaviour. We needed the support and
companionship of the group to help us change our behavior to live effectively with HIV + .
(8) The group counselling has allowed us to make important changes in our lives. These changes have been difficult and without
the support of the group members we would not have been able to make them.
(9) Meeting with other HIV + people has provided us with a level of understanding that we have not found anywhere else.
(15) Admitting publicly that we are HIV + is a big step and concerned us all. Counselling can help the individual at this point and
provide support to reduce the level of stress. We recommend that individuals should be free to decide when the appropriate
time to go public is. However we recognize that inevitably others will come to suspect and we recommend that these people
help as much as possible when that time comes.
(17) The stress and anxiety that 'miracle cures' cause is counter productive to our health. We would rather find ways of living
positively with AIDS than relying upon drugs. We do not want to act as guinea pigs in drug trials and think that it is wrong of
researchers to excite the possibility of a cure when this is not a responsible or realistic possibility.
(18) People with AIDS is a better term than AIDS victim, but we would prefer just to be considered as people. We recognize that
everybody has to die at some point and we are no different. We want to be allowed to live our lives as completely as possible.
(19) We accept that AIDS is a terminal illness, but we suffer more shock, bitterness and fear because society stigmatizes and
discriminates against us.
5. Concurrent embedded strategy
- Same as sequential embedded strategy but save time
6. Concurrent transformative strategy
- Stereotypes towards various Thai political groups
Rationale
-People act as they believe.
- Picture inside his head = stereotype
- We use stereotype as cognitive framework and heuristics to decide and
generalize from one object to other objects.
- Stereotype is not accurate. It can cause prejudice and bias as well as conflict.
- Hostile stereotype → hostile foreign policy!
- Stereotype studies during cold war in Thailand
- 66/2523 policy agenda – Politics lead forward the military.
- About 10 Years of Taksin regime
- Red shirt (UDD), Yellow shirt (PAD), and PDRC
- The advent of coup d’etat and NCPO
Research objectives
-To study the characteristics of stereotypes towards various Thai political
groups as well as its leaders i.e. UDD, PAD, PDRC, NCPO, Taksin Shinawatra,
Yingluk Shinawatra, Sutep Theugsuban, Abhisit Vejajiva, Sondhi Limtongkul,
Prayuth Jantraocha, Democrat Party, Puerthai Party, and Thai monarchy.
- To study factors affecting those stereotypes, specifically media exposure, past
political behavior, subjective norm, and their beliefs.
- To design an intervention to mitigate the extreme stereotypes among Thais in
order to harmonize Thai society.
Stereotype
Psychological
objects
AttributesGroup
Beliefs
Subjective norms
Media exposure
Past political behaviors
-Political activity participation
-Voting behavior
Current political behaviors
-Political activity participation
-Intention to vote
-Willingness to interact with
other political groups
Three phases of research project
-Phase I: Qualitative research
- Key informant in-depth interview
- PDRC, UDD, PAD, Democrat Party, Peurthai Party- leaders
- People who participate in demonstration (UDD, PDRC, PAD)
- Converter
- Theoretical sampling (and snowball sampling)→Theoretical saturation
-Data analytic strategies – grounded theory and phenomenology
- Lists of adjective describing stereotype towards political groups
- Grounded theory of stereotype towards political groups
Three phases of research project
-Phase II: Quantitative research
- large scale survey and correlational research
- Multi-stage sampling
- Instrument development
- Data analytic strategies
◦ -Factor analysis – grouping attributes
◦ -Cluster analysis – grouping people
◦ - Multidimensional scaling - perceptual mapping
◦ - Log-linear model – Relate cluster to demographic variables
◦ - Profile analysis via multidimensional scaling – Stereotypical profiles
◦ - Dominance analysis – ranking beliefs and subjective norms predicting stereotype
◦ - SEM - modeling sterotype
Three phases of research project
-Phase III: Experimental research
- Design intervention to change the extreme stereotypes
- PAR
- Quasi-experiment
O1 X O2
O3 O4
-Repeated measure design
-ANCOVA

More Related Content

Similar to Mixed methods in social and behavioral sciences

ECH Campus: Dr Martin Connor
ECH Campus: Dr Martin ConnorECH Campus: Dr Martin Connor
ECH Campus: Dr Martin Connor
3GDR
 
EARLY METHODS SECTION1Early Methods Section.docx
EARLY METHODS SECTION1Early Methods Section.docxEARLY METHODS SECTION1Early Methods Section.docx
EARLY METHODS SECTION1Early Methods Section.docx
jacksnathalie
 
Research Methodology For A Researcher
Research Methodology For A ResearcherResearch Methodology For A Researcher
Research Methodology For A Researcher
Renee Wardowski
 
Glossary
GlossaryGlossary
Glossary
asfawm
 
Assessment and Evaluation inSocial Studies.pptx
Assessment and Evaluation inSocial Studies.pptxAssessment and Evaluation inSocial Studies.pptx
Assessment and Evaluation inSocial Studies.pptx
Rheya4
 

Similar to Mixed methods in social and behavioral sciences (19)

Mixed research methodology.pptx
Mixed research methodology.pptxMixed research methodology.pptx
Mixed research methodology.pptx
 
MODULARISM: THE MODES OF THE PROVISIONING OF SPECIFICITY-SURVEYS IN A COMPAR...
MODULARISM:  THE MODES OF THE PROVISIONING OF SPECIFICITY-SURVEYS IN A COMPAR...MODULARISM:  THE MODES OF THE PROVISIONING OF SPECIFICITY-SURVEYS IN A COMPAR...
MODULARISM: THE MODES OF THE PROVISIONING OF SPECIFICITY-SURVEYS IN A COMPAR...
 
ECH Campus: Dr Martin Connor
ECH Campus: Dr Martin ConnorECH Campus: Dr Martin Connor
ECH Campus: Dr Martin Connor
 
EARLY METHODS SECTION1Early Methods Section.docx
EARLY METHODS SECTION1Early Methods Section.docxEARLY METHODS SECTION1Early Methods Section.docx
EARLY METHODS SECTION1Early Methods Section.docx
 
Research Methodology For A Researcher
Research Methodology For A ResearcherResearch Methodology For A Researcher
Research Methodology For A Researcher
 
QNT 565 Exceptional Education - snaptutorial.com
QNT 565  Exceptional Education - snaptutorial.comQNT 565  Exceptional Education - snaptutorial.com
QNT 565 Exceptional Education - snaptutorial.com
 
Scoring and predicting risk preferences
Scoring and predicting risk preferencesScoring and predicting risk preferences
Scoring and predicting risk preferences
 
Qnt 565 Enhance teaching / snaptutorial.com
Qnt 565  Enhance teaching / snaptutorial.comQnt 565  Enhance teaching / snaptutorial.com
Qnt 565 Enhance teaching / snaptutorial.com
 
Practical Research 2 - Week 1
Practical Research 2 - Week 1Practical Research 2 - Week 1
Practical Research 2 - Week 1
 
Brm unit iii - cheet sheet
Brm   unit iii - cheet sheetBrm   unit iii - cheet sheet
Brm unit iii - cheet sheet
 
C4 - Comparison Techniques
C4 - Comparison TechniquesC4 - Comparison Techniques
C4 - Comparison Techniques
 
196309903 q-answer
196309903 q-answer196309903 q-answer
196309903 q-answer
 
Scoring and Predicting Risk Preferences
Scoring and Predicting Risk PreferencesScoring and Predicting Risk Preferences
Scoring and Predicting Risk Preferences
 
Glossary
GlossaryGlossary
Glossary
 
Methods inventory jigsaw presentation
Methods inventory jigsaw presentationMethods inventory jigsaw presentation
Methods inventory jigsaw presentation
 
From Replication Crisis to Credibility Revolution
From Replication Crisis to Credibility RevolutionFrom Replication Crisis to Credibility Revolution
From Replication Crisis to Credibility Revolution
 
Assessment and Evaluation inSocial Studies.pptx
Assessment and Evaluation inSocial Studies.pptxAssessment and Evaluation inSocial Studies.pptx
Assessment and Evaluation inSocial Studies.pptx
 
Developing taxonomies
Developing taxonomiesDeveloping taxonomies
Developing taxonomies
 
Introduction to Factor Analysis for and With Mixed Methods: British Academy ...
Introduction to Factor Analysis for and With Mixed Methods:  British Academy ...Introduction to Factor Analysis for and With Mixed Methods:  British Academy ...
Introduction to Factor Analysis for and With Mixed Methods: British Academy ...
 

More from BAINIDA

Advanced quantitative research methods in political science and pa
Advanced quantitative  research methods in political science and paAdvanced quantitative  research methods in political science and pa
Advanced quantitative research methods in political science and pa
BAINIDA
 

More from BAINIDA (20)

Advanced quantitative research methods in political science and pa
Advanced quantitative  research methods in political science and paAdvanced quantitative  research methods in political science and pa
Advanced quantitative research methods in political science and pa
 
Latest thailand election2019report
Latest thailand election2019reportLatest thailand election2019report
Latest thailand election2019report
 
Data science in medicine
Data science in medicineData science in medicine
Data science in medicine
 
Nursing data science
Nursing data scienceNursing data science
Nursing data science
 
Financial time series analysis with R@the 3rd NIDA BADS conference by Asst. p...
Financial time series analysis with R@the 3rd NIDA BADS conference by Asst. p...Financial time series analysis with R@the 3rd NIDA BADS conference by Asst. p...
Financial time series analysis with R@the 3rd NIDA BADS conference by Asst. p...
 
Statistics and big data for justice and fairness
Statistics and big data for justice and fairnessStatistics and big data for justice and fairness
Statistics and big data for justice and fairness
 
Data science and big data for business and industrial application
Data science and big data  for business and industrial applicationData science and big data  for business and industrial application
Data science and big data for business and industrial application
 
Update trend: Free digital marketing metrics for start-up
Update trend: Free digital marketing metrics for start-upUpdate trend: Free digital marketing metrics for start-up
Update trend: Free digital marketing metrics for start-up
 
Advent of ds and stat adjustment
Advent of ds and stat adjustmentAdvent of ds and stat adjustment
Advent of ds and stat adjustment
 
เมื่อ Data Science เข้ามา สถิติศาสตร์จะปรับตัวอย่างไร
เมื่อ Data Science เข้ามา สถิติศาสตร์จะปรับตัวอย่างไร เมื่อ Data Science เข้ามา สถิติศาสตร์จะปรับตัวอย่างไร
เมื่อ Data Science เข้ามา สถิติศาสตร์จะปรับตัวอย่างไร
 
Data visualization. map
Data visualization. map Data visualization. map
Data visualization. map
 
Dark data by Worapol Alex Pongpech
Dark data by Worapol Alex PongpechDark data by Worapol Alex Pongpech
Dark data by Worapol Alex Pongpech
 
Deepcut Thai word Segmentation @ NIDA
Deepcut Thai word Segmentation @ NIDADeepcut Thai word Segmentation @ NIDA
Deepcut Thai word Segmentation @ NIDA
 
Professionals and wanna be in Business Analytics and Data Science
Professionals and wanna be in Business Analytics and Data ScienceProfessionals and wanna be in Business Analytics and Data Science
Professionals and wanna be in Business Analytics and Data Science
 
Deep learning and image analytics using Python by Dr Sanparit
Deep learning and image analytics using Python by Dr SanparitDeep learning and image analytics using Python by Dr Sanparit
Deep learning and image analytics using Python by Dr Sanparit
 
Visualizing for impact final
Visualizing for impact finalVisualizing for impact final
Visualizing for impact final
 
Python programming workshop
Python programming workshopPython programming workshop
Python programming workshop
 
Second prize business plan @ the First NIDA business analytics and data scien...
Second prize business plan @ the First NIDA business analytics and data scien...Second prize business plan @ the First NIDA business analytics and data scien...
Second prize business plan @ the First NIDA business analytics and data scien...
 
Second prize data analysis @ the First NIDA business analytics and data scie...
Second prize data analysis @ the First NIDA  business analytics and data scie...Second prize data analysis @ the First NIDA  business analytics and data scie...
Second prize data analysis @ the First NIDA business analytics and data scie...
 
แผนธุรกิจ ของทีมที่ได้รางวัลชนะเลิศ The First NIDA Business Analytics and Dat...
แผนธุรกิจ ของทีมที่ได้รางวัลชนะเลิศ The First NIDA Business Analytics and Dat...แผนธุรกิจ ของทีมที่ได้รางวัลชนะเลิศ The First NIDA Business Analytics and Dat...
แผนธุรกิจ ของทีมที่ได้รางวัลชนะเลิศ The First NIDA Business Analytics and Dat...
 

Recently uploaded

Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
amitlee9823
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
karishmasinghjnh
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
amitlee9823
 
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men  🔝mahisagar🔝   Esc...➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men  🔝mahisagar🔝   Esc...
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
amitlee9823
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
amitlee9823
 
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
amitlee9823
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
only4webmaster01
 
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night StandCall Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
amitlee9823
 

Recently uploaded (20)

Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Surabaya ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
 
Abortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get CytotecAbortion pills in Jeddah | +966572737505 | Get Cytotec
Abortion pills in Jeddah | +966572737505 | Get Cytotec
 
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
👉 Amritsar Call Girl 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Phone No Amri...
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men  🔝malwa🔝   Escorts Ser...
➥🔝 7737669865 🔝▻ malwa Call-girls in Women Seeking Men 🔝malwa🔝 Escorts Ser...
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men  🔝mahisagar🔝   Esc...➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men  🔝mahisagar🔝   Esc...
➥🔝 7737669865 🔝▻ mahisagar Call-girls in Women Seeking Men 🔝mahisagar🔝 Esc...
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
 
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 7737669865 👗 Top Class Call Girl Service B...
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
Call Girls Indiranagar Just Call 👗 9155563397 👗 Top Class Call Girl Service B...
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night StandCall Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Doddaballapur Road ☎ 7737669865 🥵 Book Your One night Stand
 

Mixed methods in social and behavioral sciences

  • 1. Mixed methods in social and behavioral sciences ARNOND SAKWORAWICH, PH.D.
  • 2. Origin of mixed methods MTMM (Multi-trait multi-method) Campbell and Fiske (1959) -Convergent validity (Same trait, different methods →relatively high correlation) -Discriminant validity (Different traits, same method → low correlation) -Method variance (Correlation among different traits and same method is way higher than correlation among different traits and different methods)
  • 3. Origin of mixed methods Triangulation From military (and history) -Time, space, context, motivation Instrument Development - Critical incident technique (Flanagan) Behavioral Event Interview (Competency modeling by McCleland)
  • 4. Positivism versus Phenomenology • Quantitative • Empirical data • Scientific approach • Try to measure and quantify • Study the issue by isolating (et cetera puberis) • Aims at uncovering causal relationships among variables • Qualitative • Experience, insight, intuition • Meaning and interpretation • Connectedness and complexity • Holistic approach • Aims at describing and understanding phenomenon
  • 5. Why we need mixed methods? - Dialectical perspective ◦ -Confirmation, disconfirmation ◦ - Wearing different eyeglasses, Can we still see the same thing? ◦ - What make the differences and similarities? - Pragmatic perspective ◦ - Whatever works best for results? ◦ - Use different tools suitable for different job ◦ - Strengthen results by compensating weaknesses from one method
  • 6. Fundamental components of mixed method design
  • 7. Fundamental components of mixed method design 1. Timing ◦ -Concurrent ◦ - Sequential ◦ Quan then Qual ◦ Qual then Quan 2. Weighting ◦ Equal weight ◦ QUAN>qual ◦ QUAL>quan 3. Mixing ◦ -Connecting ◦ - Integrating ◦ -Embedding 4. Theorizing ◦ Explicit ◦ Implicit
  • 8. Fundamental components of mixed method design 3. Mixing (between QUAN and QUAL results) - Integrating ◦ Quantify qualitative data into quantitative data ◦ Counting, Content analysis, Frequency distribution ◦ Coding then statistical analysis ◦ Text mining ◦ Inference and disputed authorship ◦ – Federalist paper (85 papers) ◦ Alexander Hamilton ◦ James Madison ◦ John Jay ◦ Promoting ratification of the USA
  • 9. Fundamental components of mixed method design 3. Mixing (between QUAN and QUAL results) - Integrating ◦ Qualify quantitative data into qualitative data ◦ Exploratory factor analysis to investigate how variables hang together! ◦ Naming factor – make it interpretable ◦ First factor, modernism, consists of haughty, modern, lavish, clean, disciplinary, self- confident, creative, courteous, romantic, clever, competent, and independent. Five countries with highest score on this factor are England, France, Japan, Italy, and USA, while five countries with lowest score are Iraq, Mexico, Brazil, Iran, and Chile. ◦ Second factor, need for power encompasses tricky, invasive, authoritarian, exploitative, selfish, brutal, aggressive-minded, nationalistic, and brave. Five countries with higher score on this factor are USA, Iraq, Myanmar, Iran, and Israel, while five countries with lowest score are Ethiopia, Egypt, Italy, Singapore, and Chile.
  • 10. Fundamental components of mixed method design 3. Mixing (between QUAN and QUAL results) - Integrating ◦ Qualify quantitative data into qualitative data ◦ Third factor, namely work value, comprises avaricious, diligent, patient, economical, boisterous, and business-minded. Five countries with highest score on this factor are China, Japan, Vietnam, Taiwan, and Singapore, while five countries with lowest score are New Zealand, Australia, France, Venezuela, and Italy. ◦ Fourth factor, namely positive relationship, is formed of generous, kindhearted, gregarious, pacific, simple, and honest. Five countries with highest score on this factor are New Zealand, Australia, Laos, Vietnam, and Canada, while five countries, while five countries with lowest score are India, Ethiopia, Saudi Arabia, Russia, and France. ◦ Fifth factor, namely less developed, is composed of stupid, lazy, poor, and dirty. Five countries with highest score on this factor are Laos, Cambodia, Myanmar, Ethiopia, and India, while five countries with lowest score are Brazil, Australia, Mexico, Israel, and Taiwan. ◦ Sixth factor, namely happy go lucky-sober, includes enjoyable and pious. ◦ Five countries with highest score on this factor are USA, Brazil, while five countries with lowest score are Iran, Iraq, Israel, England, and Vietnam.
  • 11. Fundamental components of mixed method design 3. Mixing (between QUAN and QUAL results) - Integrating ◦ Qualify quantitative data into qualitative data ◦ Cluster analysis to investigate how people or object are clustered together
  • 12. -First cluster, non-salient countries -Latin American sub-cluster - Venezuela, Argentina, Brazil, Mexico, and Chile -Developing sub-cluster -Malaysia, Russia, South Korea, Germany, and Taiwan -Second cluster, underdeveloped countries -India, Cambodia, Myanmar, South Africa, Saudi Arabia, and Ethiopia. -Third cluster, warrior -Iraq, Iran, and Israel. -Fourth cluster, developed countries -Italy, Singapore, Japan, France, and England -Fifth cluster peaceful countries -Australia, New Zealand, Canada, Laos, and Vietnam
  • 13. Fundamental components of mixed method design 3. Mixing (between QUAN and QUAL results) - Connecting ◦ - Results from QUAN are used in QUAL ◦ - Results from QUAL are used in QUAN ◦ Critical incident technique ◦ Performance appraisal form construction - Embedding ◦ QUAN supports QUAL ◦ QUAL supports QUAN
  • 14. Fundamental components of mixed method design 4. Theorizing - Explicit ◦ Used theory (ies) or lens to guide data collection and analysis ◦ Critical theory, Postmodern, Feminist, PAR, Empowerment etc. - Implicit ◦ Bracketing oneself!
  • 15. Six basic designs for mixed method
  • 16. 1. Sequential Explanatory Design - Popular among quantitative researchers - Explain quantitative results especially unexpected results - Typically weights QUAN more than qual. - Mixing through connecting - Explicit theory may or may not inform the overall procedure.
  • 17. 1. Sequential Explanatory Design (Example) Hawthrone Experiment -Illumination and relay assemble -The darker light, the higher productivity - Confounding - Follow-up interview - Human relation movement - Elton Mayo - Human are not machine, we need love and care!
  • 18. Another examples -Psychological tests and assessment were administered. - Extreme scorers were followed up by in-depth interview and longitudinal study. - Study of psychopathology and its prognosis and treatment.
  • 19. Another examples - Industrial survey - Benchmarking - Case study (success and failure, best practice and worst practice)
  • 20. 1. Sequential Explanatory Design - Easy to implement - Easy to describe and report - Ex post facto (if QUAN is experiment) - Lengthy duration
  • 21. 2. Sequential exploratory strategy - Appropriate to study something new and we don’t know much about it. - QUAL →quan - Typically weights QUAL more than quan. - Usually data are mixed through connecting. QUAL data are mixed into quan data in a later phase. - Design may not be implemented through theoretical perspective.
  • 22.
  • 23. 2. Sequential exploratory strategy - Item development - construct clarification through qualitative research - Item are from either critical incidents or interview transcription - Survey - Item analysis - Reliability analysis - Validation - Big Five and Lexicon approach
  • 24. 2. Sequential exploratory strategy - Easy to implement - Easy to describe and report - Appropriate for construct / theory clarification - Appropriate for model/theory building then model/theory testing - QUAN can help increase external validity and generalization to another population - Take times
  • 25. 3. Sequential transformative strategy - QUAL → quan or QUAN→qual - Mixing through connecting - Theoretical framework is used to guide overall research design.
  • 26.
  • 27.
  • 28. 4. Concurrent triangulation strategy - Compare different approach to investigate convergence/dissimilarities - Confirmation, disconfirmation, cross-validation, corroboration - Typically weights equally - Usually mix data through integration/Side-by-side comparison
  • 29.
  • 30.
  • 31. (1) The group counselling offered us support which was different from the support we received from friends and family. (4) It takes time to adjust to being HIV + and group counselling provided us with the time and opportunity to come to terms with our new status. (5) Group counselling was the most effective method we found in changing our behaviour. We needed the support and companionship of the group to help us change our behavior to live effectively with HIV + . (8) The group counselling has allowed us to make important changes in our lives. These changes have been difficult and without the support of the group members we would not have been able to make them. (9) Meeting with other HIV + people has provided us with a level of understanding that we have not found anywhere else. (15) Admitting publicly that we are HIV + is a big step and concerned us all. Counselling can help the individual at this point and provide support to reduce the level of stress. We recommend that individuals should be free to decide when the appropriate time to go public is. However we recognize that inevitably others will come to suspect and we recommend that these people help as much as possible when that time comes. (17) The stress and anxiety that 'miracle cures' cause is counter productive to our health. We would rather find ways of living positively with AIDS than relying upon drugs. We do not want to act as guinea pigs in drug trials and think that it is wrong of researchers to excite the possibility of a cure when this is not a responsible or realistic possibility. (18) People with AIDS is a better term than AIDS victim, but we would prefer just to be considered as people. We recognize that everybody has to die at some point and we are no different. We want to be allowed to live our lives as completely as possible. (19) We accept that AIDS is a terminal illness, but we suffer more shock, bitterness and fear because society stigmatizes and discriminates against us.
  • 32. 5. Concurrent embedded strategy - Same as sequential embedded strategy but save time
  • 34. - Stereotypes towards various Thai political groups
  • 35. Rationale -People act as they believe. - Picture inside his head = stereotype - We use stereotype as cognitive framework and heuristics to decide and generalize from one object to other objects. - Stereotype is not accurate. It can cause prejudice and bias as well as conflict. - Hostile stereotype → hostile foreign policy! - Stereotype studies during cold war in Thailand - 66/2523 policy agenda – Politics lead forward the military. - About 10 Years of Taksin regime - Red shirt (UDD), Yellow shirt (PAD), and PDRC - The advent of coup d’etat and NCPO
  • 36. Research objectives -To study the characteristics of stereotypes towards various Thai political groups as well as its leaders i.e. UDD, PAD, PDRC, NCPO, Taksin Shinawatra, Yingluk Shinawatra, Sutep Theugsuban, Abhisit Vejajiva, Sondhi Limtongkul, Prayuth Jantraocha, Democrat Party, Puerthai Party, and Thai monarchy. - To study factors affecting those stereotypes, specifically media exposure, past political behavior, subjective norm, and their beliefs. - To design an intervention to mitigate the extreme stereotypes among Thais in order to harmonize Thai society.
  • 37. Stereotype Psychological objects AttributesGroup Beliefs Subjective norms Media exposure Past political behaviors -Political activity participation -Voting behavior Current political behaviors -Political activity participation -Intention to vote -Willingness to interact with other political groups
  • 38. Three phases of research project -Phase I: Qualitative research - Key informant in-depth interview - PDRC, UDD, PAD, Democrat Party, Peurthai Party- leaders - People who participate in demonstration (UDD, PDRC, PAD) - Converter - Theoretical sampling (and snowball sampling)→Theoretical saturation -Data analytic strategies – grounded theory and phenomenology - Lists of adjective describing stereotype towards political groups - Grounded theory of stereotype towards political groups
  • 39. Three phases of research project -Phase II: Quantitative research - large scale survey and correlational research - Multi-stage sampling - Instrument development - Data analytic strategies ◦ -Factor analysis – grouping attributes ◦ -Cluster analysis – grouping people ◦ - Multidimensional scaling - perceptual mapping ◦ - Log-linear model – Relate cluster to demographic variables ◦ - Profile analysis via multidimensional scaling – Stereotypical profiles ◦ - Dominance analysis – ranking beliefs and subjective norms predicting stereotype ◦ - SEM - modeling sterotype
  • 40. Three phases of research project -Phase III: Experimental research - Design intervention to change the extreme stereotypes - PAR - Quasi-experiment O1 X O2 O3 O4 -Repeated measure design -ANCOVA