SlideShare una empresa de Scribd logo
1 de 29
ILCS Raking
    Motivate Need and
Illustrate Basic Approach
What is Raking?
• A way to Adjust Survey totals “t” to
  Independent Controls “T”
• Takes existing Survey Weights,
  usually wij = 1/pij, where pij is
  probability of selection
• Ratios them up to each total T in
  turn, until results are as close as
  wanted
What is the Value?
• Can increase stability of survey
  results
     Reduce Sample Variance
• Get results that are close to
  desired outcomes
     Reduce bias arising from
  minor operational errors
What Results to Expect?
• If Controls are Reasonable,
  Raking Process will converge
  (“Hit” all controls)
• And improve survey results
  related to Control Totals
More Information Quality
• Only Weights are Changed by
  Raking, not Survey Data
• Data Quality is thus
  unchanged
• But Information Quality is
  usually Improved
What Does Raking Cost?
• Usually Done quickly on a PC
• Independent Controls Need to be
  consistent with each other
• Sample must be reasonably large
  for Raking to be Safely Applied
• Some Costs incurred to explain
  Method
Raking Made Simple
• “Fudge” Factor Intuition
• Develop a ratio of target total
  divided by sample total
• Repeat this process with each
  of the controls in turn
NSS Example from ILCS
While the NSS RA survey is raked
across 4 dimensions (age, gender,
marz and urban/rural), the example
we’ll use here will just use two
dimensions.
Table 1. Raking Example –
  Source Survey Data
Table 2: Desired Marginals
First Ratio Adjustment
Second Ratio Adjustment
After Second Iteration
ISLS Benefits Achieved

• Reduction in Bias
• Reduction (hopefully) in Variance
• Survey Results are Consistent with
  Census Projections
Again Many Thanks
Data Quality and Record
  Linkage Techniques
     Springer 2007
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking
ILCS Raking

Más contenido relacionado

Similar a ILCS Raking

R - what do the numbers mean? #RStats
R - what do the numbers mean? #RStatsR - what do the numbers mean? #RStats
R - what do the numbers mean? #RStatsJen Stirrup
 
Data Collection Preparation
Data Collection PreparationData Collection Preparation
Data Collection PreparationBusiness Student
 
Introduction to Data Management in Human Ecology
Introduction to Data Management in Human EcologyIntroduction to Data Management in Human Ecology
Introduction to Data Management in Human EcologyKern Rocke
 
Presentation of Project and Critique.pptx
Presentation of Project and Critique.pptxPresentation of Project and Critique.pptx
Presentation of Project and Critique.pptxBillyMoses1
 
Audit and stat for medical professionals
Audit and stat for medical professionalsAudit and stat for medical professionals
Audit and stat for medical professionalsNadir Mehmood
 
Sample size calculation
Sample  size calculationSample  size calculation
Sample size calculationSwati Singh
 
Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...
Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...
Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...The Transfer Project
 
Bio-Statistics in Bio-Medical research
Bio-Statistics in Bio-Medical researchBio-Statistics in Bio-Medical research
Bio-Statistics in Bio-Medical researchShinjan Patra
 
webinar introducing measurement for improvement
webinar introducing measurement for improvementwebinar introducing measurement for improvement
webinar introducing measurement for improvementNHS Improving Quality
 
5. testing differences
5. testing differences5. testing differences
5. testing differencesSteve Saffhill
 
4 Inferential Statistics IV - April 7 2014.pdf
4 Inferential Statistics IV - April 7 2014.pdf4 Inferential Statistics IV - April 7 2014.pdf
4 Inferential Statistics IV - April 7 2014.pdfBijayThapa30
 
'A critique of testing' UK TMF forum January 2015
'A critique of testing' UK TMF forum January 2015 'A critique of testing' UK TMF forum January 2015
'A critique of testing' UK TMF forum January 2015 Georgina Tilby
 

Similar a ILCS Raking (20)

Inferential Statistics
Inferential StatisticsInferential Statistics
Inferential Statistics
 
R - what do the numbers mean? #RStats
R - what do the numbers mean? #RStatsR - what do the numbers mean? #RStats
R - what do the numbers mean? #RStats
 
TCI in primary care - SEM (2006)
TCI in primary care - SEM (2006)TCI in primary care - SEM (2006)
TCI in primary care - SEM (2006)
 
MD poverty indexes
MD poverty indexesMD poverty indexes
MD poverty indexes
 
IFPRI- Impact Surveys 1
IFPRI- Impact Surveys 1IFPRI- Impact Surveys 1
IFPRI- Impact Surveys 1
 
Data Collection Preparation
Data Collection PreparationData Collection Preparation
Data Collection Preparation
 
Introduction to Data Management in Human Ecology
Introduction to Data Management in Human EcologyIntroduction to Data Management in Human Ecology
Introduction to Data Management in Human Ecology
 
Statistics
StatisticsStatistics
Statistics
 
Presentation of Project and Critique.pptx
Presentation of Project and Critique.pptxPresentation of Project and Critique.pptx
Presentation of Project and Critique.pptx
 
Audit and stat for medical professionals
Audit and stat for medical professionalsAudit and stat for medical professionals
Audit and stat for medical professionals
 
Sample size calculation
Sample  size calculationSample  size calculation
Sample size calculation
 
Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...
Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...
Impact Evaluation Training with AERC: China Cash Transfer Programme Technical...
 
Bio-Statistics in Bio-Medical research
Bio-Statistics in Bio-Medical researchBio-Statistics in Bio-Medical research
Bio-Statistics in Bio-Medical research
 
webinar introducing measurement for improvement
webinar introducing measurement for improvementwebinar introducing measurement for improvement
webinar introducing measurement for improvement
 
Medicines Breakthrough Collaborative 1
Medicines Breakthrough Collaborative 1Medicines Breakthrough Collaborative 1
Medicines Breakthrough Collaborative 1
 
5. testing differences
5. testing differences5. testing differences
5. testing differences
 
4 Inferential Statistics IV - April 7 2014.pdf
4 Inferential Statistics IV - April 7 2014.pdf4 Inferential Statistics IV - April 7 2014.pdf
4 Inferential Statistics IV - April 7 2014.pdf
 
What have we learnt from randomized control trials
What have we learnt from randomized control trialsWhat have we learnt from randomized control trials
What have we learnt from randomized control trials
 
Validity andreliability
Validity andreliabilityValidity andreliability
Validity andreliability
 
'A critique of testing' UK TMF forum January 2015
'A critique of testing' UK TMF forum January 2015 'A critique of testing' UK TMF forum January 2015
'A critique of testing' UK TMF forum January 2015
 

Más de CRRC-Armenia

CRRC Data Initiative 2009
CRRC Data Initiative 2009CRRC Data Initiative 2009
CRRC Data Initiative 2009CRRC-Armenia
 
Social Networking Sites
Social Networking SitesSocial Networking Sites
Social Networking SitesCRRC-Armenia
 
Presentation on Corruption Survey Results
Presentation on Corruption Survey ResultsPresentation on Corruption Survey Results
Presentation on Corruption Survey ResultsCRRC-Armenia
 
Towards The Result Based Utility Sector In Armenia
Towards The Result Based Utility Sector In ArmeniaTowards The Result Based Utility Sector In Armenia
Towards The Result Based Utility Sector In ArmeniaCRRC-Armenia
 
The Number and Reintegration of Armenian Migrants Returned to Homeland from t...
The Number and Reintegration of Armenian Migrants Returned to Homeland from t...The Number and Reintegration of Armenian Migrants Returned to Homeland from t...
The Number and Reintegration of Armenian Migrants Returned to Homeland from t...CRRC-Armenia
 
Domestically Issued Public Debt As A Sustainable Alternative
Domestically Issued Public Debt As A Sustainable AlternativeDomestically Issued Public Debt As A Sustainable Alternative
Domestically Issued Public Debt As A Sustainable AlternativeCRRC-Armenia
 
Corruption Survey of Enterprises 2009
Corruption Survey of Enterprises 2009Corruption Survey of Enterprises 2009
Corruption Survey of Enterprises 2009CRRC-Armenia
 
Western Writing And Publishing Workshop
Western Writing And Publishing WorkshopWestern Writing And Publishing Workshop
Western Writing And Publishing WorkshopCRRC-Armenia
 
eResources for Research
eResources for ResearcheResources for Research
eResources for ResearchCRRC-Armenia
 
Humanitarian Intervention
Humanitarian InterventionHumanitarian Intervention
Humanitarian InterventionCRRC-Armenia
 
Household Corruption Survey 2009
Household Corruption Survey 2009Household Corruption Survey 2009
Household Corruption Survey 2009CRRC-Armenia
 
State of Armenian Irregular Migrants in Turkey
State of Armenian Irregular Migrants in TurkeyState of Armenian Irregular Migrants in Turkey
State of Armenian Irregular Migrants in TurkeyCRRC-Armenia
 
IMF Regional Economic Outlook for the Caucasus and Central Asia
IMF Regional Economic Outlook for the Caucasus and Central AsiaIMF Regional Economic Outlook for the Caucasus and Central Asia
IMF Regional Economic Outlook for the Caucasus and Central AsiaCRRC-Armenia
 
The Sources and Uses of Survey Data on Armenia
The Sources and Uses of Survey Data on ArmeniaThe Sources and Uses of Survey Data on Armenia
The Sources and Uses of Survey Data on ArmeniaCRRC-Armenia
 
Institutional Sources of Corruption in the Case of Armenia
Institutional Sources of Corruption in the Case of ArmeniaInstitutional Sources of Corruption in the Case of Armenia
Institutional Sources of Corruption in the Case of ArmeniaCRRC-Armenia
 
Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...
Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...
Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...CRRC-Armenia
 
Civil Society and Corruption
Civil Society and CorruptionCivil Society and Corruption
Civil Society and CorruptionCRRC-Armenia
 
Freedom of Expression and Censorship in Armenia
Freedom of Expression and Censorship in ArmeniaFreedom of Expression and Censorship in Armenia
Freedom of Expression and Censorship in ArmeniaCRRC-Armenia
 

Más de CRRC-Armenia (20)

CRRC Data Initiative 2009
CRRC Data Initiative 2009CRRC Data Initiative 2009
CRRC Data Initiative 2009
 
Social Networking Sites
Social Networking SitesSocial Networking Sites
Social Networking Sites
 
Presentation on Corruption Survey Results
Presentation on Corruption Survey ResultsPresentation on Corruption Survey Results
Presentation on Corruption Survey Results
 
Towards The Result Based Utility Sector In Armenia
Towards The Result Based Utility Sector In ArmeniaTowards The Result Based Utility Sector In Armenia
Towards The Result Based Utility Sector In Armenia
 
The Number and Reintegration of Armenian Migrants Returned to Homeland from t...
The Number and Reintegration of Armenian Migrants Returned to Homeland from t...The Number and Reintegration of Armenian Migrants Returned to Homeland from t...
The Number and Reintegration of Armenian Migrants Returned to Homeland from t...
 
Domestically Issued Public Debt As A Sustainable Alternative
Domestically Issued Public Debt As A Sustainable AlternativeDomestically Issued Public Debt As A Sustainable Alternative
Domestically Issued Public Debt As A Sustainable Alternative
 
Corruption Survey of Enterprises 2009
Corruption Survey of Enterprises 2009Corruption Survey of Enterprises 2009
Corruption Survey of Enterprises 2009
 
CRRC Armenia
CRRC Armenia CRRC Armenia
CRRC Armenia
 
Western Writing And Publishing Workshop
Western Writing And Publishing WorkshopWestern Writing And Publishing Workshop
Western Writing And Publishing Workshop
 
eResources for Research
eResources for ResearcheResources for Research
eResources for Research
 
Humanitarian Intervention
Humanitarian InterventionHumanitarian Intervention
Humanitarian Intervention
 
Household Corruption Survey 2009
Household Corruption Survey 2009Household Corruption Survey 2009
Household Corruption Survey 2009
 
State of Armenian Irregular Migrants in Turkey
State of Armenian Irregular Migrants in TurkeyState of Armenian Irregular Migrants in Turkey
State of Armenian Irregular Migrants in Turkey
 
IMF Regional Economic Outlook for the Caucasus and Central Asia
IMF Regional Economic Outlook for the Caucasus and Central AsiaIMF Regional Economic Outlook for the Caucasus and Central Asia
IMF Regional Economic Outlook for the Caucasus and Central Asia
 
Rewire Your Brain
Rewire Your BrainRewire Your Brain
Rewire Your Brain
 
The Sources and Uses of Survey Data on Armenia
The Sources and Uses of Survey Data on ArmeniaThe Sources and Uses of Survey Data on Armenia
The Sources and Uses of Survey Data on Armenia
 
Institutional Sources of Corruption in the Case of Armenia
Institutional Sources of Corruption in the Case of ArmeniaInstitutional Sources of Corruption in the Case of Armenia
Institutional Sources of Corruption in the Case of Armenia
 
Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...
Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...
Chicken or the Hen Dilemma or Understanding of the Perception of Corruption i...
 
Civil Society and Corruption
Civil Society and CorruptionCivil Society and Corruption
Civil Society and Corruption
 
Freedom of Expression and Censorship in Armenia
Freedom of Expression and Censorship in ArmeniaFreedom of Expression and Censorship in Armenia
Freedom of Expression and Censorship in Armenia
 

ILCS Raking

  • 1. ILCS Raking Motivate Need and Illustrate Basic Approach
  • 2. What is Raking? • A way to Adjust Survey totals “t” to Independent Controls “T” • Takes existing Survey Weights, usually wij = 1/pij, where pij is probability of selection • Ratios them up to each total T in turn, until results are as close as wanted
  • 3. What is the Value? • Can increase stability of survey results Reduce Sample Variance • Get results that are close to desired outcomes Reduce bias arising from minor operational errors
  • 4. What Results to Expect? • If Controls are Reasonable, Raking Process will converge (“Hit” all controls) • And improve survey results related to Control Totals
  • 5. More Information Quality • Only Weights are Changed by Raking, not Survey Data • Data Quality is thus unchanged • But Information Quality is usually Improved
  • 6. What Does Raking Cost? • Usually Done quickly on a PC • Independent Controls Need to be consistent with each other • Sample must be reasonably large for Raking to be Safely Applied • Some Costs incurred to explain Method
  • 7. Raking Made Simple • “Fudge” Factor Intuition • Develop a ratio of target total divided by sample total • Repeat this process with each of the controls in turn
  • 8. NSS Example from ILCS While the NSS RA survey is raked across 4 dimensions (age, gender, marz and urban/rural), the example we’ll use here will just use two dimensions.
  • 9. Table 1. Raking Example – Source Survey Data
  • 10. Table 2: Desired Marginals
  • 14. ISLS Benefits Achieved • Reduction in Bias • Reduction (hopefully) in Variance • Survey Results are Consistent with Census Projections
  • 15. Again Many Thanks Data Quality and Record Linkage Techniques Springer 2007