SlideShare una empresa de Scribd logo
1 de 5
BioSense 2.0 Analytics

Change Point Analysis

June 22, 2012



By TahaKass-Hout and ZhihengXu



BioSense is a national public health surveillance system for early detection and rapid assessment of

potential bioterrorism-related illness. It integrates current health data shared by health departments from

a variety of sources to provide insight on the health of communities and the country. Using statistical

aberration detection methods, public health officials are able toidentify and investigate the

anomaliesboth temporal and spatial. In the first iteration of statistical tools for inclusion in BioSense 2.0

redesign, we introduced the Early Aberration Reporting System (EARS) which has been used

extensively in BioSense for disease anomaly detection. As a complimentary tool to EARS, Change Point

Analysis (CPA) has been implemented in BioSenseto address the limitation of EARS in detecting subtle

changes and characterizing disease trends. In this paper, we will describe how to implement Taylor’s

cumulative sum (CUSUM) CPA method.


CUSUM CPA

Taylor [1] developed a change point analysis method through the iterative application of cumulative sum

charts (CUSUM) and bootstrapping methods to detect changes in time-series and their inferences. This

approach is based on the mean-shift model and assumes that residuals are independent and identically

distributed (iid) with a mean of zero. For time-series data Yi with i=1, …, N, the mean-shift model is

written as             ,where µ is the sample average as                and    is the residual term defined

as              for the ithobservation. The cumulative sums of residuals are calculated as
for i=1, …, N where           The change point at location mis detected through searching for the

maximum absolute CUSUM of residuals where                              . The time-series data is split into

two segments on each side of the change point, and the analysis is repeated for each segment. 1000

Bootstrapping samples are generated to calculate the significance level and 95% confidence interval (CI)

of change points. The following steps summarize how to implement Taylor’s CUSUM CPA to detect

change points:


   1. Prepare the initial time series data.

   2. Calculate the cumulative sum of residuals           .

   3. Find the location with the maximum absolute CUSUM of residuals which is defined as the

       change point.

   4. Calculate the difference between maximum and minimum CUSUM of residuals as

                               where                  and

   5. Determine whether this change point is significant or not via bootstrapping:

           a. Generate a bootstrap sample of N, denoted as                        through reshuffling

                 the original N values.

           b. Calculate the CUSUM of residuals from the bootstrap sample, denoted as



           c. Calculate the maximum, minimum and difference of CUSUM of residuals, denoted as

                                     where

           d. Determine whether the difference of CUSUM from the bootstrap sample is less than

                 the original difference     .
e. Repeat step a-d 1000 times and record the number of the bootstrap samples which

                has                denoted as X.

           f. The significance level is defined as X/1000.

   6. If the significance level ≥95%, it indicates the detected change point is statistically

       significant and then we split the dataset into two subsets from this significant change point;

       if the significance level <95%, it indicates the detected change point is not statistically

       significant and then we stop the splitting.

   7. Repeat step 2-6 in each one of two subsets until no more significant change point is

       detected.


Data Example

The following data were created to illustrate the detection of change points using CUSUM CPA method.


MMWR
week (i)        Percent of visit (Yi) µ       εi       Si         |Si|
            1                 0.001     0.036 -0.03483 -0.03483 0.034827
            2                 0.002     0.036 -0.03383 -0.06865 0.068654
            3                 0.003     0.036 -0.03283 -0.10148 0.101481
            4                 0.002     0.036 -0.03383 -0.13531 0.135308
            5                 0.008     0.036 -0.02783 -0.16313 0.163135
            6                 0.009     0.036 -0.02683 -0.18996 0.189962
            7                 0.012     0.036 -0.02383 -0.21379 0.213788
            8                 0.011     0.036 -0.02483 -0.23862 0.238615
            9                 0.009     0.036 -0.02683 -0.26544 0.265442
           10                 0.011     0.036 -0.02483 -0.29027 0.290269
           11                 0.021     0.036 -0.01483    -0.3051 0.305096
           12                 0.012     0.036 -0.02383 -0.32892 0.328923
           13                  0.01     0.036 -0.02583 -0.35475 0.35475
           14                 0.008     0.036 -0.02783 -0.38258 0.382577
           15                  0.01     0.036 -0.02583    -0.4084 0.408404
           16                 0.028     0.036 -0.00783 -0.41623 0.416231
           17                 0.023     0.036 -0.01283 -0.42906 0.429058
           18                 0.015     0.036 -0.02083 -0.44988 0.449885
19   0.014   0.036   -0.02183   -0.47171    0.471712
20   0.052   0.036   0.016173   -0.45554    0.455538
21   0.079   0.036   0.043173   -0.41237    0.412365
22   0.064   0.036   0.028173   -0.38419    0.384192
23   0.079   0.036   0.043173   -0.34102    0.341019
24   0.085   0.036   0.049173   -0.29185    0.291846
25   0.072   0.036   0.036173   -0.25567    0.255673
26   0.099   0.036   0.063173     -0.1925     0.1925
27   0.036   0.036   0.000173   -0.19233    0.192327
28    0.07   0.036   0.034173   -0.15815    0.158154
29   0.077   0.036   0.041173   -0.11698    0.116981
30   0.092   0.036   0.056173   -0.06081    0.060808
31   0.111   0.036   0.075173   0.014365    0.014365
32   0.083   0.036   0.047173   0.061538    0.061538
33   0.095   0.036   0.059173   0.120712    0.120712
34   0.072   0.036   0.036173   0.156885    0.156885
35   0.092   0.036   0.056173   0.213058    0.213058
36   0.019   0.036   -0.01683   0.196231    0.196231
37   0.012   0.036   -0.02383   0.172404    0.172404
38   0.023   0.036   -0.01283   0.159577    0.159577
39   0.022   0.036   -0.01383    0.14575     0.14575
40   0.024   0.036   -0.01183   0.133923    0.133923
41   0.012   0.036   -0.02383   0.110096    0.110096
42    0.03   0.036   -0.00583   0.104269    0.104269
43   0.021   0.036   -0.01483   0.089442    0.089442
44   0.026   0.036   -0.00983   0.079615    0.079615
45   0.025   0.036   -0.01083   0.068788    0.068788
46    0.02   0.036   -0.01583   0.052962    0.052962
47   0.026   0.036   -0.00983   0.043135    0.043135
48    0.02   0.036   -0.01583   0.027308    0.027308
49   0.036   0.036   0.000173   0.027481    0.027481
50    0.03   0.036   -0.00583   0.021654    0.021654
51    0.03   0.036   -0.00583   0.015827    0.015827
52    0.02   0.036   -0.01583   6.94E-17    6.94E-17
Percent of visit (Yi)
  0.12

   0.1

  0.08

  0.06

  0.04

  0.02

     0
         1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61


The significance level and 95% CI of change points will be calculated from 1000 bootstrapping samples.

After detecting the first significant change point which is highlighted in yellow in the above table, the

time-series data for MMWR week 1-52 will be split into two segments: MMWR week 1-19 and week

20-52. The analysis will be repeated on each of two segments to determine their change points.


Reference
   1. Taylor, W. Change-Point Analysis: A Powerful New Tool For Detecting Changes. 2010;
       Available from: http://www.variation.com/anonftp/pub/changepoint.pdf.
   2. Barker, N. A Practical Introduction to the Bootstrap Using the SAS System. 2010; Available
       from: http://www.lexjansen.com/phuse/2005/pk/pk02.pdf.
   3. Efron, B.a.T., Robert, An introduction fo the Bootstrap1993, New York: Chapman & Hall.
   4. Kass-Hout TA, Xu Z, McMurray P, Park S, Buckeridge DL, Brownstein JS, Finelli L, Groseclose
       SL. Application of change point analysis to daily influenza-like-illness (ILI) emergency
       department visits. Journal of American Medical Informatics Association (2012), in press.

Más contenido relacionado

Destacado

Preparing Vietnam for 4G Revolution
Preparing Vietnam for 4G RevolutionPreparing Vietnam for 4G Revolution
Preparing Vietnam for 4G RevolutionKurian Manjakkal
 
Preentrega freezenon
Preentrega freezenonPreentrega freezenon
Preentrega freezenonPaula Bedoya
 
RMSMT 2015_Be Prepared
RMSMT 2015_Be PreparedRMSMT 2015_Be Prepared
RMSMT 2015_Be PreparedGlenn Giles
 
Unidad 11
Unidad 11Unidad 11
Unidad 11TomasCR
 
New Concept For Business.
New Concept For Business.New Concept For Business.
New Concept For Business.Mihiri Adikari
 
Cpgp day01-session 4 - getting started cp
Cpgp day01-session 4 - getting started cpCpgp day01-session 4 - getting started cp
Cpgp day01-session 4 - getting started cpzubeditufail
 
Myth Or Fact Productivty Challenges In R & D2
Myth Or Fact Productivty Challenges In R & D2Myth Or Fact Productivty Challenges In R & D2
Myth Or Fact Productivty Challenges In R & D2harsukh
 
Tema 3 ccss
Tema 3 ccssTema 3 ccss
Tema 3 ccssTomasCR
 
Aastha gupta automation_manual_testing_istq_bcertified_5yrs exp
Aastha gupta automation_manual_testing_istq_bcertified_5yrs expAastha gupta automation_manual_testing_istq_bcertified_5yrs exp
Aastha gupta automation_manual_testing_istq_bcertified_5yrs expAastha Gupta
 
An introduction to CP Optimizer
An introduction to CP OptimizerAn introduction to CP Optimizer
An introduction to CP OptimizerPhilippe Laborie
 
Management Information System
Management Information SystemManagement Information System
Management Information Systemamana fathima
 

Destacado (19)

Preparing Vietnam for 4G Revolution
Preparing Vietnam for 4G RevolutionPreparing Vietnam for 4G Revolution
Preparing Vietnam for 4G Revolution
 
Preentrega freezenon
Preentrega freezenonPreentrega freezenon
Preentrega freezenon
 
RMSMT 2015_Be Prepared
RMSMT 2015_Be PreparedRMSMT 2015_Be Prepared
RMSMT 2015_Be Prepared
 
Unidad 11
Unidad 11Unidad 11
Unidad 11
 
Design Session
Design Session Design Session
Design Session
 
GRC Screen 1
GRC Screen 1GRC Screen 1
GRC Screen 1
 
New Concept For Business.
New Concept For Business.New Concept For Business.
New Concept For Business.
 
Cpgp day01-session 4 - getting started cp
Cpgp day01-session 4 - getting started cpCpgp day01-session 4 - getting started cp
Cpgp day01-session 4 - getting started cp
 
GRP DOME
GRP DOMEGRP DOME
GRP DOME
 
Bluemercury
BluemercuryBluemercury
Bluemercury
 
GRC DOME Thual
GRC DOME ThualGRC DOME Thual
GRC DOME Thual
 
Dawn reference
Dawn referenceDawn reference
Dawn reference
 
Informe de Rendimiento de Computadoras
Informe  de Rendimiento  de Computadoras Informe  de Rendimiento  de Computadoras
Informe de Rendimiento de Computadoras
 
Myth Or Fact Productivty Challenges In R & D2
Myth Or Fact Productivty Challenges In R & D2Myth Or Fact Productivty Challenges In R & D2
Myth Or Fact Productivty Challenges In R & D2
 
Tema 3 ccss
Tema 3 ccssTema 3 ccss
Tema 3 ccss
 
Ahmed cv
Ahmed cvAhmed cv
Ahmed cv
 
Aastha gupta automation_manual_testing_istq_bcertified_5yrs exp
Aastha gupta automation_manual_testing_istq_bcertified_5yrs expAastha gupta automation_manual_testing_istq_bcertified_5yrs exp
Aastha gupta automation_manual_testing_istq_bcertified_5yrs exp
 
An introduction to CP Optimizer
An introduction to CP OptimizerAn introduction to CP Optimizer
An introduction to CP Optimizer
 
Management Information System
Management Information SystemManagement Information System
Management Information System
 

Similar a Change Point Analysis (CPA)

Multi Objective Optimization of PMEDM Process Parameter by Topsis Method
Multi Objective Optimization of PMEDM Process Parameter by Topsis MethodMulti Objective Optimization of PMEDM Process Parameter by Topsis Method
Multi Objective Optimization of PMEDM Process Parameter by Topsis Methodijtsrd
 
Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...
Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...
Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...Muhamad Rizky
 
Tarea 2 hidraulica iii-cabrera arias roberto alejandro
Tarea 2 hidraulica iii-cabrera arias roberto alejandroTarea 2 hidraulica iii-cabrera arias roberto alejandro
Tarea 2 hidraulica iii-cabrera arias roberto alejandroAlejandro Cabrera
 
Fault Diagnosis of Ball Bearing using AI kurthosis and Signal Processing
Fault Diagnosis of Ball Bearing using AI kurthosis and Signal ProcessingFault Diagnosis of Ball Bearing using AI kurthosis and Signal Processing
Fault Diagnosis of Ball Bearing using AI kurthosis and Signal ProcessingSridhara R
 
DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...
DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...
DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...Deltares
 
Continuous assessing of the Reviewed Event Bulletin with waveform cross corr...
Continuous assessing of the Reviewed Event Bulletin  with waveform cross corr...Continuous assessing of the Reviewed Event Bulletin  with waveform cross corr...
Continuous assessing of the Reviewed Event Bulletin with waveform cross corr...ivanokitov
 
Rigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería Estructural
Rigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería EstructuralRigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería Estructural
Rigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería EstructuralIRMA Trejo Amado
 
Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...
Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...
Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...Luis Beltran
 
Application of ibearugbulem’s model for optimizing granite concrete mix
Application of ibearugbulem’s model for optimizing granite concrete mixApplication of ibearugbulem’s model for optimizing granite concrete mix
Application of ibearugbulem’s model for optimizing granite concrete mixeSAT Publishing House
 
A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...
A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...
A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...aurkoiitk
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdff8usejdkddmmd
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdffjksekmmdm
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdff8usjekdkdmmd
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdff8suejjdkddmmd
 

Similar a Change Point Analysis (CPA) (20)

Z distribution
Z distribution Z distribution
Z distribution
 
Naca 4 digit-delta
Naca 4 digit-deltaNaca 4 digit-delta
Naca 4 digit-delta
 
Multi Objective Optimization of PMEDM Process Parameter by Topsis Method
Multi Objective Optimization of PMEDM Process Parameter by Topsis MethodMulti Objective Optimization of PMEDM Process Parameter by Topsis Method
Multi Objective Optimization of PMEDM Process Parameter by Topsis Method
 
Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...
Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...
Ground Vibration Control Using Signature Hole Method - Thesis BE Mining, Univ...
 
Tarea 2 hidraulica iii-cabrera arias roberto alejandro
Tarea 2 hidraulica iii-cabrera arias roberto alejandroTarea 2 hidraulica iii-cabrera arias roberto alejandro
Tarea 2 hidraulica iii-cabrera arias roberto alejandro
 
Fault Diagnosis of Ball Bearing using AI kurthosis and Signal Processing
Fault Diagnosis of Ball Bearing using AI kurthosis and Signal ProcessingFault Diagnosis of Ball Bearing using AI kurthosis and Signal Processing
Fault Diagnosis of Ball Bearing using AI kurthosis and Signal Processing
 
DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...
DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...
DSD-NL 2014 - iMOD Symposium - 9. iPEST - iMOD parameter estimation, Peter Ve...
 
Continuous assessing of the Reviewed Event Bulletin with waveform cross corr...
Continuous assessing of the Reviewed Event Bulletin  with waveform cross corr...Continuous assessing of the Reviewed Event Bulletin  with waveform cross corr...
Continuous assessing of the Reviewed Event Bulletin with waveform cross corr...
 
Rigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería Estructural
Rigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería EstructuralRigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería Estructural
Rigidez de Dos Pórticos para Dos Niveles de Piso - Albañilería Estructural
 
Mutt_Wind_Tunnel_Results_v2
Mutt_Wind_Tunnel_Results_v2Mutt_Wind_Tunnel_Results_v2
Mutt_Wind_Tunnel_Results_v2
 
El centro
El centroEl centro
El centro
 
Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...
Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...
Cloud Lunch and Learn ML.NET MACHINE LEARNING (AND DEEP LEARNING) FOR THE CSh...
 
Application of ibearugbulem’s model for optimizing granite concrete mix
Application of ibearugbulem’s model for optimizing granite concrete mixApplication of ibearugbulem’s model for optimizing granite concrete mix
Application of ibearugbulem’s model for optimizing granite concrete mix
 
ANALYTICAL STUDY OF TOOL WEAR IN TURNING OPERATION THROUGH S/N RATIO AND ANOVA
ANALYTICAL STUDY OF TOOL WEAR IN TURNING OPERATION THROUGH S/N RATIO AND ANOVA ANALYTICAL STUDY OF TOOL WEAR IN TURNING OPERATION THROUGH S/N RATIO AND ANOVA
ANALYTICAL STUDY OF TOOL WEAR IN TURNING OPERATION THROUGH S/N RATIO AND ANOVA
 
A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...
A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...
A Study on the Short Run Relationship b/w Major Economic Indicators of US Eco...
 
task3
task3task3
task3
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf
 
2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf2001 Infiniti I30 Service Repair Manual.pdf
2001 Infiniti I30 Service Repair Manual.pdf
 

Más de Taha Kass-Hout, MD, MS

A Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile MethodologyA Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile MethodologyTaha Kass-Hout, MD, MS
 
A Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile MethodologyA Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile MethodologyTaha Kass-Hout, MD, MS
 
e-Democracy: Egypt’s 18 Day Revolution
e-Democracy: Egypt’s 18 Day Revolutione-Democracy: Egypt’s 18 Day Revolution
e-Democracy: Egypt’s 18 Day RevolutionTaha Kass-Hout, MD, MS
 
Public Health Surveillance Through Collaboration
Public Health Surveillance Through CollaborationPublic Health Surveillance Through Collaboration
Public Health Surveillance Through CollaborationTaha Kass-Hout, MD, MS
 
Updates on the BioSense Program Redesign: 2011 Public Health Preparedness Summit
Updates on the BioSense Program Redesign: 2011 Public Health Preparedness SummitUpdates on the BioSense Program Redesign: 2011 Public Health Preparedness Summit
Updates on the BioSense Program Redesign: 2011 Public Health Preparedness SummitTaha Kass-Hout, MD, MS
 
Novel Approaches in Public Health Surveillance
Novel Approaches in Public Health SurveillanceNovel Approaches in Public Health Surveillance
Novel Approaches in Public Health SurveillanceTaha Kass-Hout, MD, MS
 
Internet2 and Public Health Surveillance
Internet2 and Public Health SurveillanceInternet2 and Public Health Surveillance
Internet2 and Public Health SurveillanceTaha Kass-Hout, MD, MS
 
BioSense Program: Scientific Collaboration
BioSense Program: Scientific CollaborationBioSense Program: Scientific Collaboration
BioSense Program: Scientific CollaborationTaha Kass-Hout, MD, MS
 
Riff: A Social Network and Collaborative Platform for Public Health Disease S...
Riff: A Social Network and Collaborative Platform for Public Health Disease S...Riff: A Social Network and Collaborative Platform for Public Health Disease S...
Riff: A Social Network and Collaborative Platform for Public Health Disease S...Taha Kass-Hout, MD, MS
 
BioSense Program Going Forward: HIMSS10 Conference
BioSense Program Going Forward: HIMSS10 ConferenceBioSense Program Going Forward: HIMSS10 Conference
BioSense Program Going Forward: HIMSS10 ConferenceTaha Kass-Hout, MD, MS
 

Más de Taha Kass-Hout, MD, MS (20)

precisionFDA
precisionFDAprecisionFDA
precisionFDA
 
A Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile MethodologyA Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile Methodology
 
A Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile MethodologyA Brief Introduction to the SCRUM Agile Methodology
A Brief Introduction to the SCRUM Agile Methodology
 
e-Democracy: Egypt’s 18 Day Revolution
e-Democracy: Egypt’s 18 Day Revolutione-Democracy: Egypt’s 18 Day Revolution
e-Democracy: Egypt’s 18 Day Revolution
 
Big Data in Public Health
Big Data in Public HealthBig Data in Public Health
Big Data in Public Health
 
Public Health Surveillance Through Collaboration
Public Health Surveillance Through CollaborationPublic Health Surveillance Through Collaboration
Public Health Surveillance Through Collaboration
 
BioSense 2.0
BioSense 2.0BioSense 2.0
BioSense 2.0
 
Social Media for the Meta-Leader
Social Media for the Meta-LeaderSocial Media for the Meta-Leader
Social Media for the Meta-Leader
 
Updates on the BioSense Program Redesign: 2011 Public Health Preparedness Summit
Updates on the BioSense Program Redesign: 2011 Public Health Preparedness SummitUpdates on the BioSense Program Redesign: 2011 Public Health Preparedness Summit
Updates on the BioSense Program Redesign: 2011 Public Health Preparedness Summit
 
Novel Approaches in Public Health Surveillance
Novel Approaches in Public Health SurveillanceNovel Approaches in Public Health Surveillance
Novel Approaches in Public Health Surveillance
 
Introducing BioSense Program Redesign
Introducing BioSense Program RedesignIntroducing BioSense Program Redesign
Introducing BioSense Program Redesign
 
Internet2 and Public Health Surveillance
Internet2 and Public Health SurveillanceInternet2 and Public Health Surveillance
Internet2 and Public Health Surveillance
 
Change Point Analysis
Change Point AnalysisChange Point Analysis
Change Point Analysis
 
BioSense Program: Scientific Collaboration
BioSense Program: Scientific CollaborationBioSense Program: Scientific Collaboration
BioSense Program: Scientific Collaboration
 
Riff: A Social Network and Collaborative Platform for Public Health Disease S...
Riff: A Social Network and Collaborative Platform for Public Health Disease S...Riff: A Social Network and Collaborative Platform for Public Health Disease S...
Riff: A Social Network and Collaborative Platform for Public Health Disease S...
 
Distribute
DistributeDistribute
Distribute
 
BioSense Program Going Forward: HIMSS10 Conference
BioSense Program Going Forward: HIMSS10 ConferenceBioSense Program Going Forward: HIMSS10 Conference
BioSense Program Going Forward: HIMSS10 Conference
 
Epi Info™ Mesh4x
Epi Info™ Mesh4xEpi Info™ Mesh4x
Epi Info™ Mesh4x
 
InSTEDD Mesh4x Platform
InSTEDD Mesh4x PlatformInSTEDD Mesh4x Platform
InSTEDD Mesh4x Platform
 
Oswego in the Cloud: Scenario Script
Oswego in the Cloud: Scenario ScriptOswego in the Cloud: Scenario Script
Oswego in the Cloud: Scenario Script
 

Último

Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...narwatsonia7
 
97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAA97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAAjennyeacort
 
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...narwatsonia7
 
Call Girls In Andheri East Call 9920874524 Book Hot And Sexy Girls
Call Girls In Andheri East Call 9920874524 Book Hot And Sexy GirlsCall Girls In Andheri East Call 9920874524 Book Hot And Sexy Girls
Call Girls In Andheri East Call 9920874524 Book Hot And Sexy Girlsnehamumbai
 
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...rajnisinghkjn
 
Call Girls Hebbal Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hebbal Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Hebbal Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hebbal Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
 
See the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy PlatformSee the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy PlatformKweku Zurek
 
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking ModelsMumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Modelssonalikaur4
 
Hematology and Immunology - Leukocytes Functions
Hematology and Immunology - Leukocytes FunctionsHematology and Immunology - Leukocytes Functions
Hematology and Immunology - Leukocytes FunctionsMedicoseAcademics
 
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort ServiceCollege Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort ServiceNehru place Escorts
 
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
 
Hemostasis Physiology and Clinical correlations by Dr Faiza.pdf
Hemostasis Physiology and Clinical correlations by Dr Faiza.pdfHemostasis Physiology and Clinical correlations by Dr Faiza.pdf
Hemostasis Physiology and Clinical correlations by Dr Faiza.pdfMedicoseAcademics
 
Call Girl Lucknow Mallika 7001305949 Independent Escort Service Lucknow
Call Girl Lucknow Mallika 7001305949 Independent Escort Service LucknowCall Girl Lucknow Mallika 7001305949 Independent Escort Service Lucknow
Call Girl Lucknow Mallika 7001305949 Independent Escort Service Lucknownarwatsonia7
 
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
 
Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...narwatsonia7
 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...narwatsonia7
 
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original PhotosCall Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photosnarwatsonia7
 
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original PhotosBook Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photosnarwatsonia7
 
VIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service Lucknow
VIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service LucknowVIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service Lucknow
VIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service Lucknownarwatsonia7
 
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Availablenarwatsonia7
 

Último (20)

Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
Call Girls Frazer Town Just Call 7001305949 Top Class Call Girl Service Avail...
 
97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAA97111 47426 Call Girls In Delhi MUNIRKAA
97111 47426 Call Girls In Delhi MUNIRKAA
 
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Electronic City Just Call 7001305949 Top Class Call Girl Service A...
 
Call Girls In Andheri East Call 9920874524 Book Hot And Sexy Girls
Call Girls In Andheri East Call 9920874524 Book Hot And Sexy GirlsCall Girls In Andheri East Call 9920874524 Book Hot And Sexy Girls
Call Girls In Andheri East Call 9920874524 Book Hot And Sexy Girls
 
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
Dwarka Sector 6 Call Girls ( 9873940964 ) Book Hot And Sexy Girls In A Few Cl...
 
Call Girls Hebbal Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hebbal Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Hebbal Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hebbal Just Call 7001305949 Top Class Call Girl Service Available
 
See the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy PlatformSee the 2,456 pharmacies on the National E-Pharmacy Platform
See the 2,456 pharmacies on the National E-Pharmacy Platform
 
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking ModelsMumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
Mumbai Call Girls Service 9910780858 Real Russian Girls Looking Models
 
Hematology and Immunology - Leukocytes Functions
Hematology and Immunology - Leukocytes FunctionsHematology and Immunology - Leukocytes Functions
Hematology and Immunology - Leukocytes Functions
 
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort ServiceCollege Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
College Call Girls Vyasarpadi Whatsapp 7001305949 Independent Escort Service
 
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Jp Nagar Just Call 7001305949 Top Class Call Girl Service Available
 
Hemostasis Physiology and Clinical correlations by Dr Faiza.pdf
Hemostasis Physiology and Clinical correlations by Dr Faiza.pdfHemostasis Physiology and Clinical correlations by Dr Faiza.pdf
Hemostasis Physiology and Clinical correlations by Dr Faiza.pdf
 
Call Girl Lucknow Mallika 7001305949 Independent Escort Service Lucknow
Call Girl Lucknow Mallika 7001305949 Independent Escort Service LucknowCall Girl Lucknow Mallika 7001305949 Independent Escort Service Lucknow
Call Girl Lucknow Mallika 7001305949 Independent Escort Service Lucknow
 
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Whitefield Just Call 7001305949 Top Class Call Girl Service Available
 
Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...
Call Girls Kanakapura Road Just Call 7001305949 Top Class Call Girl Service A...
 
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
Russian Call Girls Chickpet - 7001305949 Booking and charges genuine rate for...
 
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original PhotosCall Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
Call Girl Service Bidadi - For 7001305949 Cheap & Best with original Photos
 
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original PhotosBook Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
Book Call Girls in Yelahanka - For 7001305949 Cheap & Best with original Photos
 
VIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service Lucknow
VIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service LucknowVIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service Lucknow
VIP Call Girls Lucknow Nandini 7001305949 Independent Escort Service Lucknow
 
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service AvailableCall Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
Call Girls Hsr Layout Just Call 7001305949 Top Class Call Girl Service Available
 

Change Point Analysis (CPA)

  • 1. BioSense 2.0 Analytics Change Point Analysis June 22, 2012 By TahaKass-Hout and ZhihengXu BioSense is a national public health surveillance system for early detection and rapid assessment of potential bioterrorism-related illness. It integrates current health data shared by health departments from a variety of sources to provide insight on the health of communities and the country. Using statistical aberration detection methods, public health officials are able toidentify and investigate the anomaliesboth temporal and spatial. In the first iteration of statistical tools for inclusion in BioSense 2.0 redesign, we introduced the Early Aberration Reporting System (EARS) which has been used extensively in BioSense for disease anomaly detection. As a complimentary tool to EARS, Change Point Analysis (CPA) has been implemented in BioSenseto address the limitation of EARS in detecting subtle changes and characterizing disease trends. In this paper, we will describe how to implement Taylor’s cumulative sum (CUSUM) CPA method. CUSUM CPA Taylor [1] developed a change point analysis method through the iterative application of cumulative sum charts (CUSUM) and bootstrapping methods to detect changes in time-series and their inferences. This approach is based on the mean-shift model and assumes that residuals are independent and identically distributed (iid) with a mean of zero. For time-series data Yi with i=1, …, N, the mean-shift model is written as ,where µ is the sample average as and is the residual term defined as for the ithobservation. The cumulative sums of residuals are calculated as
  • 2. for i=1, …, N where The change point at location mis detected through searching for the maximum absolute CUSUM of residuals where . The time-series data is split into two segments on each side of the change point, and the analysis is repeated for each segment. 1000 Bootstrapping samples are generated to calculate the significance level and 95% confidence interval (CI) of change points. The following steps summarize how to implement Taylor’s CUSUM CPA to detect change points: 1. Prepare the initial time series data. 2. Calculate the cumulative sum of residuals . 3. Find the location with the maximum absolute CUSUM of residuals which is defined as the change point. 4. Calculate the difference between maximum and minimum CUSUM of residuals as where and 5. Determine whether this change point is significant or not via bootstrapping: a. Generate a bootstrap sample of N, denoted as through reshuffling the original N values. b. Calculate the CUSUM of residuals from the bootstrap sample, denoted as c. Calculate the maximum, minimum and difference of CUSUM of residuals, denoted as where d. Determine whether the difference of CUSUM from the bootstrap sample is less than the original difference .
  • 3. e. Repeat step a-d 1000 times and record the number of the bootstrap samples which has denoted as X. f. The significance level is defined as X/1000. 6. If the significance level ≥95%, it indicates the detected change point is statistically significant and then we split the dataset into two subsets from this significant change point; if the significance level <95%, it indicates the detected change point is not statistically significant and then we stop the splitting. 7. Repeat step 2-6 in each one of two subsets until no more significant change point is detected. Data Example The following data were created to illustrate the detection of change points using CUSUM CPA method. MMWR week (i) Percent of visit (Yi) µ εi Si |Si| 1 0.001 0.036 -0.03483 -0.03483 0.034827 2 0.002 0.036 -0.03383 -0.06865 0.068654 3 0.003 0.036 -0.03283 -0.10148 0.101481 4 0.002 0.036 -0.03383 -0.13531 0.135308 5 0.008 0.036 -0.02783 -0.16313 0.163135 6 0.009 0.036 -0.02683 -0.18996 0.189962 7 0.012 0.036 -0.02383 -0.21379 0.213788 8 0.011 0.036 -0.02483 -0.23862 0.238615 9 0.009 0.036 -0.02683 -0.26544 0.265442 10 0.011 0.036 -0.02483 -0.29027 0.290269 11 0.021 0.036 -0.01483 -0.3051 0.305096 12 0.012 0.036 -0.02383 -0.32892 0.328923 13 0.01 0.036 -0.02583 -0.35475 0.35475 14 0.008 0.036 -0.02783 -0.38258 0.382577 15 0.01 0.036 -0.02583 -0.4084 0.408404 16 0.028 0.036 -0.00783 -0.41623 0.416231 17 0.023 0.036 -0.01283 -0.42906 0.429058 18 0.015 0.036 -0.02083 -0.44988 0.449885
  • 4. 19 0.014 0.036 -0.02183 -0.47171 0.471712 20 0.052 0.036 0.016173 -0.45554 0.455538 21 0.079 0.036 0.043173 -0.41237 0.412365 22 0.064 0.036 0.028173 -0.38419 0.384192 23 0.079 0.036 0.043173 -0.34102 0.341019 24 0.085 0.036 0.049173 -0.29185 0.291846 25 0.072 0.036 0.036173 -0.25567 0.255673 26 0.099 0.036 0.063173 -0.1925 0.1925 27 0.036 0.036 0.000173 -0.19233 0.192327 28 0.07 0.036 0.034173 -0.15815 0.158154 29 0.077 0.036 0.041173 -0.11698 0.116981 30 0.092 0.036 0.056173 -0.06081 0.060808 31 0.111 0.036 0.075173 0.014365 0.014365 32 0.083 0.036 0.047173 0.061538 0.061538 33 0.095 0.036 0.059173 0.120712 0.120712 34 0.072 0.036 0.036173 0.156885 0.156885 35 0.092 0.036 0.056173 0.213058 0.213058 36 0.019 0.036 -0.01683 0.196231 0.196231 37 0.012 0.036 -0.02383 0.172404 0.172404 38 0.023 0.036 -0.01283 0.159577 0.159577 39 0.022 0.036 -0.01383 0.14575 0.14575 40 0.024 0.036 -0.01183 0.133923 0.133923 41 0.012 0.036 -0.02383 0.110096 0.110096 42 0.03 0.036 -0.00583 0.104269 0.104269 43 0.021 0.036 -0.01483 0.089442 0.089442 44 0.026 0.036 -0.00983 0.079615 0.079615 45 0.025 0.036 -0.01083 0.068788 0.068788 46 0.02 0.036 -0.01583 0.052962 0.052962 47 0.026 0.036 -0.00983 0.043135 0.043135 48 0.02 0.036 -0.01583 0.027308 0.027308 49 0.036 0.036 0.000173 0.027481 0.027481 50 0.03 0.036 -0.00583 0.021654 0.021654 51 0.03 0.036 -0.00583 0.015827 0.015827 52 0.02 0.036 -0.01583 6.94E-17 6.94E-17
  • 5. Percent of visit (Yi) 0.12 0.1 0.08 0.06 0.04 0.02 0 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 The significance level and 95% CI of change points will be calculated from 1000 bootstrapping samples. After detecting the first significant change point which is highlighted in yellow in the above table, the time-series data for MMWR week 1-52 will be split into two segments: MMWR week 1-19 and week 20-52. The analysis will be repeated on each of two segments to determine their change points. Reference 1. Taylor, W. Change-Point Analysis: A Powerful New Tool For Detecting Changes. 2010; Available from: http://www.variation.com/anonftp/pub/changepoint.pdf. 2. Barker, N. A Practical Introduction to the Bootstrap Using the SAS System. 2010; Available from: http://www.lexjansen.com/phuse/2005/pk/pk02.pdf. 3. Efron, B.a.T., Robert, An introduction fo the Bootstrap1993, New York: Chapman & Hall. 4. Kass-Hout TA, Xu Z, McMurray P, Park S, Buckeridge DL, Brownstein JS, Finelli L, Groseclose SL. Application of change point analysis to daily influenza-like-illness (ILI) emergency department visits. Journal of American Medical Informatics Association (2012), in press.