Webinar 5: Identifying barriers and enablers, and determinants, in practice
Research alternatives oct 22 final
1. Research Alternatives for Clinical
Practice
Mary P. Watkins, DPT, MS
Faculty Emerita
MGH Institute of Health Professions
Boston, Massachusetts
1 MP Watkins, 2008
2. Course Objective And Goals
To define and explore methods for integrating
research activities and clinical practice for the purpose
of achieving effective, timely patient or client care.
To assure that our clinical intervention strategies
– Are based on the best available research- based
evidence
0R
– Are lacking in that evidence therefore requiring
studies to determine effectiveness – the beginnings
of establishing sound evidence
2 MP Watkins, 2008
3. Identify The Question
Define the problem
Identify the variables ?
Characteristics that can be
manipulated (intervention)or
observed (measurement of outcome)
MP Watkins,2008
4. What about all that information
that already exists?
How can we access it?
What can we learn from it?
4 MP Watkins, 2008
6. Introduction :
Definition of the PICO Model
A case example
Asking the question
Planning the Search
6 MP Watkins, 2008
7. What does PICO represent:
P – The patient or the disease process
I – The intervention
– Diagnostic test
– Intervention
C – A comparison of interventions
O – The outcome
7 MP Watkins, 2008
8. An example: Read this carefully:
Mrs. C.T. aged 45 years old administrative
assistant who complains of pain and tingling in her
right hand, often waking her up during the night.
The pain bothers her if she works at the computer
for more than 20 minutes without a break. Her
husband is unemployed at this time. She has
accumulated two weeks of sick time. She has had
the appropriate diagnostic tests revealing that she
has carpal tunnel syndrome. Given her present
symptoms, her need to work and the sick time
limit that she has, we need to consider the
treatment approach.
8 MP Watkins, 2008
9. The Patient
45 years old
Employed and needs to be
Symptoms bother her at night and on the job
She has 2 weeks of sick time
On questioning, her goal is to be able to work
without pain and tingling
9 MP Watkins, 2008
10. Intervention
Work station evaluation and adaptation
Splinting
Work rest periods with exercise
Surgery
10 MP Watkins, 2008
11. Comparison
Conservative program: splinting, rest periods,
work station adaptation, exercise (alone or in
combination)
OR
Surgical intervention: arthroscopy or open
approach
11 MP Watkins, 2008
12. Outcome: ????
Conservative intervention
– Effective to achieve the goal
– Risk: eventual surgery
Surgical intervention
– Effective to achieve the goal
– Risk: Surgical failure; time lost from work
12 MP Watkins, 2008
13. What is our specific question?
For patients who have a confirmed diagnosis of Carpal Tunnel
Syndrome and whose symptoms at this time limited to pain and
tingling, is conservative management effective in reducing pain
and increasing function?
Is it complete?
•The patient and the condition
•The intervention
•The comparison (may or may not include in our search)
•The outcome
13 MP Watkins, 2008
14. Identify The Question
Define the problem
Identify the variables ?
Characteristics that can be
manipulated (intervention)or
observed (measurement of outcome)
MP Watkins,2008
15. How will you pursue the answer to
your clinical question? Is your
question complete enough to pursue?
YES? Let’s see what our choices are:
15 MP Watkins, 2008
16. Existing Information
http://servers.medlib.hscbklyn.edu/ebm/2100.htm
16 MP Watkins, 2008
17. Systematic Review
Definition: a process of summarizing research
evidence in an organized, rigorous way to
answer a clinical question.
17 MP Watkins, 2008
18. The process of Systematic Review
1. Refine a specific clinical question
2. Identify and obtain all relevant studies
3. Establish inclusion criteria
4. Systematically select studies that meet the criteria
5. Appraise the methodological quality of selected studies
6. Synthesize the data to answer the question
18 MP Watkins, 2008
19. The Systematic Review Process
Develop the Conduct a database Retrieve relevant
Clarify the need: Write protocol: identify search and review papers (4.0)
out a question that variables, other relevant
defines the information inclusion/exclusion sources (3.0)
needed to arrive at an criteria and
answer (1.0) evaluation method
(2.0) Develop a search
strategy (3.4)
Identify the first
Identify
choice site Select and
resources that
(Repeat until all organize key
include relevant
resources have words
information (3.1)
been (3.3)
included)(3.2)
Sort and select
Incorporate Information into a Evaluate the quality papers that meet
synthesis of the systematic of the studies (6.0) established criteria.
review (7.0) (5.0)
19 MP Watkins, 2008
21. Meta-analysis
Definition: statistical analysis of
information from a series of
similar studies
Purpose: to synthesize and integrate
findings into an overall
interpretation of results
Benefit: effectively increases sample
size = increases power and
generalizability
21 MP Watkins, 2008
22. 1. What if the supporting evidence is not
sufficient or does not exist at all??
2. What if in our clinic there are several patients
with a similar condition?
3. Time to consider conducting clinically-based
studies…What are our reasonable choices??
22 MP Watkins, 2008
23. What about
one of these
categories?
http://servers.medlib.hscbklyn.edu/ebm/2100.htm
23 MP Watkins, 2008
24. Case Report
Purpose:
• to describe something new or unique
• to present usually ONE instance (one
patient)
• to perform an intense analysis of one case
24 MP Watkins, 2008
25. Case Report
Introduction including background literature to support
elements of the case and what’s unique about the case
Patient description: problem, symptoms, prior
treatment,….
Methods
– Treatment plan and procedures (Intervention)
– Documentation methods (Measurement)
Discussion with compare/contrast to prior background,
conclusion including future directions
25 MP Watkins, 2008
27. Sequential Clinical Trials
Advantages:
1. continuous analysis as data are
collected
2. the method is a statistical
technique
27 MP Watkins, 2008
28. Sequential Clinical Trials: Concept
and Technique
Alternative treatments administered randomly
to pairs of subjects - a series of “little
experiments”
Success criterion (“preference”) - determined
apriori
28 MP Watkins, 2008
29. Possible Outcomes
Outcome Treatment A Treatment B Preference
1 Improvement Improvement None
2 No improvement No improvement None
3 Improvement No improvement A
4 No improvement Improvement B
29 MP Watkins, 2008
31. Sequential Clinical Trials: the “numbers
problem”
Minimum # in the example: 8 pairs
– What about the pairs with no preference?
Maximum # : 58 pairs to reach either favorable choice
WHAT TO DO?
– Record and account for tied pairs
– Early termination: a clinical decision and a decision
based on the Research Question!!
31 MP Watkins, 2008
33. Sequential Clinical Trials:
Advantages
Data analysis is simple
The study is terminated as soon as a
preference is determined
the impact on clinical decision-making can be
immediate
33 MP Watkins, 2008
34. Single case experimental designs
Purpose: to compare
2 or more treatments
(or treatment-no
treatment)
34 MP Watkins, 2008
35. Single case designs
Advantage - study of individuals
(where individual characteristics may get lost in
group studies)
Disadvantage - generalizability, but
fosters replication
35 MP Watkins, 2008
36. Single case experimental designs
Unique elements:
Repeated measures of a “target”behavior
Design phases over time - beginning with
“baseline”- usually designated by letters, e.g.
A,B,C…..
36 MP Watkins, 2008
39. Single case designs: A - B - A
A B . . A
. .
. .
. .
. .
.
.
. . . .
39 MP Watkins, 2008
40. Multiple single case designs
alternate treatment: A - B - A - C
interactive treatment: A - B - BC - A
multiple baseline across subjects
staggered baseline
multiple dependent measures
40 MP Watkins, 2008
41. Data Analysis
Visual analysis: stability and trend
Split middle technique - celeration lines
Two standard deviation band method.
41 MP Watkins, 2008
44. Example
To compare the effectiveness of two
taping methods for treatment of
plantar fasciitis for pain, disability and
activities of daily life.
44 MP Watkins, 2008
45. 2 standard deviation band analysis
Mean & standard deviations were calculated for
each phase
Lines were drawn 2SD above & below the mean &
extended into the successive intervention phase
Where at least two successive data points fell
outside the 2SD band, changes were considered
significant
45 MP Watkins, 2008
47. Summary
To define and explore methods for integrating
research activities and clinical practice.
– We reviewed the principles of evidence based
practice to use the best available research- based
data and the approach of systematic review
– We considered kinds of studies that are suited to
clinical practice and that contribute to the process of
establishing sound evidence of effective, timely
patient care.
47 MP Watkins, 2008
48. Web- based References
Atkins C, Sampson J. Critical Appraisal Guidelines for Single Case
Study Research. Available at: <
http://is2.lse.ac.uk/asp/aspecis/20020011.pdf > Accessed September
12, 2008.
Aldridge J. Single Case Research Designs for the Clinician.
Available at: <
http://www.musictherapyworld.net/modules/archive/stuff/papers/Sing
Case.pdf > Accessed September 12, 2008
Greenhalgh, T. How to read a paper: Papers that summarise other
papers (systematic reviews and meta-analyses). Available at: <
http://www.bmj.com/cgi/content/full/315/7109/672 > Accessed
September 12, 2008
48 MP Watkins, 2008
49. Text References
Law M, MacDermid J. Evidence-Based
Rehabilitation. Thorofare, NJ: Slack Inc, 2008
Portney LG, Watkins MP. Foundations of
Clinical Research. Applications to Practice.
Upper Saddle River, NJ: Pearson Prentice
Hall, 2009
49 MP Watkins, 2008