1. Progress Report Presentation:
Debriefing Assessment in Real Time - DART
Barbara Ferdman*, M.D., Lou Halamek**, M.D.
For the DART Research Group
*University of Rochester Medical Center
**Center for Advanced Pediatric and Perinatal Education,
Stanford University
IMSH 2014: San Francisco, CA / USA
International Network for Simulation-based Pediatric Innovation, Research and Education

2. Aim(s) - Revised
• Record multiple debriefings at a minimum of 3 sites
– Debriefers will possess different levels of experience and employ different
methods of debriefing
• Score debriefings using DASH, DART 1 and DART 2
• Compare
o
o
o
o
Perceived ease of use
Inter-rater reliability
Construct validity
Identify any objective markers that correlate with perceived quality
International Network for Simulation-based Pediatric Innovation, Research and Education

3. Timeline
• March 1:
o Finalize DART 1 and DART 2
o Finalize scoring guide for the DART assessment tool
• May 1:
o Complete pilot testing DART 1 and DART 2 (Stanford only)
o Revise assessment tools and scoring guide as necessary
• August 1
o Score 10 debriefings at each site using the DASH, DART 1, and
DART 2
o Begin data analysis
International Network for Simulation-based Pediatric Innovation, Research and Education

4. Progress since Jan 2013
• Quantifiable markers refined
• Project design revised
o DART expanded, now 2 versions available
o Scoring guide developed to reduce ambiguity for raters
• Plan to seek internal funding to assist with implementation
International Network for Simulation-based Pediatric Innovation, Research and Education

5. Needs / Challenges
• Securing the time (and personnel) to devote to non-funded
research
• Identify any additional ambiguous verbalizations and determine
optimal method of scoring to optimize inter-rater reliability
• Illustrate, in a visually compelling way, the flow of a debriefing
session
• Seek internal funding sources
International Network for Simulation-based Pediatric Innovation, Research and Education

6. How can INSPIRE help?
1. Provide site to upload recordings of
debriefings
2. In 3 months: ?
3. Over 1 year: ?
International Network for Simulation-based Pediatric Innovation, Research and Education

7. Contact Information
Name: Lou Halamek
Institution: Center for Advanced Pediatric
and Perinatal Education, Stanford
halamek@stanford.edu
650-724-4444
International Network for Simulation-based Pediatric Innovation, Research and Education