SlideShare una empresa de Scribd logo
1 de 7
Descargar para leer sin conexión
Overview of CSR
Study Section Meetings
Joan Tucker, PhD
Senior Behavioral Scientist
RAND Corporation
Slide 2
What Happens Before the Meeting?
•  Study section members review list of applications
and notify SRO of any conflicts of interest
•  Each application is typically assigned to 3 reviewers
•  The lead and secondary reviewers write a full review;
the discussant writes an overall impact paragraph
•  NIH scoring system uses a 9-point rating for the
impact/priority score (1 = exceptional to 9 = poor)
•  Assigned reviewers also provide ratings for each
review criterion (e.g., Significance, Innovation)
Slide 3
What Happens Before the Meeting?
•  Assigned reviewers post their critique and ratings a
few days prior to the meeting
•  This allows:
– All study section members to read the reviews and
ratings ahead of time
– SRO to determine order of review based on
preliminary ratings provided by the assigned
reviewers, including identifying applications that
will likely not be discussed at the meeting
Slide 4
What Happens During the Meeting?
•  Suggested time limit for discussing applications is 15
minutes per R01, 10 minutes per R21 or R03
•  Members with a conflict of interest leave the room
•  Each of the assigned reviewers states his/her priority
score for the application
•  Lead reviewer briefly describes the study and
highlights principal strengths and weaknesses
according to review criteria
•  Secondary reviewer and discussant are given an
opportunity to weigh in (but if they have nothing to
add, they can say so)
Slide 5
What Happens During the Meeting?
•  Discussion is opened up to full committee, who can
ask questions or offer further comment on
strengths/weaknesses
•  Protections for Human Subjects and Inclusion codes
are then reviewed
•  Budget concerns can be discussed, but “F word”
cannot be used during review
Slide 6
What Happens During the Meeting?
•  Assigned reviewers revisit their priority score;
sometimes scores change based on discussion,
sometimes they don’t
•  This creates a range of scores for the application
•  Discussed applications receive priority scores from
all eligible reviewers. While most will score the
application within the range, they can ask to score
the application outside the range.
•  Scores are averaged and the result multiplied by 10
to determine final priority score (range of 10 to 90)
Slide 7
What Happens After the Meeting?
•  Assigned reviewers may be asked to change their
critique after the meeting if:
– They have changed their score based on
discussion (so that the critique matches the score)
– A weakness is raised during the discussion that
isn’t reflected in any of the critiques, but needs
attention by the PI if the application is resubmitted

Más contenido relacionado

Destacado

Tucker workshop core review criteria
Tucker workshop core review criteriaTucker workshop core review criteria
Tucker workshop core review criteria
UCLA CTSI
 

Destacado (16)

Writing the NIH K Award (SF 424): K08-K23 Applications & Individual CDAs
Writing the NIH K Award (SF 424): K08-K23 Applications & Individual CDAsWriting the NIH K Award (SF 424): K08-K23 Applications & Individual CDAs
Writing the NIH K Award (SF 424): K08-K23 Applications & Individual CDAs
 
Asthmatic children transitioning from acute care to community-based managed care
Asthmatic children transitioning from acute care to community-based managed careAsthmatic children transitioning from acute care to community-based managed care
Asthmatic children transitioning from acute care to community-based managed care
 
Introduction to UCLA CTSI and K Workshop
Introduction to UCLA CTSI and K WorkshopIntroduction to UCLA CTSI and K Workshop
Introduction to UCLA CTSI and K Workshop
 
04 norris ctsi k award 7 26-12
04 norris ctsi k award 7 26-1204 norris ctsi k award 7 26-12
04 norris ctsi k award 7 26-12
 
Estimating the Cost and Cost Savings of Community Partners in Care
Estimating the Cost and Cost Savings of Community Partners in CareEstimating the Cost and Cost Savings of Community Partners in Care
Estimating the Cost and Cost Savings of Community Partners in Care
 
Grant Proposals (SF 424): K08-K23 Applications and Individual CDAs
Grant Proposals (SF 424): K08-K23 Applications and Individual CDAsGrant Proposals (SF 424): K08-K23 Applications and Individual CDAs
Grant Proposals (SF 424): K08-K23 Applications and Individual CDAs
 
NIH/Career Development Award Workshop
NIH/Career Development Award WorkshopNIH/Career Development Award Workshop
NIH/Career Development Award Workshop
 
Understanding the Burden of Heart Disease in South Los Angeles
Understanding the Burden of Heart Disease in South Los AngelesUnderstanding the Burden of Heart Disease in South Los Angeles
Understanding the Burden of Heart Disease in South Los Angeles
 
Navigating the NIH K Award Process (July 2015)
Navigating the NIH K Award Process (July 2015)Navigating the NIH K Award Process (July 2015)
Navigating the NIH K Award Process (July 2015)
 
How to Anticipate and Plan for an R Grant Application
How to Anticipate and Plan for an R Grant ApplicationHow to Anticipate and Plan for an R Grant Application
How to Anticipate and Plan for an R Grant Application
 
K-to-R Workshop: How to Structure the "Approach" Section (Part 1)
K-to-R Workshop: How to Structure the "Approach" Section (Part 1)K-to-R Workshop: How to Structure the "Approach" Section (Part 1)
K-to-R Workshop: How to Structure the "Approach" Section (Part 1)
 
Welcome Remarks and Overview of CTSI Resources
Welcome Remarks and Overview of CTSI ResourcesWelcome Remarks and Overview of CTSI Resources
Welcome Remarks and Overview of CTSI Resources
 
K-to-R Workshop: Significance and Innovation
K-to-R Workshop: Significance and InnovationK-to-R Workshop: Significance and Innovation
K-to-R Workshop: Significance and Innovation
 
Tucker workshop core review criteria
Tucker workshop core review criteriaTucker workshop core review criteria
Tucker workshop core review criteria
 
Shetty significance and innovation
Shetty significance and innovationShetty significance and innovation
Shetty significance and innovation
 
Improving Healthcare Quality and Safety while Reducing Costs through Clinical...
Improving Healthcare Quality and Safety while Reducing Costs through Clinical...Improving Healthcare Quality and Safety while Reducing Costs through Clinical...
Improving Healthcare Quality and Safety while Reducing Costs through Clinical...
 

Similar a Tucker workshop

Changes in peer review v3
Changes in peer review v3Changes in peer review v3
Changes in peer review v3
CherylAnnie
 
Seven deadly sins of software reviews
Seven deadly sins of software reviewsSeven deadly sins of software reviews
Seven deadly sins of software reviews
allle90
 
SMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docxSMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docx
rosemariebrayshaw
 
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docxSCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
kenjordan97598
 
Anna Dickinson REF Update from HEFCE
Anna Dickinson REF Update from HEFCEAnna Dickinson REF Update from HEFCE
Anna Dickinson REF Update from HEFCE
ARLGSW
 

Similar a Tucker workshop (20)

Changes in peer review v3
Changes in peer review v3Changes in peer review v3
Changes in peer review v3
 
Seven deadly sins of software reviews
Seven deadly sins of software reviewsSeven deadly sins of software reviews
Seven deadly sins of software reviews
 
Assessment and feedback
Assessment and feedbackAssessment and feedback
Assessment and feedback
 
Review Process
Review ProcessReview Process
Review Process
 
Panel evaluation, processes and results
Panel evaluation, processes and resultsPanel evaluation, processes and results
Panel evaluation, processes and results
 
Bab 3
Bab 3Bab 3
Bab 3
 
Interviewing Candidates
Interviewing CandidatesInterviewing Candidates
Interviewing Candidates
 
Research Funding & AHRQ
Research Funding & AHRQResearch Funding & AHRQ
Research Funding & AHRQ
 
muhammaddawoodbashir_16_8519_ME-022-Muhammad Dawood Bashir.pptx
muhammaddawoodbashir_16_8519_ME-022-Muhammad Dawood Bashir.pptxmuhammaddawoodbashir_16_8519_ME-022-Muhammad Dawood Bashir.pptx
muhammaddawoodbashir_16_8519_ME-022-Muhammad Dawood Bashir.pptx
 
Entity Resource Planning selection process
Entity Resource Planning selection processEntity Resource Planning selection process
Entity Resource Planning selection process
 
Static techniques
Static techniquesStatic techniques
Static techniques
 
SMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docxSMART Learner FormPSL Scientific Merit Action Research Te.docx
SMART Learner FormPSL Scientific Merit Action Research Te.docx
 
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docxSCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
SCIENTIFIC MERIT ACTION RESEARCH TEMPLATE (SMART) FORMa..docx
 
Consensus method - Nominal Group technique and Delhi technique
Consensus method - Nominal Group technique and Delhi techniqueConsensus method - Nominal Group technique and Delhi technique
Consensus method - Nominal Group technique and Delhi technique
 
Anna Dickinson REF Update from HEFCE
Anna Dickinson REF Update from HEFCEAnna Dickinson REF Update from HEFCE
Anna Dickinson REF Update from HEFCE
 
Effective governance using the governance wheel P9
Effective governance using the governance wheel P9 Effective governance using the governance wheel P9
Effective governance using the governance wheel P9
 
Performance Management - Herman Augnis
Performance Management - Herman Augnis Performance Management - Herman Augnis
Performance Management - Herman Augnis
 
Static Technique
Static TechniqueStatic Technique
Static Technique
 
Phases of a formal review
Phases of a formal reviewPhases of a formal review
Phases of a formal review
 
Software Testing 4/5
Software Testing 4/5Software Testing 4/5
Software Testing 4/5
 

Más de UCLA CTSI

Más de UCLA CTSI (20)

What Next: When You are not Funded on the First Round - 2023
What Next: When You are not Funded on the First Round - 2023What Next: When You are not Funded on the First Round - 2023
What Next: When You are not Funded on the First Round - 2023
 
How to Write the “Specific Aims” Section - 2023
How to Write the “Specific Aims” Section - 2023How to Write the “Specific Aims” Section - 2023
How to Write the “Specific Aims” Section - 2023
 
How to Structure the “Approach” Section (Basic Science)
How to Structure the “Approach” Section (Basic Science)How to Structure the “Approach” Section (Basic Science)
How to Structure the “Approach” Section (Basic Science)
 
How to Craft the "Significance” & "Innovation" [Filler] - 2023
How to Craft the "Significance” & "Innovation" [Filler] - 2023How to Craft the "Significance” & "Innovation" [Filler] - 2023
How to Craft the "Significance” & "Innovation" [Filler] - 2023
 
How to Craft the "Significance” & "Innovation" - 2023
How to Craft the "Significance” & "Innovation"  - 2023How to Craft the "Significance” & "Innovation"  - 2023
How to Craft the "Significance” & "Innovation" - 2023
 
A Tactical Approach to Writing Your Grant Application (HSR) - 2023
A Tactical Approach to Writing Your Grant Application (HSR) - 2023A Tactical Approach to Writing Your Grant Application (HSR) - 2023
A Tactical Approach to Writing Your Grant Application (HSR) - 2023
 
A Tactical Approach to Writing Your Grant Application - 2023
A Tactical Approach to Writing Your Grant Application - 2023A Tactical Approach to Writing Your Grant Application - 2023
A Tactical Approach to Writing Your Grant Application - 2023
 
How to Write the “Specific Aims” Section of a Grant Application (Basic Scienc...
How to Write the “Specific Aims” Section of a Grant Application (Basic Scienc...How to Write the “Specific Aims” Section of a Grant Application (Basic Scienc...
How to Write the “Specific Aims” Section of a Grant Application (Basic Scienc...
 
How to Anticipate and Plan for an R Grant Application - 2023
How to Anticipate and Plan for an R Grant Application - 2023How to Anticipate and Plan for an R Grant Application - 2023
How to Anticipate and Plan for an R Grant Application - 2023
 
NIH Loan Repayment Program (LRP) Info Session - 9/26/23
NIH Loan Repayment Program (LRP) Info Session - 9/26/23NIH Loan Repayment Program (LRP) Info Session - 9/26/23
NIH Loan Repayment Program (LRP) Info Session - 9/26/23
 
Writing the NIH K Award – Research Plan
Writing the NIH K Award – Research PlanWriting the NIH K Award – Research Plan
Writing the NIH K Award – Research Plan
 
Considerations in Applying for a K99 Award: the NIH "Pathway to Independence"...
Considerations in Applying for a K99 Award: the NIH "Pathway to Independence"...Considerations in Applying for a K99 Award: the NIH "Pathway to Independence"...
Considerations in Applying for a K99 Award: the NIH "Pathway to Independence"...
 
Navigating the NIH K Award Process and Choosing Your Mentorship Team (2023)
Navigating the NIH K Award Process  and Choosing Your Mentorship Team (2023)Navigating the NIH K Award Process  and Choosing Your Mentorship Team (2023)
Navigating the NIH K Award Process and Choosing Your Mentorship Team (2023)
 
K Awards – Common Pitfalls and UCLA CTSI KL2 Resources (2023)
K Awards – Common Pitfalls and UCLA CTSI KL2 Resources (2023)K Awards – Common Pitfalls and UCLA CTSI KL2 Resources (2023)
K Awards – Common Pitfalls and UCLA CTSI KL2 Resources (2023)
 
Writing the NIH K Award – Candidate Information and Career Development Plan, ...
Writing the NIH K Award – Candidate Information and Career Development Plan, ...Writing the NIH K Award – Candidate Information and Career Development Plan, ...
Writing the NIH K Award – Candidate Information and Career Development Plan, ...
 
How to Anticipate and Plan for an R Grant Application. (2022)
How to Anticipate and Plan for an R Grant Application. (2022)How to Anticipate and Plan for an R Grant Application. (2022)
How to Anticipate and Plan for an R Grant Application. (2022)
 
A Tactical Approach to Writing Your Grant Application. (Moin, 2022)
A Tactical Approach to Writing Your Grant Application. (Moin, 2022)A Tactical Approach to Writing Your Grant Application. (Moin, 2022)
A Tactical Approach to Writing Your Grant Application. (Moin, 2022)
 
How to Write the “Specific Aims” Section of a Grant Application. (Moin, 2022)
How to Write the “Specific Aims” Section of a Grant Application. (Moin, 2022)How to Write the “Specific Aims” Section of a Grant Application. (Moin, 2022)
How to Write the “Specific Aims” Section of a Grant Application. (Moin, 2022)
 
K99 Award: the NIH "Pathway to Independence"
K99 Award: the NIH "Pathway to Independence"K99 Award: the NIH "Pathway to Independence"
K99 Award: the NIH "Pathway to Independence"
 
Navigating the NIH K Award Process - Carol Mangione, MD, MSPH (2022)
Navigating the NIH K Award Process - Carol Mangione, MD, MSPH (2022)Navigating the NIH K Award Process - Carol Mangione, MD, MSPH (2022)
Navigating the NIH K Award Process - Carol Mangione, MD, MSPH (2022)
 

Último

1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
fonyou31
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Último (20)

BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
BAG TECHNIQUE Bag technique-a tool making use of public health bag through wh...
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 

Tucker workshop

  • 1. Overview of CSR Study Section Meetings Joan Tucker, PhD Senior Behavioral Scientist RAND Corporation
  • 2. Slide 2 What Happens Before the Meeting? •  Study section members review list of applications and notify SRO of any conflicts of interest •  Each application is typically assigned to 3 reviewers •  The lead and secondary reviewers write a full review; the discussant writes an overall impact paragraph •  NIH scoring system uses a 9-point rating for the impact/priority score (1 = exceptional to 9 = poor) •  Assigned reviewers also provide ratings for each review criterion (e.g., Significance, Innovation)
  • 3. Slide 3 What Happens Before the Meeting? •  Assigned reviewers post their critique and ratings a few days prior to the meeting •  This allows: – All study section members to read the reviews and ratings ahead of time – SRO to determine order of review based on preliminary ratings provided by the assigned reviewers, including identifying applications that will likely not be discussed at the meeting
  • 4. Slide 4 What Happens During the Meeting? •  Suggested time limit for discussing applications is 15 minutes per R01, 10 minutes per R21 or R03 •  Members with a conflict of interest leave the room •  Each of the assigned reviewers states his/her priority score for the application •  Lead reviewer briefly describes the study and highlights principal strengths and weaknesses according to review criteria •  Secondary reviewer and discussant are given an opportunity to weigh in (but if they have nothing to add, they can say so)
  • 5. Slide 5 What Happens During the Meeting? •  Discussion is opened up to full committee, who can ask questions or offer further comment on strengths/weaknesses •  Protections for Human Subjects and Inclusion codes are then reviewed •  Budget concerns can be discussed, but “F word” cannot be used during review
  • 6. Slide 6 What Happens During the Meeting? •  Assigned reviewers revisit their priority score; sometimes scores change based on discussion, sometimes they don’t •  This creates a range of scores for the application •  Discussed applications receive priority scores from all eligible reviewers. While most will score the application within the range, they can ask to score the application outside the range. •  Scores are averaged and the result multiplied by 10 to determine final priority score (range of 10 to 90)
  • 7. Slide 7 What Happens After the Meeting? •  Assigned reviewers may be asked to change their critique after the meeting if: – They have changed their score based on discussion (so that the critique matches the score) – A weakness is raised during the discussion that isn’t reflected in any of the critiques, but needs attention by the PI if the application is resubmitted