SlideShare una empresa de Scribd logo
1 de 52
Descargar para leer sin conexión
Open Proposals:
A Pre-Competitive Interactive
Space for Research Community
Oksana Gologorskaya, M.Sc.
Product Manager, Virtual Home Program,
Clinical and Translational Science Institute,
University of California, San Francisco
Learning Objectives
“Crowdsourcing” ideas and proposal
development at biomedical institution
Insights from 5 years of practicing
Open Proposals Tool Demo
Invitation to collaborate
Harvesting Ideas in Academia
Request for Proposals
RFP Timeline
Imagine a friendly community…
Add “social” phase to the process
What is different?
Proposal Ideas are shared with community
before they are submitted
Everyone knows what everyone else is
proposing
Anyone in community can comment on the
ideas
Valuable contributors can join proposal teams
Proposal teams can merge
Open Proposal Process
Share Online
Discuss & Improve
Submit for Review
See Everyone’s Results
accelerate.ucsf.edu
First Open Forum
 18 ideas
 41 comments
accelerate.ucsf.edu
First Open Forum: Implementation
 Section on existing Drupal website
 Simple features:
 Post ideas
 Comment
 Vote
 Anonymous participation ok
2009 UCSF CTSI Grant Renewal RFPaccelerate.ucsf.edu
 High stakes: ideas for
$112 M grant
 53 ideas
 47 comments
 We got the grant!
Practical Insight 1: Starting Conditions
Collaborative audience
Non-$ motivations to participate
Support from the top
UCSF CTSI Pilot Awards 2012
accelerate.ucsf.edu
 28 ideas
 292 comments
Participation Increased. Why?
18 27 53
19 28
41 39
47
6
290
2009 2009 2009 2010 2012
Open Forums Participation 2009-2012
Proposals Comments
Behaviors Observed:
Proposals improved
Connections made between
participants
Proposals withdrawn
Practical Insight 2: Process Matters
18 27 53
19 28
41 39
47
6
290
1 2 3 4 5
Open Forums Participation 2009-2012
Proposals Comments
Design process to encourage
participation
Manage the audience
First Non-CTSI Challenge
2012 UCSF IT Innovation Contest
Target Audience: All Staff & Faculty
Competing against other solutions
Solutions Considered
Email
Salesforce Chatter
Open Proposals
UCSF Open Proposals Tool
Custom Branding for
Opportunity Sponsor
UCSF Open Proposals Tool
Standalone, easy to use space
for discussions
UCSF Open Proposals Tool
Transparent & efficient process
Open Proposals Provided:
Transparent & efficient process
Standalone space for discussions
Easy to use
Custom branding for sponsor
IT Contest 2012 - Results
48 proposals, 5 awarded
73 people posted 216 comments
Withdrawn/merged proposals: 1
517 unique visitors in active
phases
A Hard Learning
Department of Medicine
Funding Patient Cohorts 2012
Funding to allocate: $200,000
Target audience: DOM Faculty (~620)
Collaborative opportunity: reusing
patient cohorts
Open Proposals: Collaborative Space for Research Community
DOM Funding Patient Cohorts
2012 - Results
14 proposals, 2 awarded
30 people posted 66 comments
Withdrawn proposals: 1
431 unique visitors in active phases
Surprising Feedback
Opportunity Sponsors: “We won’t
use it again”
End Users:
– Overall experience: 2-dissatisfied / 6 –
neutral / 7 - satisfied
– Proposal impact: 2- improved / 7 – no
change / 2- worsened
– Team impact: 2- added team members
Practical Insight 3: Supportive Sponsor,
Engaged Community
Make sure the audience understands the
process (no, it is not a popularity contest)
Early ideas have more room for
feedback than fully baked proposals
The audience will not engage without
Sponsor’s support
Other types of opportunities that
benefited from OP
Building Community to Revamp
Medical School’s curriculum
Department Strategic Planning
Administrative Process Improvements
UCSF Open Proposals Tool
open-proposals.ucsf.edu
 Standalone Drupal Website
 Integrated with UCSF Single
Sign On
 Optional IP restricted access
 Linked with UCSF Profiles
UCSF Open Proposals UI
open-proposals.ucsf.edu
1
3
2
5
4
6
7
8
9
10
11
UI: Forum Space
1. Sponsor branding
2. Opportunity
title/subtitle
3. Intro text – opp.
description
4. Opportunity
timeline
5. Proposals main
feed
6. Forum menu
7. My Proposals
shortcut
8. Topic filter
9. Activity feeds
10.Footer menu
11.Search
1
3
2
4
UI: Proposal Page
1.Proposal title
2.Proposal view tabs
3.Proposal info
4.Proposal body
1
3
2
4
UI: Adding Proposal
1.Instructions /
format requirements
2.Title (required)
3.Taxonomy fields
4.Primary author – if
proposal is submitted for
someone else
5
7
6
8
UI: Adding Proposal
5. Proposal body
6. Multi-file attachments
7. Single file attachment
8. Post (submit) button
9. Preview button
9
Automation: Updates and Subscriptions
Proposal authors and
commenters are
automatically subscribed
to the updates on their
proposal
Forum visitors can
“Follow” the forum or its
selected proposals
Key Ingredients for Success
Process
Tool
Engaged Community
Supportive Sponsor
Challenges
How to engage community?
– Intrinsic vs. extrinsic motivation for community
reviewers
Community balance
Narrow enough to
remain relevant
and collaborative
Wide enough to
provide valuable
input
Benefits of Open Proposals
Open, transparent process
Collaborative space
Efficiency
Better teams
Better proposals
Less Obvious Benefits
Reviewers get not only proposals
but also community’s reaction that
may inform them as well
Every idea is captured and stays
there (usually online) forever…
Active participants build
relationships and get noticed
Winning proposals draw more attention
0 5 10 15 20 25
IT Innovations Contest
OpenSocial Gadget Contest
DOM Patient Cohorts RFA
Funding Shared Equipment RFA
CHV Caring Wisely Initiative
2013 CTSI Annual Pilot Awards
Funding Shared Equipment RFA…
UCSF Coursera Course CFP
CTSI 2016 NIH Renewal Launchpad
2013 IT Innovations Contest
DOM 2013 Strategic Planning
CHV Caring Wisely 2 Initiative
2014 Innovations Funding for…
SOM Dean's Office Bureaucracy…
Average comments for
winning proposal
Average comments for
other proposals
Avg. # Comments, All Forums
Winning vs. Non Winning Proposals
0
1
2
3
4
5
6
Avg. comments per proposal
Winning
Non Winning
UCSF Open Proposals Today
 23 forums Since launch in 2012
 700+ proposals
 18,000+ visitors
 $ 4,000,000+ funding distributed
 Shared with 2 institutions
What’s Next?
Research
Administration,
Infrastructure,
Strategic
Planning
Collaborative
Research
Opportunities
Thank You
UCSF Open Proposals is managed by the
UCSF Clinical and Translational Science
Institute (CTSI), part of the Clinical and
Translational Science Award program
funded by the National Center for
Advancing Translational Sciences (Grant
Number UL1 TR000004) at the National
Institutes of Health (NIH).
Special Thanks
Mini Kahlon and Clay Johnston, for
introducing the idea and making it come to
life
To Brad Bulger, for building the tool
To Cynthia Piontkowski, for creating the
tool’s people friendly side
To Leslie Yuan, for support and inspiration,
and winning decisions
Special Thanks
To Rachael Sak, for figuring out tricky details
of the process and making it a success when
most people were skeptical
To Lisa Schoonerman, for help with winning
hesitant new customers and for invaluable
practical insight
To Anirvan Chatterjee, for the most creative
ideas for the tool and its introduction to the
bigger world, and for huge help with this
presentation
Open Proposals: Collaborative Space for Research Community
It is literally true that you can
succeed best and quickest by
helping others to succeed.
Napoleon Hill, one of the great
writers on success
Publication on Open Proposals
http://onlinelibrary.wiley.com/doi/10.1111/
cts.12147/full
ctsi.ucsf.edu * open-proposals.ucsf.edu
GitHub Project (ask us for access):
https://github.com/CTSIatUCSF/dreamcatcher
open.proposal@ucsf.edu
oksana.gologorskaya@ucsf.edu
Contact Us
Media Credits
Noel Hidalgo, Hand made "like us on
Facebook" sign. , Flickr
Kfergos, Abstract Lights , Flickr
Sasha Gologorskaya, Friends,
Everyday Photos
Ren Kuo, Dreamcatcher, Flickr

Más contenido relacionado

Destacado

Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014
Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014
Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014anayajm
 
NISO webinar: Discovery and Reuse of Open Access Research
NISO webinar: Discovery and Reuse of Open Access ResearchNISO webinar: Discovery and Reuse of Open Access Research
NISO webinar: Discovery and Reuse of Open Access ResearchWilliam Gunn
 
Three Techniques, One System: How to Effectively Characterize Complete Muscle...
Three Techniques, One System: How to Effectively Characterize Complete Muscle...Three Techniques, One System: How to Effectively Characterize Complete Muscle...
Three Techniques, One System: How to Effectively Characterize Complete Muscle...InsideScientific
 
Quantum Field Theory and the Limits of Knowledge
Quantum Field Theory and the Limits of KnowledgeQuantum Field Theory and the Limits of Knowledge
Quantum Field Theory and the Limits of KnowledgeSean Carroll
 
Lessons from Software for Synthetic Biology
Lessons from Software for Synthetic BiologyLessons from Software for Synthetic Biology
Lessons from Software for Synthetic BiologyTim O'Reilly
 
Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...
Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...
Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...InsideScientific
 

Destacado (6)

Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014
Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014
Treatment of Rheumatoid Arthritis in Latin America - EULAR 2014
 
NISO webinar: Discovery and Reuse of Open Access Research
NISO webinar: Discovery and Reuse of Open Access ResearchNISO webinar: Discovery and Reuse of Open Access Research
NISO webinar: Discovery and Reuse of Open Access Research
 
Three Techniques, One System: How to Effectively Characterize Complete Muscle...
Three Techniques, One System: How to Effectively Characterize Complete Muscle...Three Techniques, One System: How to Effectively Characterize Complete Muscle...
Three Techniques, One System: How to Effectively Characterize Complete Muscle...
 
Quantum Field Theory and the Limits of Knowledge
Quantum Field Theory and the Limits of KnowledgeQuantum Field Theory and the Limits of Knowledge
Quantum Field Theory and the Limits of Knowledge
 
Lessons from Software for Synthetic Biology
Lessons from Software for Synthetic BiologyLessons from Software for Synthetic Biology
Lessons from Software for Synthetic Biology
 
Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...
Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...
Gold Standard Physiological Measurements and Novel Drug Delivery Methods - Se...
 

Similar a Open Proposals: Collaborative Space for Research Community

Engaging Many Minds: Crowdsourcing in Academia
Engaging Many Minds: Crowdsourcing in AcademiaEngaging Many Minds: Crowdsourcing in Academia
Engaging Many Minds: Crowdsourcing in AcademiaKatja Reuter, PhD
 
How much can you say in one sentence? Useful Science Keynote Address at ComSc...
How much can you say in one sentence? Useful Science Keynote Address at ComSc...How much can you say in one sentence? Useful Science Keynote Address at ComSc...
How much can you say in one sentence? Useful Science Keynote Address at ComSc...Useful Science
 
The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...
The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...
The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...ARISTOTELE
 
Creating an Experience-Driven Strategy: full 2011 UPA presentation
Creating an Experience-Driven Strategy: full 2011 UPA presentationCreating an Experience-Driven Strategy: full 2011 UPA presentation
Creating an Experience-Driven Strategy: full 2011 UPA presentationDante Murphy
 
CureAccelerator Final Deliverable
CureAccelerator Final DeliverableCureAccelerator Final Deliverable
CureAccelerator Final DeliverableYingwen Zeng
 
Supporting user driven innovation activities in a crowdsourcing community
Supporting user driven innovation activities in a crowdsourcing communitySupporting user driven innovation activities in a crowdsourcing community
Supporting user driven innovation activities in a crowdsourcing communityMiia Kosonen
 
Research in current scenario -sgd-adamf-20-apr-2018
Research in current scenario -sgd-adamf-20-apr-2018Research in current scenario -sgd-adamf-20-apr-2018
Research in current scenario -sgd-adamf-20-apr-2018Sanjeev Deshmukh
 
What is an idea network (aka concept map) and how and why to map a network of...
What is an idea network (aka concept map) and how and why to map a network of...What is an idea network (aka concept map) and how and why to map a network of...
What is an idea network (aka concept map) and how and why to map a network of...Daniel McLinden
 
Libraries, change management and professional development: discovering an app...
Libraries, change management and professional development: discovering an app...Libraries, change management and professional development: discovering an app...
Libraries, change management and professional development: discovering an app...RAILS7
 
Better Software, Better Practices, Better Research
Better Software, Better Practices, Better ResearchBetter Software, Better Practices, Better Research
Better Software, Better Practices, Better ResearchShoaib Sufi
 
Losing Control In Qualitative Research
Losing Control In Qualitative ResearchLosing Control In Qualitative Research
Losing Control In Qualitative ResearchLatitude Insights
 
Open Idea Development & Team Formation
Open Idea Development & Team FormationOpen Idea Development & Team Formation
Open Idea Development & Team FormationManinder Kahlon
 
Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...
Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...
Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...Peter Bruce-Clark
 
DSIC Semi-Finalist Fellowship Overview
DSIC Semi-Finalist Fellowship OverviewDSIC Semi-Finalist Fellowship Overview
DSIC Semi-Finalist Fellowship OverviewBetsy Loucks
 
Public engagement with postgraduate research june 2013
Public engagement with postgraduate research june 2013Public engagement with postgraduate research june 2013
Public engagement with postgraduate research june 2013VreckaScott
 
How to write the impact sections of a Horizon Europe proposal
How to write the impact sections of a Horizon Europe proposalHow to write the impact sections of a Horizon Europe proposal
How to write the impact sections of a Horizon Europe proposalMark Reed
 
Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...
Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...
Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...Wilfrid Laurier University
 

Similar a Open Proposals: Collaborative Space for Research Community (20)

Engaging Many Minds: Crowdsourcing in Academia
Engaging Many Minds: Crowdsourcing in AcademiaEngaging Many Minds: Crowdsourcing in Academia
Engaging Many Minds: Crowdsourcing in Academia
 
How much can you say in one sentence? Useful Science Keynote Address at ComSc...
How much can you say in one sentence? Useful Science Keynote Address at ComSc...How much can you say in one sentence? Useful Science Keynote Address at ComSc...
How much can you say in one sentence? Useful Science Keynote Address at ComSc...
 
The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...
The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...
The Innovation Engine for Team Building – The EU Aristotele Approach From Ope...
 
Creating an Experience-Driven Strategy: full 2011 UPA presentation
Creating an Experience-Driven Strategy: full 2011 UPA presentationCreating an Experience-Driven Strategy: full 2011 UPA presentation
Creating an Experience-Driven Strategy: full 2011 UPA presentation
 
CureAccelerator Final Deliverable
CureAccelerator Final DeliverableCureAccelerator Final Deliverable
CureAccelerator Final Deliverable
 
Supporting user driven innovation activities in a crowdsourcing community
Supporting user driven innovation activities in a crowdsourcing communitySupporting user driven innovation activities in a crowdsourcing community
Supporting user driven innovation activities in a crowdsourcing community
 
Research in current scenario -sgd-adamf-20-apr-2018
Research in current scenario -sgd-adamf-20-apr-2018Research in current scenario -sgd-adamf-20-apr-2018
Research in current scenario -sgd-adamf-20-apr-2018
 
What is an idea network (aka concept map) and how and why to map a network of...
What is an idea network (aka concept map) and how and why to map a network of...What is an idea network (aka concept map) and how and why to map a network of...
What is an idea network (aka concept map) and how and why to map a network of...
 
Libraries, change management and professional development: discovering an app...
Libraries, change management and professional development: discovering an app...Libraries, change management and professional development: discovering an app...
Libraries, change management and professional development: discovering an app...
 
Better Software, Better Practices, Better Research
Better Software, Better Practices, Better ResearchBetter Software, Better Practices, Better Research
Better Software, Better Practices, Better Research
 
Losing Control In Qualitative Research
Losing Control In Qualitative ResearchLosing Control In Qualitative Research
Losing Control In Qualitative Research
 
Open Idea Development & Team Formation
Open Idea Development & Team FormationOpen Idea Development & Team Formation
Open Idea Development & Team Formation
 
Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...
Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...
Generating Impact Alpha: A Global Projects Center Conference - Stanford Unive...
 
DSIC Semi-Finalist Fellowship Overview
DSIC Semi-Finalist Fellowship OverviewDSIC Semi-Finalist Fellowship Overview
DSIC Semi-Finalist Fellowship Overview
 
Adventures in research and teaching in Second Life®
Adventures in research and teaching in Second Life®Adventures in research and teaching in Second Life®
Adventures in research and teaching in Second Life®
 
Public engagement with postgraduate research june 2013
Public engagement with postgraduate research june 2013Public engagement with postgraduate research june 2013
Public engagement with postgraduate research june 2013
 
Educause_042406_FINAL
Educause_042406_FINALEducause_042406_FINAL
Educause_042406_FINAL
 
How to write the impact sections of a Horizon Europe proposal
How to write the impact sections of a Horizon Europe proposalHow to write the impact sections of a Horizon Europe proposal
How to write the impact sections of a Horizon Europe proposal
 
Bosman-Kramer Changing Research Workflows
Bosman-Kramer Changing Research WorkflowsBosman-Kramer Changing Research Workflows
Bosman-Kramer Changing Research Workflows
 
Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...
Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...
Research Week 2014: SSHRC Part One: Opportunities, Timelines, and Writing Str...
 

Último

Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdfPests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdfPirithiRaju
 
Pests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdf
Pests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdfPests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdf
Pests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdfPirithiRaju
 
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTMARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTjipexe1248
 
Substances in Common Use for Shahu College Screening Test
Substances in Common Use for Shahu College Screening TestSubstances in Common Use for Shahu College Screening Test
Substances in Common Use for Shahu College Screening TestAkashDTejwani
 
KeyBio pipeline for bioinformatics and data science
KeyBio pipeline for bioinformatics and data scienceKeyBio pipeline for bioinformatics and data science
KeyBio pipeline for bioinformatics and data scienceLayne Sadler
 
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...marwaahmad357
 
TORSION IN GASTROPODS- Anatomical event (Zoology)
TORSION IN GASTROPODS- Anatomical event (Zoology)TORSION IN GASTROPODS- Anatomical event (Zoology)
TORSION IN GASTROPODS- Anatomical event (Zoology)chatterjeesoumili50
 
Controlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentControlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentRahulVishwakarma71547
 
MARSILEA notes in detail for II year Botany.ppt
MARSILEA  notes in detail for II year Botany.pptMARSILEA  notes in detail for II year Botany.ppt
MARSILEA notes in detail for II year Botany.pptaigil2
 
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxQ3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxArdeniel
 
Human brain.. It's parts and function.
Human brain.. It's parts and function. Human brain.. It's parts and function.
Human brain.. It's parts and function. MUKTA MANJARI SAHOO
 
Lehninger_Chapter 17_Fatty acid Oxid.ppt
Lehninger_Chapter 17_Fatty acid Oxid.pptLehninger_Chapter 17_Fatty acid Oxid.ppt
Lehninger_Chapter 17_Fatty acid Oxid.pptSachin Teotia
 
M.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery SystemsM.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery SystemsSumathi Arumugam
 
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...PirithiRaju
 
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdfSUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdfsantiagojoderickdoma
 
IB Biology New syllabus B3.2 Transport.pptx
IB Biology New syllabus B3.2 Transport.pptxIB Biology New syllabus B3.2 Transport.pptx
IB Biology New syllabus B3.2 Transport.pptxUalikhanKalkhojayev1
 
Alternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusAlternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusPradnya Wadekar
 
Krishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्रKrishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्रKrashi Coaching
 
Role of herbs in hair care Amla and heena.pptx
Role of herbs in hair care  Amla and  heena.pptxRole of herbs in hair care  Amla and  heena.pptx
Role of herbs in hair care Amla and heena.pptxVaishnaviAware
 
SCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptx
SCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptxSCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptx
SCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptxROVELYNEDELUNA3
 

Último (20)

Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdfPests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
Pests of cumbu_Identification, Binomics, Integrated ManagementDr.UPR.pdf
 
Pests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdf
Pests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdfPests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdf
Pests of wheat_Identification, Bionomics, Damage symptoms, IPM_Dr.UPR.pdf
 
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENTMARKER ASSISTED SELECTION IN CROP IMPROVEMENT
MARKER ASSISTED SELECTION IN CROP IMPROVEMENT
 
Substances in Common Use for Shahu College Screening Test
Substances in Common Use for Shahu College Screening TestSubstances in Common Use for Shahu College Screening Test
Substances in Common Use for Shahu College Screening Test
 
KeyBio pipeline for bioinformatics and data science
KeyBio pipeline for bioinformatics and data scienceKeyBio pipeline for bioinformatics and data science
KeyBio pipeline for bioinformatics and data science
 
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
001 Case Study - Submission Point_c1051231_attempt_2023-11-23-14-08-42_ABS CW...
 
TORSION IN GASTROPODS- Anatomical event (Zoology)
TORSION IN GASTROPODS- Anatomical event (Zoology)TORSION IN GASTROPODS- Anatomical event (Zoology)
TORSION IN GASTROPODS- Anatomical event (Zoology)
 
Controlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform EnvironmentControlling Parameters of Carbonate platform Environment
Controlling Parameters of Carbonate platform Environment
 
MARSILEA notes in detail for II year Botany.ppt
MARSILEA  notes in detail for II year Botany.pptMARSILEA  notes in detail for II year Botany.ppt
MARSILEA notes in detail for II year Botany.ppt
 
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptxQ3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
Q3W4part1-SSSSSSSSSSSSSSSSSSSSSSSSCI.pptx
 
Human brain.. It's parts and function.
Human brain.. It's parts and function. Human brain.. It's parts and function.
Human brain.. It's parts and function.
 
Lehninger_Chapter 17_Fatty acid Oxid.ppt
Lehninger_Chapter 17_Fatty acid Oxid.pptLehninger_Chapter 17_Fatty acid Oxid.ppt
Lehninger_Chapter 17_Fatty acid Oxid.ppt
 
M.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery SystemsM.Pharm - Question Bank - Drug Delivery Systems
M.Pharm - Question Bank - Drug Delivery Systems
 
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
3.2 Pests of Sorghum_Identification, Symptoms and nature of damage, Binomics,...
 
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdfSUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
SUKDANAN DIAGNOSTIC TEST IN PHYSICAL SCIENCE ANSWER KEYY.pdf
 
IB Biology New syllabus B3.2 Transport.pptx
IB Biology New syllabus B3.2 Transport.pptxIB Biology New syllabus B3.2 Transport.pptx
IB Biology New syllabus B3.2 Transport.pptx
 
Alternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabusAlternative system of medicine herbal drug technology syllabus
Alternative system of medicine herbal drug technology syllabus
 
Krishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्रKrishi Vigyan Kendras - कृषि विज्ञान केंद्र
Krishi Vigyan Kendras - कृषि विज्ञान केंद्र
 
Role of herbs in hair care Amla and heena.pptx
Role of herbs in hair care  Amla and  heena.pptxRole of herbs in hair care  Amla and  heena.pptx
Role of herbs in hair care Amla and heena.pptx
 
SCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptx
SCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptxSCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptx
SCIENCE 6 QUARTER 3 REVIEWER(FRICTION, GRAVITY, ENERGY AND SPEED).pptx
 

Open Proposals: Collaborative Space for Research Community

  • 1. Open Proposals: A Pre-Competitive Interactive Space for Research Community Oksana Gologorskaya, M.Sc. Product Manager, Virtual Home Program, Clinical and Translational Science Institute, University of California, San Francisco
  • 2. Learning Objectives “Crowdsourcing” ideas and proposal development at biomedical institution Insights from 5 years of practicing Open Proposals Tool Demo Invitation to collaborate
  • 3. Harvesting Ideas in Academia Request for Proposals
  • 5. Imagine a friendly community…
  • 6. Add “social” phase to the process
  • 7. What is different? Proposal Ideas are shared with community before they are submitted Everyone knows what everyone else is proposing Anyone in community can comment on the ideas Valuable contributors can join proposal teams Proposal teams can merge
  • 8. Open Proposal Process Share Online Discuss & Improve Submit for Review See Everyone’s Results
  • 9. accelerate.ucsf.edu First Open Forum  18 ideas  41 comments
  • 10. accelerate.ucsf.edu First Open Forum: Implementation  Section on existing Drupal website  Simple features:  Post ideas  Comment  Vote  Anonymous participation ok
  • 11. 2009 UCSF CTSI Grant Renewal RFPaccelerate.ucsf.edu  High stakes: ideas for $112 M grant  53 ideas  47 comments  We got the grant!
  • 12. Practical Insight 1: Starting Conditions Collaborative audience Non-$ motivations to participate Support from the top
  • 13. UCSF CTSI Pilot Awards 2012 accelerate.ucsf.edu  28 ideas  292 comments
  • 14. Participation Increased. Why? 18 27 53 19 28 41 39 47 6 290 2009 2009 2009 2010 2012 Open Forums Participation 2009-2012 Proposals Comments
  • 15. Behaviors Observed: Proposals improved Connections made between participants Proposals withdrawn
  • 16. Practical Insight 2: Process Matters 18 27 53 19 28 41 39 47 6 290 1 2 3 4 5 Open Forums Participation 2009-2012 Proposals Comments Design process to encourage participation Manage the audience
  • 17. First Non-CTSI Challenge 2012 UCSF IT Innovation Contest Target Audience: All Staff & Faculty Competing against other solutions
  • 19. UCSF Open Proposals Tool Custom Branding for Opportunity Sponsor
  • 20. UCSF Open Proposals Tool Standalone, easy to use space for discussions
  • 21. UCSF Open Proposals Tool Transparent & efficient process
  • 22. Open Proposals Provided: Transparent & efficient process Standalone space for discussions Easy to use Custom branding for sponsor
  • 23. IT Contest 2012 - Results 48 proposals, 5 awarded 73 people posted 216 comments Withdrawn/merged proposals: 1 517 unique visitors in active phases
  • 24. A Hard Learning Department of Medicine Funding Patient Cohorts 2012 Funding to allocate: $200,000 Target audience: DOM Faculty (~620) Collaborative opportunity: reusing patient cohorts
  • 26. DOM Funding Patient Cohorts 2012 - Results 14 proposals, 2 awarded 30 people posted 66 comments Withdrawn proposals: 1 431 unique visitors in active phases
  • 27. Surprising Feedback Opportunity Sponsors: “We won’t use it again” End Users: – Overall experience: 2-dissatisfied / 6 – neutral / 7 - satisfied – Proposal impact: 2- improved / 7 – no change / 2- worsened – Team impact: 2- added team members
  • 28. Practical Insight 3: Supportive Sponsor, Engaged Community Make sure the audience understands the process (no, it is not a popularity contest) Early ideas have more room for feedback than fully baked proposals The audience will not engage without Sponsor’s support
  • 29. Other types of opportunities that benefited from OP Building Community to Revamp Medical School’s curriculum Department Strategic Planning Administrative Process Improvements
  • 30. UCSF Open Proposals Tool open-proposals.ucsf.edu  Standalone Drupal Website  Integrated with UCSF Single Sign On  Optional IP restricted access  Linked with UCSF Profiles
  • 31. UCSF Open Proposals UI open-proposals.ucsf.edu
  • 32. 1 3 2 5 4 6 7 8 9 10 11 UI: Forum Space 1. Sponsor branding 2. Opportunity title/subtitle 3. Intro text – opp. description 4. Opportunity timeline 5. Proposals main feed 6. Forum menu 7. My Proposals shortcut 8. Topic filter 9. Activity feeds 10.Footer menu 11.Search
  • 33. 1 3 2 4 UI: Proposal Page 1.Proposal title 2.Proposal view tabs 3.Proposal info 4.Proposal body
  • 34. 1 3 2 4 UI: Adding Proposal 1.Instructions / format requirements 2.Title (required) 3.Taxonomy fields 4.Primary author – if proposal is submitted for someone else
  • 35. 5 7 6 8 UI: Adding Proposal 5. Proposal body 6. Multi-file attachments 7. Single file attachment 8. Post (submit) button 9. Preview button 9
  • 36. Automation: Updates and Subscriptions Proposal authors and commenters are automatically subscribed to the updates on their proposal Forum visitors can “Follow” the forum or its selected proposals
  • 37. Key Ingredients for Success Process Tool Engaged Community Supportive Sponsor
  • 38. Challenges How to engage community? – Intrinsic vs. extrinsic motivation for community reviewers Community balance Narrow enough to remain relevant and collaborative Wide enough to provide valuable input
  • 39. Benefits of Open Proposals Open, transparent process Collaborative space Efficiency Better teams Better proposals
  • 40. Less Obvious Benefits Reviewers get not only proposals but also community’s reaction that may inform them as well Every idea is captured and stays there (usually online) forever… Active participants build relationships and get noticed
  • 41. Winning proposals draw more attention 0 5 10 15 20 25 IT Innovations Contest OpenSocial Gadget Contest DOM Patient Cohorts RFA Funding Shared Equipment RFA CHV Caring Wisely Initiative 2013 CTSI Annual Pilot Awards Funding Shared Equipment RFA… UCSF Coursera Course CFP CTSI 2016 NIH Renewal Launchpad 2013 IT Innovations Contest DOM 2013 Strategic Planning CHV Caring Wisely 2 Initiative 2014 Innovations Funding for… SOM Dean's Office Bureaucracy… Average comments for winning proposal Average comments for other proposals
  • 42. Avg. # Comments, All Forums Winning vs. Non Winning Proposals 0 1 2 3 4 5 6 Avg. comments per proposal Winning Non Winning
  • 43. UCSF Open Proposals Today  23 forums Since launch in 2012  700+ proposals  18,000+ visitors  $ 4,000,000+ funding distributed  Shared with 2 institutions
  • 45. Thank You UCSF Open Proposals is managed by the UCSF Clinical and Translational Science Institute (CTSI), part of the Clinical and Translational Science Award program funded by the National Center for Advancing Translational Sciences (Grant Number UL1 TR000004) at the National Institutes of Health (NIH).
  • 46. Special Thanks Mini Kahlon and Clay Johnston, for introducing the idea and making it come to life To Brad Bulger, for building the tool To Cynthia Piontkowski, for creating the tool’s people friendly side To Leslie Yuan, for support and inspiration, and winning decisions
  • 47. Special Thanks To Rachael Sak, for figuring out tricky details of the process and making it a success when most people were skeptical To Lisa Schoonerman, for help with winning hesitant new customers and for invaluable practical insight To Anirvan Chatterjee, for the most creative ideas for the tool and its introduction to the bigger world, and for huge help with this presentation
  • 49. It is literally true that you can succeed best and quickest by helping others to succeed. Napoleon Hill, one of the great writers on success
  • 50. Publication on Open Proposals http://onlinelibrary.wiley.com/doi/10.1111/ cts.12147/full
  • 51. ctsi.ucsf.edu * open-proposals.ucsf.edu GitHub Project (ask us for access): https://github.com/CTSIatUCSF/dreamcatcher open.proposal@ucsf.edu oksana.gologorskaya@ucsf.edu Contact Us
  • 52. Media Credits Noel Hidalgo, Hand made "like us on Facebook" sign. , Flickr Kfergos, Abstract Lights , Flickr Sasha Gologorskaya, Friends, Everyday Photos Ren Kuo, Dreamcatcher, Flickr

Notas del editor

  1. The Clinical & Translational Science Institute (CTSI) facilitates the translation of research to improvements in health. CTSI provides infrastructure, services, and training to support clinical and translational research. Oksana Gologorskaya, Product Manager for the Virtual Program here at CTSI. I manage technology products that support various initiatives in translational research, including Open Proposals. I studied applied math then worked as a software engineer and designer for about 13 years, in tech industry,before joiningUCSF as a product manager.
  2. This presentation will be about the new collaborative approach to developing proposals for academic initiatives. It started as an internal experiment with social media and crowdsourcing model and turned into a service and a supporting technology used to support various projects at UCSF. We believe it has enough value and we learned enough about it to be worth sharing with other institutions and hopefully some of you will get inspired to try this approach in your institution.
  3. First a bit of theory, then I will share some practical insights.In Academia research funding is often distributed via the RFP mechanism that intends to collect and select the best ideas available for a given opportunity.RFP process is commonly used for other kinds of initiatives – infrastructure improvements, innovation projects. Traditionally, it is a black box approach.
  4. This diagram is a simplified research grant submission process (NIH Grant).Every horizontal line here is a separate proposal team. Proposals that end up getting an award are shown in orange, and the purple ones are those that do not get an award.From a proposal team’s perspective, everything happens during the first phase – they put in as much time as possible to make their proposals perfect, then submit. Then they just wait to hear back. If you don’t make it through the peer review, you may not even know why exactly your proposal was rejected. And you also don’t know what your proposal was competing against. So in this process all people that submit proposals are just a bunch of competitors for the same award.
  5. Now imagine there is also a friendly professional community that wants your proposal to win. What if you include this community in the process, kind of like this…
  6. So you add a social phase to the process.Again, purple lines indicate non-winning proposals, and orange lines are the winners.Little black arrows are the community members contributing to proposals. This diagram shows a few possible scenarios.1) Uncompetitive proposal – drop out early and go prepare for the next round.2) Two similar proposals decide to combine their projects into one and submit one proposal, instead of competing with each other.3) a non-winning proposal was strengthened by community input or team member and turned into a winning one.4)The quality of each submitted proposal improves because authors see the level of other proposals submitted.With this structure, you can see that it is more time-efficient for proposers than black box approach. It is also more efficient for the reviewers as they don’t get to review some uncompetitive proposals, and also they get a higher quality bottom line.
  7. From the Proposal Author’s perspective, the second step in the process makes all the difference – it is where the proposal may change, the people collaborating on it may change and even the decision to submit the proposal may also change based on the situation in the community.Now let’s see how this theory works in practice.
  8. -not only it went mainstream, but businesses realized that they could use it to connect with the customers and grow business
  9. First practical application – a 2009 strategic planning forum.CTSI wanted to prioritize projects for the next year and the leadership decided to host an open forum on the CTSI’s website. It was a success – some of the ideas submitted have come to life as complete projects and some grew into bigger programs and services.
  10. In terms of technology, it was really minimalistic: a section on the website, with basic features like adding posts, comments and voting to support ideas.
  11. Second use case – using the open forum to collect ideas for applying for an external grant.11 of the 53 ideas proposed were included as renewal initiatives.
  12. Here comes first practical insight - in order for the approach to work, you need to meet certain starting conditions.Collaborative audience, motivations to participate and support from the top (leaders should say this is the only way to participate in the opportunity). Otherwise, people will just send their ideas the way they are used to.
  13. Third use case is interesting because we added something to the process that influenced level of participation.It was a funding opportunity to improve methods of research. CTSI was the sponsor so we had the freedom to change the process.We got 28 ideas and 292 comments from community.
  14. The boost in participation happened because of how the process was designed and how it was managed.We added a requirement for each proposal owner to comment on another proposal in order to be considered for funding. Also, we added this first submission deadline to make sure people share their proposal with community early enough, to allow time for community to contribute.In addition, the opportunity manager was constantly communicating with the audience to remind them about deadlines and to do some match making between proposals and potential contributors.
  15. As a result, we’ve seen all the scenarios that our theoretical model suggested: some proposals were improved, people got to work together for the first time, and also, some proposals were withdrawn early.There was a case when someone proposed to build a solution for a problem with a research method. A community member commented on the proposal to point out to already existing solution the proposer did not know about. So they withdrew their proposal.
  16. (comments required)Time driven process(reminders, matchmaking)
  17. My next use case is about the first use outside of out own department – external customer, cross campus initiative, competing against other solutions.
  18. Email = black boxSalesforce Chatter is nice, kind of like FB for employees, and we have this great arrangement with Salesforce at UCSF, but 1) not web 2.0 savvy people would have a learning curve 2) UI is branded for SF and your organization – UCSF – but not so much for the specific opportunity.
  19. Branding is importantYou can see right away who is sponsoring the opportunity, and it hopefully invites people to trust it with their ideas.
  20. It looks and feels like a separate website, without extra noise, it is all about a given opportunity. Simple and structured enough, not too casual.
  21. Summary of Proposals page allows both Reviewers and Proposers to quickly scan through all proposals, see the current stats of the forum.You can also export this summary data or generate a document with all the proposals to read through off-line.
  22. It was not al there yet – but we built it on Drupal
  23. Back to case study
  24. Case study 4 – a hard learning.
  25. We looked at the reasons for this negative outcome, and it turned out thatPeople thought it was a popularity contest - they thought proposals would be judged by the number of comments they getProposals were submitted when they were quite mature already, that left little room for feedback.The sponsors or organizers did not believe in the process and did not work with the audience to encourage collaboration.
  26. The tool is designed to enable collaborative, transparent proposal development and submission processDesigned specifically for academic RFP processes.Time-driven processAutomated notifications
  27. The tool is designed to enable collaborative, transparent proposal development and submission processDesigned specifically for academic RFP processes.Time-driven processAutomated notifications
  28. The tool is designed to enable collaborative, transparent proposal development and submission processDesigned specifically for academic RFP processes.Time-driven processAutomated notifications
  29. The tool is designed to enable collaborative, transparent proposal development and submission processDesigned specifically for academic RFP processes.Time-driven processAutomated notifications
  30. The tool is designed to enable collaborative, transparent proposal development and submission processDesigned specifically for academic RFP processes.Time-driven processAutomated notifications
  31. The tool is designed to enable collaborative, transparent proposal development and submission processDesigned specifically for academic RFP processes.Time-driven processAutomated notifications
  32. Access to collaborative community is one thing, another thing is how to encourage collaboration.Depending on the opportunity, there could be direct and indirect ways to do it. Setting aside some type of awards for valuable contributors, with some tokens of appreciation could be helpful. Also educating the community about the benefits of participating.
  33. Transparent process helps build credibility for the sponsorCollaborative space – another way to find collaborators and meet peersEfficiency – saves time for all