An overview of the Open SUNY COTE Quality Review (OSCQR) Process and Rubric for the continuous improvement of online course design. By the Open SUNY Center for Online Teaching Excellence.

1. Center
for
Online
Teaching
Excellence
(COTE)
The
Open
SUNY
Course
Quality
Review
(OSCQR)
Process
and
Rubric

2. Who are we? How did we get here?
SLN
Application
SupportSLN
HelpDesk
Online
readiness
assessment
Open-
SUNY.edu
navigator Exploration
course
Student
online
experience
SLN
Education
Research
Faculty
professional
development
in online
education
SLN Online
Resources
LMS
Administrative
support
LMS
Hosting

3. Open SUNY Digital DNA
Campus and
system-wide
initiatives and
supports
Student
supports
24/7 service
hotline
Online
academic
tutoring
Library
and open
educational
resources
Student
computer
program
Academic
initiatives
Lab for
new models
in teaching
and learning
Affordable
broadband
for NYS
Revenue
And cost
models
Universal
sign-on
Online
readiness
assessment
Policy
architecture
Open SUNY
NY State
SUNY
Prior
learning
assessment
High-needs
disciplines
General
education
Signature
SUNY
programs
Skill
remediation
Offerings
powered by
Open SUNY
Open SUNY
infrastructure
Educational
resources
Competency-
based
learning
Credit-
bearing
third-party
content
Open SUNY
Global
ePortfolio
Open-
SUNY.edu
navigator
Credits
and financial
aid across
campuses
Student
services
hotline
Experiential
learning
Exploration
course
Student
online
experience
Faculty
supports
Research &
innovation
Faculty
professional
development
in online
education
Course
supports
Community
of practice Competency
development
Open SUNY
Learning
Commons
24/7 service
hotline
Institutional
pathways &
readiness
Student
concierge
Potential
students
Monitoring
and
continuous
improvement
Stakeholder
engagement
and commu-
nications
Funders
and
partners
Complete
SUNY
IT enablers
Legal and
compliance
policies
Identification
& verification
Workforce
development

4. Open SUNY Center for Online Teaching Excellence (COTE)
Campus and
system-wide
initiatives and
supports
Student
supports
24/7 service
hotline
Online
academic
tutoring
Library
and open
educational
resources
Student
computer
program
Academic
initiatives
Lab for
new models
in teaching
and learning
Affordable
broadband
for NYS
Revenue
And cost
models
Universal
sign-on
Online
readiness
assessment
Policy
architecture
Open SUNY
NY State
SUNY
Prior
learning
assessment
High-needs
disciplines
General
education
Signature
SUNY
programs
Skill
remediation
Offerings
powered by
Open SUNY
Open SUNY
infrastructure
Educational
resources
Competency-
based
learning
Credit-
bearing
third-party
content
Open SUNY
Global
ePortfolio
Open-
SUNY.edu
navigator
Credits
and financial
aid across
campuses
Student
services
hotline
Experiential
learning
Exploration
course
Student
online
experience
Faculty
supports
Research &
innovation
Faculty
professional
development
in online
education
Course
supports
Community
of practice Competency
development
Open SUNY
Learning
Commons
24/7 service
hotline
Institutional
pathways &
readiness
Student
concierge
Potential
students
Monitoring
and
continuous
improvement
Stakeholder
engagement
and commu-
nications
Funders
and
partners
Complete
SUNY
IT enablers
Legal and
compliance
policies
Identification
& verification
Workforce
development

5. COTE
Center for
Online
Teaching
Excellence
Research &
innovationFaculty
professional
development
in online
education
Course
supportsCommunity
of practice
Competency
development
Open SUNY
Learning
Commons
24/7 service
hotline
Open SUNY
Course Supports

6. A COTE framework, process, and resource
provider for:
- Course Review
- Course Refresh
- Learning Review
What are Course Supports?

7. Open SUNY COTE Quality Review
Our Goal:
To ensure that all online courses meet quality
instructional design and accessibility standards, and are
regularly reviewed, refreshed, and improved to reflect
campus guidelines and research-based online effective
practices.
Meet OSCQR

8. Open SUNY COTE Quality
Review Rubric
Meet OSCQR

9. Open SUNY COTE Quality Review Rubric
The
CHICO
Rubric
Meet OSCQR

10. Open SUNY COTE Quality Review Rubric
The
CHICO
Rubric
SUNY
Campus
Input
Meet OSCQR

11. Open SUNY COTE Quality Review Rubric
The
CHICO
Rubric
SUNY
Campus
Input
SLN/Open
SUNY
EffecJve
PracJces
Meet OSCQR

12. Open SUNY COTE Quality Review Rubric
The
CHICO
Rubric
SUNY
Campus
Input
SLN/Open
SUNY
EffecJve
PracJces
Gap
Analysis
with
other
rubrics:
• Quality
MaOers
• iNACOL
• Bb
Exemplary
Courses
Meet OSCQR

13. Open SUNY COTE Quality Review Rubric
The
CHICO
Rubric
SUNY
Campus
Input
SLN/Open
SUNY
EffecJve
PracJces
Gap
Analysis
with
other
rubrics:
• Quality
MaOers
• INACOL
• Bb
Exemplary
Courses
Accessibility
Standards
Meet OSCQR

14. • Based on Community of Inquiry (COI) model.
• 37 discrete standards for online instructional
design.
• 37 discrete standards for web accessibility.
• Research-based and built for SUNY by SUNY.
• Mapped to the COTE fundamental and core
competencies for online instructional design.
OSCQR Rubric

15.
The
Community
of
Inquiry
(Garrison,
Anderson,
and
Archer,
2000)
Bloom’s
Taxonomy
(Bloom
et
al.,
1956)
Seven
Principles
For
Good
PracJce
in
Undergraduate
EducaJon
(Chickering
&
Gamson,
1987)
The
Adult
Learner
(Malcom
Knowles,
1973)
How
People
Learn
(Bransford
et
al.,
1999)
Pedagogical Influences

16.
The
Community
of
Inquiry
(Garrison,
Anderson,
and
Archer,
2000)
Pedagogical Influences

17. Bloom’s
Taxonom
y
(Bloom
et
al.,
1956)
Pedagogical Influences

18. The
Adult
Learner
(Malcom
Knowles,
1973)
Pedagogical Influences

19. How
People
Learn
(Bransford
et
al.,
1999)
Pedagogical Influences

20. Seven
Principles
For
Good
PracJce
in
Undergraduate
EducaJon
(Chickering
&
Gamson,
1987)
Pedagogical Influences

21. Flexible,
non-­‐evaluaJve,
and
focused
on
improvement
The OSCQR Rubric

22. The
sole
intent
of
OSCQR
is
to
help
iden3fy
how
a
course
can
be
improved
during
the
Course
Refresh
process.
The OSCQR Rubric

23. Many factors contribute to quality …

24. • Alignment
of
course
objecJves/
• learning
acJviJes/assessments
• Social
Presence,
Teaching
Presence,
• CogniJve
Presence
• The
learner’s
perspecJve:
• NavigaJon
• Pacing
• Content
presentaJon
• Accessibility
Instructional Design Only

25. • Self-­‐serve
rubric:
bit.ly/OSCQRSelfServe.
• Rubric
remains
private
unless
you
wish
to
share.
Use the OSCQR Rubric to Review Your
Course
Self-Assessment

26. • Aggregated
narraJve
feedback.
• Engage
librarians,
instrucJonal
designers,
colleagues.
• External
input
promotes:
• ObjecJvity.
• More
robust
acJon
plans.
• The
“student”
perspecJve.
Have Multiple Reviewers’ Perspectives
Peer Review

27. • Go to bit.ly/OSCQRSelfServe.
• Fill out two pieces of information.
• Check your email.
• Click on the link to your own rubric.
Bookmark the URL of the rubric.
Let’s Try It!

28. Achievement Levels
Tabs
A Brief Tour

29. • ConstrucJve
feedback
=
soluJons,
not
problems.
• Avoid:
The
Icebreaker
Module
does
not
include
a
forum
for
students
to
ask
quesJons.
• Provide:
Create
an
“Ask
a
QuesJon”
forum
in
the
Icebreaker
module.
• All
entries
are
automaJcally
saved.
• All
input
is
confidenJal,
shared
only
when
you
share
it.
A Few Rules of the Road
Suggestions

30. 1. Review your own course or one from the
Courses for Observation (links on worksheet).
2. Choose two instructional design standards and
apply them.
3. Choose two accessibility standards and apply
them.
Use your OSQCR Worksheet

31. Center
for
Online
Teaching
Excellence
(COTE)
Campus
and
Program
ImplementaJon
of
the
OSCQR
Rubric

32. • Campuses create and manage their own OSCQR
rubrics.
• Rubrics can be customized for particular programs.
• Activity can be tracked and aggregated.
• Reviews are conducted on copies of courses (no
student activity).
OSCQR Dashboard

33. Review
and
refresh
progress
is
aggregated
automa.cally.
OSCQR Dashboard

34. Data
analyJcs
allows
a
campus
to
idenJfy
trends.
Campus Analytics

35. Process
is
mulJ-­‐
faceted
and
flexible.
OSCQR Process

36. The
focus
remains
on
conJnuous
improvement
and
is
an
iteraJve
process.
OSCQR Process

37. • Become an Open SUNY COTE fellow:
– Interact with colleagues and practitioners across SUNY.
– Once registered, tap into professional development opportunities, instructional
resources, discipline-specific groups, and COTE community events.
– http://cotecommunity.open.suny.edu/
• Learn more about Open SUNY/COTE
– http://commons.suny.edu/opensuny/faq/
– http://commons.suny.edu/cote/
• Learn more about OSCQR
– http://commons.suny.edu/cote/course-supports/
– Get the Rubric
– http://commons.suny.edu/cote/course-supports/oscqr-rubric/
Next Steps