SlideShare una empresa de Scribd logo
1 de 46
Understanding the Faculty and Student TritonEd Experience
Using Experience Analysis and Design Methodology
UC San Diego uses
WebCT LMS
Courses supported: 756
Blackboard buys WebCT
UC San Diego migrates to Blackboard v7
Named “TED”
Courses supported: 962
Blackboard v8
Courses supported: 1316
• 2014
Blackboard v9
Renamed “TritonEd”
Courses supported: 2419
Students in TritonEd: 23,313
• Today
Blackboard v9
Courses supported: 3823
Students in TritonEd: 31,032
A History of TritonEd/Ted at UC San Diego
Pre-2006 2006 2010 2014 Today
Have you ever used TritonEd/Ted in the a course
you taught or supervised at UC San Diego?
Have you had at least one course at UC San Diego
in which the instructor used TritonEd/Ted?
Response: No
Number of Responses: 3
% of Total Responses: 0.14%
Response: Yes
Number of Responses: 2,072
% of Total Responses: 99.86%
Response: Yes
Number of Responses: 174
% of Total Responses: 84.06%
Response: No
Number of Responses: 33
% of Total Responses: 15.94%
How extensive is TritonEd’s reach?
Key Research Questions:
Understand current
Faculty and Student
experience around
TritonEd to gain
measurable and actionable
data to improve the LMS
experience.
Understand instructor and
student learning
technology needs beyond
the TritonEd LMS.
Identify KEY faculty and
student teaching and
learning needs to
determine if Blackboard
best meets the needs of
UC San Diego and to
inform feature and UI/UX
requirements for a UCSD
LMS RFP.
TritonEd Experience Analysis and Design Study
SURVEY RESULTS:
Who were our instructors?
Valid Faculty Responses
(Population 3086)
(5% Response Rate)
Survey Results: Who Were Our Instructors?
Instructor type:
Instructional Assistants
Number of Responses: 13
% of Total Responses: 7.39%
Instructor type: Others
Number of Responses: 13
% of Total Responses: 7.39%
Instructor type: Professor Series
Number of Responses: 41
% of Total Responses: 23.30%
Instructor type: Lecturer (U18)
Number of Responses: 69
% of Total Responses: 39.20%
Instructor type: Teaching Prof Series
Number of Responses: 40
% of Total Responses: 22.73%
Classification: Part time
Number of Responses: 86
% of Total Responses: 48.86%
Classification: Full time
Number of Responses: 90
% of Total Responses: 51.14%
Have you taught or supervised the teaching
of a course at UC San Diego in the past 2 years?
How many courses have you taught
in the last academic year?
Survey Results: Who Were Our Instructors?
Responses: No
Number of Responses: 24
% of Total Responses: 11.59%
Responses: Yes
Number of Responses: 183
% of Total Responses: 88.41%
Number of Courses: 4-6
Number of Responses: 41
% of Total Responses: 23.30%
Number of Courses: 7-10
Number of Responses: 12
% of Total Responses: 6.82%
Number of Courses: 16
Number of Responses: 1
% of Total Responses: 0.57%
Number of Courses: 16
Number of Responses: 1
% of Total Responses: 0.57%
Number of Courses: 1-3
Number of Responses: 121
% of Total Responses: 68.75%
Have you used TritonEd/Ted in the most recent
course you taught or supervised at UC San Diego?
Have you ever used TritonEd/Ted in the a course
you taught or supervised at UC San Diego?
Survey Results: Who Were Our Instructors?
Response: Yes
Number of Responses: 174
% of Total Responses: 84.06%
Response: No
Number of Responses: 33
% of Total Responses: 15.94%
Responses: No
Number of Responses: 38
% of Total Responses: 18.36%
Responses: Yes
Number of Responses: 169
% of Total Responses: 81.64%
Average Overall
TritonEd Satisfaction
by Instructor Type
(7-point scale)
Survey Results: Who Were Our Instructors?
Faculty with higher
self-perceived
high technology
skills are much
less satisfied
with TritonEd.
Those who
perceive their
students as
having higher
technology skills
are more satisfied
with TritonEd. Survey Results: Who Were Our Instructors?
Faculty with higher self-reported technology skill levels
spend more time on course-related activities
Most UC San Diego
faculty have not used
a technology outside
of the “Big 3” in their
teaching.
Survey Results: Who Were Our Instructors?
Have you used a technology other than TritonEd/Ted,
iClickers or Piazza in your teaching at UC San Diego?
Responses: Yes
Number of Responses: 64
% of Total Responses: 34.41%
Responses: No
Number of Responses: 122
% of Total Responses: 65.59%
SURVEY RESULTS:
Who were our students?
Valid Student Responses
(Population 26,222)
(7% Response Rate)
Student respondents were a good representation
of class year distribution at UC San Diego
Survey Results: Who Were Our Students?
Fifth +
Students tend to
have a higher
overall Satisfaction
with in-class
learning
experiences as
their Instructors’
perceived
technology skills
increase.
Survey Results: Who Were Our Students?
Activity Gap Score Mean SAT Mean IMP Valid Cases
Sharing my lecture notes or outlines with students 0.32 4.13 4.45 116
Sharing multimedia content with students 0.34 3.79 4.14 97
Sharing my PowerPoint presentations with students 0.36 4.23 4.60 125
Making TritonEd/Ted course available to students 0.38 4.22 4.60 150
Adding supplementary resources from textbook
publishes
0.51 3.56 4.07 73
Testing and reviewing content in TritonEd/Ted from
prior quarter
0.54 3.36 3.90 118
TritonEd works well for Instructors as a content repository
Survey Results: Positive Gap Score Stories
Activity Gap Score Mean SAT Mean IMP Valid Cases
Contacting an instructional technology support person 0.39 4.25 4.64 69
Getting timely updates on problem
resolution progress
0.42 4.13 4.55 62
Getting timely updates on a problem resolution
progress during a high-stakes period of reliance on
TritonEd/Ted
0.54 3.81 4.35 26
Getting timely resolution to a TritonEd/Ted or other
instructional technology problem
0.55 3.91 4.46 65
Instructors are generally pleased with support from ETS
Survey Results: Positive Gap Score Stories
THEME 1
Understanding course
performance using
TritonEd gradebook is
incredibly challenging
THEME 2
Unwieldy TritonEd
mobile experience is a
barrier to student
performance & planning
THEME 3
Faculty use of TritonEd
for more than
information broadcasting
causes student anxiety
and expense
Student Data: TritonEd Pain Themes
Activity Gap Score Mean SAT Mean IMP Valid Cases
Reviewing scores and instructor remarks
on assignments
1.06 3.53 4.58 1,376
Receiving grades in a timely manner 1.04 3.57 4.61 1,418
Reviewing my overall course performance 1.03 3.64 4.67 1,401
Viewing quiz or exam results 0.85 3.83 4.68 1,398
Reviewing my class participation performance 0.84 3.66 4.50 1,311
Reviewing progress and scores on
group assignments or projects
0.77 3.72 4.49 1,119
THEME 1:
Understanding course performance using
TritonEd gradebook is incredibly challenging
Professors did not seem to feel
the need to include feedback
comments on assignments even
though grading was subjective.
Grades would not be posted
until weeks later.
Professors in about a quarter of
my classes have never returned
grades or comments on any of
my papers, even after email
requests. There is no way to
improve on my writing skills if I
get absolutely no feedback
It's hard to gauge where you are
in class with just points and no
weighing system in place to
actually reflect the syllabus
grading.
Viewing results on
exams/quizzes are easy as long
as the TAs or the professors
submit the scores. I like how the
professor could provide us with
grading rubric so the students
can know where the grades are
coming from.
For one Chemistry lab course in
particular, it is impossible for me
to view my score on lab reports
done in pairs when my partner
is the one who submitted the
files through their TritonEd
account. This is caused by
instructors only accepting one
report per pair. In any case, I
always have to ask my partner
to show me how we did on the
report via their account since I
cannot view the score on my
own account.
I've seen instructors that use
GradeScope instead of Ted so
show scores on group
assignments.
The one thing not to use
Ted for is checking grades -
grades on Ted as seen by
students almost never
match the professor's view
It is hard and confusing to see
the scores and instructor
remarks on the assignments.
Sometimes, I don't even know if
there are scores and remarks on
the assignments.
Survey Results: What Students Said
THEME 2:
Unwieldy TritonEd mobile experience is a barrier to
student performance & planning
Activity Gap Score Mean SAT Mean IMP Valid Cases
Using my mobile device to access TritonEd/Ted 0.83 3.65 4.48 1,391
Understanding when and/or where the final exam will
occur
0.76 3.71 4.48 1,621
Identifying course activities and assignments to be done 0.73 3.84 4.57 1,722
Planning your time that you will spend on the course 0.51 3.18 3.69 1,436
TritonEd is easily accessible on
laptops but is not very mobile
device friendly. I can't open
documents that professors post on
TritonEd using my phone and I
can't easily check my grades using
TritonEd either.
Sometimes, some information is
cut-off when I'm using my mobile
devices (iPhone and iPad).
When looking at grades on a
mobile device (including
comments on essays submitted in
TurnItIn), the grades and
comments are cut off from the
screen and are not completely
viewable even when you try to
scroll down.
Loading up TED on the phone is
not terrible, but it just is not as
user-friendly. I have to keep
minimizing and maximizing the
web page in order to reach certain
buttons. It's almost like the page
was not designed for mobile
devices.
Sometimes, my mobile device
would not load the pdf files after I
had clicked on them multiple
times, even if I had WiFi. I also
wish it were a bit faster and easier
to navigate, and I can't access
some of the tools on my computer
such as "My grades" for all classes.
Syllabus that's in .doc form or .pdf
gets downloaded without being
able to see them in browser on
mobile.
Trying to view grades on TritonEd
mobile site is absolutely
horrendous. Thank goodness the
app works okay otherwise I'd be
limited to only being able to check
TritonEd when I'm using my laptop
The website is just so gross and
clunky.
Most materials on TritonEd is only
accessible for downloading on a
laptop. You cannot open those
files on your phone.
When you open TritonEd on
phone, you can't open documents
like articles or the syllabus that are
posted. For some articles, it
shows only the first page.
Survey Results: What Students Said
Survey Results: What Students Said
The date/times of the final exams
are never placed on TritonEd .
Instead, I must login to WebReg to
find out that part of the course.
TritonEd is annoying to navigate,
so instructors rely on e-mail to
communicate important messages
such as final exam information.
Almost every professor and/or TAs
have never used TED for posting
the final exam. Either they stay it
in class, their website, send out an
email, and/or use Webreg.
I think it will be better if there's
anything like calendar on the main
page that indicates when and
where the midterms or finals are.
It is inconvenient…when I have
multiple finals and have to click on
every course site to find out the
location. I want something I can
check those stuff at once.
TritonEd does not have a tab that
shows this information, although it
would be very helpful. It is up the
professor to make an
announcement on TritonEd to
update students on any changes in
exam location and time. However,
since there is no notification
system that alerts students
without signing on, some students
may miss the announcement.
This usually was not posted on
TritonEd. And if it was, it was hard
to find. I wish there was a way to
see important dates right after
logging in (maybe like a calendar)
Many professors put the date of
the midterm on one tiny spot on
the syllabus, and then post that
syllabus in some other folder - at
the very least let the syllabus be its
own tab. Preferably, important
information like this would be
written down in the
announcements, or somehow
pinned to be the first
announcement. I typically check
the exam date on Webreg since
Ted is not useful for checking the
exam date.
Always need to go to syllabus. And
when I go to syllabus, I have to
open it in a new tab. Too long for
info I need really fast.
THEME 3:
Instructor use of TritonEd for more than information
broadcasting causes student anxiety and expense
Activity Gap Score Mean SAT Mean IMP Valid Cases
Using online textbooks supplements
(WileyPLUS, Pearson MyLab, WebAssign, Redshelf)
0.64 3.41 4.05 1,053
Taking Exams 0.64 3.82 4.46 929
Setting up an account for online textbook supplements
(WileyPLUS, Pearson MyLab, WebAssign, Redshelf)
0.64 3.57 4.21 1,109
Taking Quizzes 0.62 3.88 4.50 1,220
WebAssign is complete bullshit. It
takes an additional hour to figure
out the way WebAssign wants us
to format the answer. Like you can
get an answer exactly right, but
WebAssign requires students to
format it a certain way. Figuring
that out on average takes another
hour.
The quizzes are hard to use
because sometimes your answer
won't get saved or depending on
browser size or type the
timer/overview covers questions
as you scroll.
Sometimes TritonEd quits
unexpectedly and does not save
my answers for the quizzes. it is
also difficult to review the quizzes
I've taken to see my score and
learn from the mistakes I made.
I have only had to deal with
RedShelf and the system they used
was bad. They automatically were
going to charge my class $100
each for the online textbook
unless we opted out online.
It is so expensive. considering that
there is no alternative we kinda
have to be forced to spend $120
to turn in homework. which sucks
when you’re poor and tuition is
already killing you.
Occasionally, when creating an
account, the website will tell me
that an account is already
registered with my email address
even though I would never have
created one. This is probably a
result of UCSD reusing school
email addresses for multiple
students.
TritonEd is useful for accessing
online textbook supplements (I've
used WebAssign for Math), and it
helps with preparing for exams
and quizzes because I can review
class materials and lectures.
Quiz interface is horrible. I cannot
go back when I put a wrong
answer as a mistake, and I have to
go all the way to the right when
the answer is on the left.
Triton Ed has never helped me
with anything related to online
material/homework. I don't think I
have ever witnessed anything
related to WebAssign, Wiley Plus.
In my three years I have never
taken an exam or a quiz on
TritonEd. I don't think you have
the faculty bought on it.
Survey Results: What Students Said
BONUS THEME:
Poor group features in TritonEd drive students to
outside services, causes communication challenges
Activity Gap Score Mean SAT Mean IMP Valid Cases
Resolving group conflicts 0.59 3.52 4.10 637
Conducting project work 0.56 3.57 4.13 746
Meeting with my project group online 0.56 3.47 4.03 690
Forming my project group 0.55 3.59 4.14 796
Producing project documents 0.54 3.60 4.14 733
Sharing my contact information with
other group members
0.54 3.64 4.18 796
Presenting group project work 0.52 3.66 4.18 704
In regards to group projects, I only
used Ted to contact my group
members initially. I would use Ted
to send out an email to all of my
group members to ask them to
give me their preferred method(s)
of contact. Then, my group and I
would use those preferred
method(s) of contact and Google
Suites to conduct work for the
remainder of the project.
Usually use other modes of
communication; Piazza, email,
Facebook.
Usually conducted group work on
google docs and would only use
Ted to submit the project.
If you think I'd actually use ted to
produce project documents you're
out of your freaking mind. I can
barely find my grades on ted and
turn things in. Stop trying to do a
million different things poorly, and
instead focus on doing a few
things really well.
Group assignments are such
terrifying prospects, not only does
it put you in a vulnerable position
but also requires you to work out
with each other the confusing time
slots where you can actually meet.
I would never consider using TED
over Google Drive for group work.
The tools are clunky and slow to
figure out.
I've had to do one group project
where the only place to form
groups was on TED. I was fucked
over and hung out to dry by
several potential groups. It's a
really shitty way to form groups
and easily leaves people out and is
so disconnected from everything.
All done through email or google
docs/sheets which are less
cumbersome, easier to use, and
are less likely to experience
problems/downtime.
It's not easy to do so and requires
manually finding the person's ucsd
email which isn't always checked
by the student.
It is not simple to do, trying to
figure out the medium of
communication and collect
information, often within the last
few minutes of a class. Some
people might be left out for a
week because contact information
was not recorded well or at all.
Survey Results: What Students Said
THEME 1
Managing gradebook
across the quarter is
unintuitive, cumbersome
and time-consuming
THEME 2
Poor user interface design
prevents effective grading
and feedback
THEME 3
TritonEd user interface
makes it difficult to set up
the basics of a course
Instructor Data: TritonEd Pain Themes
Activity Gap Score Mean SAT Mean IMP Valid Cases
Submitting grades to eGrades 1.46 3.23 4.70 103
Developing accurate grading schemas or scales 1.42 3.05 4.47 79
Entering grades in TritonEd/Ted gradebook 1.41 3.21 4.63 122
Editing grades in TritonEd/Ted 1.26 3.38 4.64 124
Displaying accurate grades to students 0.83 3.84 4.67 131
THEME 1:
Managing gradebook across the quarter is unintuitive,
cumbersome and time-consuming
THEME 1:
Managing gradebook across the quarter is
unintuitive, cumbersome and time-consuming
Activity Gap Score Mean SAT Mean IMP Valid Cases
Displaying accurate grades
to students 0.83 3.84 4.67 131
Reviewing my overall
course performance 1.03 3.64 4.67 1,401
Survey Results: Faculty vs. Students on Gradebook
I can't convey how terrible I think
the Blackboard gradebook
function is. It simply doesn't
navigate correctly. You can't
search on all assignments/grades
for a given student -- or if you do,
it doesn't display them correctly.
You can't manipulate grades in
there. I mean, it's a freaking simple
spreadsheet, and they can't even
design that well.
Entering individual grades is fine,
but trying to download the grade
book, edit, and then re-upload
seems to always lead to grades
getting rearranged.
I only tried displaying grades to
student one quarter. I found it a
bit confusing to track various types
of grades (e.g. points for
participation, grades for
assignments, etc.) and I went back
to keeping track in an Excel sheet.
For me the grade center is the
most important part of TritonEd
but it feels like it's 25 years old. It's
slow to respond even on a high
end computer, weird things
happen when students submitted
their homework more than once,
going to the next line is tedious.
still haven't figured out how to
create letter grades and export
them to eGrades, doing it
manually.
I should be able to upload to
eGrades readily, whereas I ended
up having to enter the eGrades
manually.
One bad thing about the TritonEd
gradebook is that it has as a
default a column displayed to the
students that keeps track of the
total point score over all
assignments/exams, which may
not correspond to how the total
grade will be calculated after
weighting, etc. So the students get
a mistaken impression of how they
are doing in the course.
I would rather just have a blank
spreadsheet where students can
see only the column headings and
their own row of data.
Biggest pain in the ass
Survey Results: What Instructors Said
Survey Results: What Instructors Said
What I see and what the students
see are not always the same. This
has been verified with them
sending screenshots and/or
showing me on their own
tablets/laptops.
Used TurnItIn to give feedback on
papers but students couldn't see
the comments I had entered in.
had to pdf the page and then
email it to them
I only tried displaying grades to
student one quarter. I found it a
bit confusing to track various types
of grades (e.g. points for
participation, grades for
assignments, etc.) and I went back
to keeping track in an Excel sheet.
I simply do not know if it's possible
to do the calculation in TritonEd. I
have been using excel and then
manually enter the final grades.
I manage all of my grade
assignments in excel because I
have more flexibility with
calculations.
The scrolling interface is
impossible. Finding a student in
particular is a daunting task of
filtering or lucky scrolling.
The TED "spreadsheet" is far too
limited to calculate grades the way
I need. I have to use an external
spreadsheet and upload the
grades. This is a lot of work, and
sometimes leads to mistakes.
The last time I tried this the
procedure didn't work at all.
eGrades refused to process the file
I downloaded from TritonED.
The total score column confuses
them. (I know I can remove it, I
just usually forget to.)
Tritoned seems to create its own
columns with total scores or
weighted scores that I DO NOT
want visible but make it impossible
to remove. And properly scaled
columns rarely calculate properly.
Downloading the files to do some
calculations and re-uploading is
annoying. having more ability to
manipulate the cells within
TritonEd would be helpful
Activity Gap Score Mean SAT Mean IMP Valid Cases
Grading group projects/work 1.11 3.23 4.34 43
Grading written assignments 1.07 3.48 4.55 86
Providing feedback on written assignments 0.99 3.53 4.53 79
Viewing student assignment submissions 0.97 3.74 4.71 102
THEME 2:
Poor user interface design prevents
effective grading and feedback
As with entering grades, viewing
student submissions requires
drilling down through too many
menus. To make matters worse,
Ted makes me repeat this process
for each student.
There isn't an obvious place to go
to see submissions and then
sometimes they show up strange if
they didn't follow directions about
file formats.
The TurnItIn feedback function is a
good idea that looks and works
like it was executed by 2nd year CS
majors. In a hurry. They earn a B-
...good idea, executed badly.
Available tools for providing
feedback on written assignments
is greatly impoverished compared
to what is afforded by using pen
and paper.
If it even has capacities to grade
code, it's definitely not worth the
6000 button clicks to find these
tools. My approach is always to
use TritonED for the bare
minimum, get assignments out of
there, and grade with real, helpful
tools.
I haven't yet had students submit
assignments online. I suppose that
would save paper and avoid
possibility of lost hardcopy
assignments, but I haven't done so
because it is so hard on the human
eye to grade scanned paper
assignments.”
Can't write comments for the
students -- see GradeScope, which
does this pretty well.
TurnItIn is an important tool, and
in some ways it's good, and in
some ways it's badly designed. It
loses progress and you can't tell
what students can see. Clunky.
We use Gradescope so that we can
provide written comments to
students. TED is very restrictive in
submission and feedback.
Survey Results: What Instructors Said
Survey Results: What Instructors Said
Problems arise from columns not
being visible (left-right scrolling
ability seems to rarely show up).
Except for auto-graded quizzes,
why would you use TritonED? It's
bloated, slow, and annoying. I
grade using Gradescope.
I have not done anything more
than the quizzes. When I used
TritionEd for grading online
submissions it took my TAs triple
the time to grade.
Hard to download code, no code
comparison possible but should be
done automatically.
I don't know how to [grade
multimedia assignments] on
TritonEd, and I am pretty well
versed in the system. There
doesn't appear to be an intuitive
method for student submission or
grading of multimedia assignments
Clicking on 'View Attempt' fails to
load a significant amount of time.
Getting to students actual
submissions is super clunky and
opaque.
The grading especially for Tas of
the large courses is a bit difficult in
terms of moving quickly between
and amongst students' exams.
TurnItIn does not allow for group
grading of projects. Creates a ton
of work to have to manual figure
this out and messes up the whole
grade center b/c you have
columns that work for some
people (the person who submitted
the project) and not others
(anyone else in their group).
Activity Gap Score Mean SAT Mean IMP Valid Cases
Conducting quizzes 1.03 3.26 4.29 68
Setting up quizzes 0.92 3.13 4.06 75
Conducting exams 0.86 3.26 4.11 39
Selecting/activating features, setting
or tools in TritonEd/Ted
0.79 3.24 4.03 149
Organizing the structure of my TritonEd/Ted course 0.68 3.49 4.17 138
THEME 3:
TritonEd user interface makes it
difficult to set up the basics of a course
I have not been able to conduct
quizzes on TritonEd to a
satisfactory level so I have stopped
trying.
I might like to conduct exams if
there were built-in electronic
features to reduce cheating -- and
if it were possible to import a
Word file into the quiz function so
it wasn't so damned tedious to set
up a quiz. Just getting the
formatting to be uniform is a
challenge. Hard to make sure all the settings
that I want are activated
I've been told not to do [use the
TritonEd exam feature] because
the WiFi infrastructure at UCSD
can not handle it. I did try it last
quarter, and had students not
come to the lecture hall to
complete it, but this led to other
problems like cheating.
It is so complex, it needs to be
streamlined.
Clunky, slow, unintuitive. Did I say
slow? So slow. Ponderous. Circa
1990 user interface design.
Quizzes are a pain to set up and
hard to debug in Blackboard. Too
many features, opaque
descriptions of the settings, no
sandbox for testing, and no
confirmation of settings. Also,
hard to copy paste from one to the
other.
[Quiz builder] crashes, unclear
instructions, cumbersome to work
with. The [question item] pool
feature is unclear.
I find it hard to decide how to
organize files into folders and to
organize the folders in a way that
is obvious to the student where
they can find things.
I like TritonEd overall and it lets
me do what I need to do, but I
don't find it very intuitive.
Survey Results: What Instructors Said
As a piece of software, my
perspective on Blackboard (as a
student and TA) is that while it
does, in fact, have some useful
features, it's also bloated, clunky,
frustrating, and something that I
would burn in effigy for cathartic
release, given a physical
representation and the
opportunity to do so.
I am not computer-savvy, and I
used TritonEd for the first time this
winter, only to take advantage of
Turnitin.com. I found setting THAT
up absolutely baffling and found
the entire website
incomprehensible.
TritonEd/TED requires such a long
unintuitive learning curve. It does
not facilitate any reasonable
discussion platform (for that we go
to Piazza) and the only reason I
use TritonEd is so that my TAs can
upload content and it manages
grades moderately well.
Setting up quizzes with flexible
grading options on TritonEd is
painful and not usually successful.
Not useful as a training tool for
students.
In the past quarter, TritonED has
made it very difficult to move
content from an old course site to
the new one--even if the class is
the same. This meant that I had to
manually upload all of the old files-
-a process that took nearly 3
hours--instead of simply cloning
the old course. If this cloning
feature is still available, it needs to
be marked much more clearly. If it
is not, it needs to come back.
After so many years, the
Blackboard based system should
be easier to use. I have started
using some advanced features that
I like, but they are really difficult to
figure out, and the navigation has
to be re-learned every year.
I have my own class website that
works a lot better/needs my needs
a lot better than TritonEd.
The buttons and contents were
hidden. It took me about 15
minutes in search of the
functionality I needed to change
the front page of TritonEd.
IDEATION: Student Stakeholders
IDEATION: Faculty Stakeholders
IDEATION: Teaching Assistant Stakeholders
IDEATION: IT Services Stakeholders
1. Make the Best of What's Around
• Quick Wins with Blackboard
• Create Faculty-Developed Simplified Course Structure Template
• Embrace tools currently used by faculty through enterprise adoption & integration
2. Promote Next Practices
• Develop a student technology fee to fund technology improvements campus-wide, including
wi-fi
• Collaborate with the T&LC to promote a Community of Practice around Teaching with
Technology Next Practices
• Work with TLC to promote adoption and improve utilization of already-available campus
collaboration tools such as Google Apps and/or Office 365
• Implement a student-led technology advisory group
3. Explore New Technology Paths
• Adopt an LMS with a more modern user interface/user experience
• Support for and integration of a wide variety of faculty-selected technologies (NGDLE)
• UCSD-developed app that provides a unified calendar and simplified grade book for students
RefinedSolutionsPortfolio
0 1 2 3 4 5 6 7 8
Quick Wins with Blackboard
Create Faculty-Developed Simplified Course Structure Template
Embrace tools currently used by faculty through enterprise
adoption & integration
Develop a student technology fee to fund technology
improvements campus-wide, including wi-fi
Collaborate with the T&LC to promote a Community of Practice
around Teaching with Technology Next Practices
Work with TLC to promote adoption and improve utilization of
already-available campus collaboration tools such as Google…
Implement a student-led technology advisory group
Adopt an LMS with a more modern user interface/user experience
Support for and integration of a wide variety of faculty-selected
technologies (NGDLE)
UCSD-developed app that provides a unified calendar and
simplified grade book for students
No. of Pain Themes Addressed by Solution

Más contenido relacionado

La actualidad más candente

Enhancing student learning through
Enhancing student learning throughEnhancing student learning through
Enhancing student learning throughIJITE
 
Using GradeMark to improve feedback and engage students in the marking process
Using GradeMark to improve feedback and engage students in the marking processUsing GradeMark to improve feedback and engage students in the marking process
Using GradeMark to improve feedback and engage students in the marking processSara Marsham
 
Educational Research
Educational ResearchEducational Research
Educational ResearchSara Marsham
 
TESTA Interactive Masterclass
TESTA Interactive MasterclassTESTA Interactive Masterclass
TESTA Interactive MasterclassTansy Jessop
 
Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...
Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...
Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...Blackboard APAC
 
Student Usability Study of BlueQuill LMS
Student Usability Study of BlueQuill LMSStudent Usability Study of BlueQuill LMS
Student Usability Study of BlueQuill LMSTawana Washington
 
English Proficiency Test
English Proficiency TestEnglish Proficiency Test
English Proficiency TestRoselle Reonal
 
Digital Teaching Platform: Multi-Year Usage
Digital Teaching Platform: Multi-Year UsageDigital Teaching Platform: Multi-Year Usage
Digital Teaching Platform: Multi-Year Usagetameca17
 
Using effective pedagogical strategies
Using effective pedagogical strategiesUsing effective pedagogical strategies
Using effective pedagogical strategiesCOHERE2012
 
Facilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshopFacilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshopSara Marsham
 
Evaluation #3 for Eldon Ray
Evaluation #3 for Eldon RayEvaluation #3 for Eldon Ray
Evaluation #3 for Eldon RayEldon Ray
 
MLCS Syllabus SP14 Almy
MLCS Syllabus SP14 AlmyMLCS Syllabus SP14 Almy
MLCS Syllabus SP14 Almykathleenalmy
 
22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...Bart Rienties
 
Low stakes testing in the mathematics classroom
Low stakes testing in the mathematics classroomLow stakes testing in the mathematics classroom
Low stakes testing in the mathematics classroomColleen Young
 
How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?RichardM_Walker
 

La actualidad más candente (19)

Enhancing student learning through
Enhancing student learning throughEnhancing student learning through
Enhancing student learning through
 
Using GradeMark to improve feedback and engage students in the marking process
Using GradeMark to improve feedback and engage students in the marking processUsing GradeMark to improve feedback and engage students in the marking process
Using GradeMark to improve feedback and engage students in the marking process
 
Educational Research
Educational ResearchEducational Research
Educational Research
 
TESTA Interactive Masterclass
TESTA Interactive MasterclassTESTA Interactive Masterclass
TESTA Interactive Masterclass
 
New Horizons VCCS 2012
New Horizons VCCS 2012 New Horizons VCCS 2012
New Horizons VCCS 2012
 
Syllabus
SyllabusSyllabus
Syllabus
 
WI16-TCSS390A-Eval
WI16-TCSS390A-EvalWI16-TCSS390A-Eval
WI16-TCSS390A-Eval
 
Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...
Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...
Blackboard not Blackbored: Engaging and enabling students in the Tertiary Ena...
 
Active Learning in the Flipped Classroom
Active Learning in the Flipped ClassroomActive Learning in the Flipped Classroom
Active Learning in the Flipped Classroom
 
Student Usability Study of BlueQuill LMS
Student Usability Study of BlueQuill LMSStudent Usability Study of BlueQuill LMS
Student Usability Study of BlueQuill LMS
 
English Proficiency Test
English Proficiency TestEnglish Proficiency Test
English Proficiency Test
 
Digital Teaching Platform: Multi-Year Usage
Digital Teaching Platform: Multi-Year UsageDigital Teaching Platform: Multi-Year Usage
Digital Teaching Platform: Multi-Year Usage
 
Using effective pedagogical strategies
Using effective pedagogical strategiesUsing effective pedagogical strategies
Using effective pedagogical strategies
 
Facilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshopFacilitating a feedback loop through GradeMark and TurningPoint: A workshop
Facilitating a feedback loop through GradeMark and TurningPoint: A workshop
 
Evaluation #3 for Eldon Ray
Evaluation #3 for Eldon RayEvaluation #3 for Eldon Ray
Evaluation #3 for Eldon Ray
 
MLCS Syllabus SP14 Almy
MLCS Syllabus SP14 AlmyMLCS Syllabus SP14 Almy
MLCS Syllabus SP14 Almy
 
22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...
 
Low stakes testing in the mathematics classroom
Low stakes testing in the mathematics classroomLow stakes testing in the mathematics classroom
Low stakes testing in the mathematics classroom
 
How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?How are students engaging with lecture recordings as a study resource?
How are students engaging with lecture recordings as a study resource?
 

Similar a UCSD TritonEd Experience Analysis & Design Results

Using Analytics to Increase Student Success
Using Analytics to Increase Student SuccessUsing Analytics to Increase Student Success
Using Analytics to Increase Student SuccessDavid Lindrum
 
2011Using Data Analytics
2011Using Data Analytics2011Using Data Analytics
2011Using Data AnalyticsWCET
 
Using GradeMark to engage students in the feedback process
Using GradeMark to engage students in the feedback processUsing GradeMark to engage students in the feedback process
Using GradeMark to engage students in the feedback processSara Marsham
 
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...Blackboard APAC
 
Do i really want to know
Do i really want to knowDo i really want to know
Do i really want to knowIda Jones
 
Why a programme view? Why TESTA?
Why a programme view? Why TESTA?Why a programme view? Why TESTA?
Why a programme view? Why TESTA?Tansy Jessop
 
Presentations morning session 22 January 2018 HEFCE open event “Using data to...
Presentations morning session 22 January 2018 HEFCE open event “Using data to...Presentations morning session 22 January 2018 HEFCE open event “Using data to...
Presentations morning session 22 January 2018 HEFCE open event “Using data to...Bart Rienties
 
Using Classroom Response Systems to Engage your Students
Using Classroom Response Systems to Engage your StudentsUsing Classroom Response Systems to Engage your Students
Using Classroom Response Systems to Engage your Studentssdalili
 
PGNA 2014: District Results
PGNA 2014: District ResultsPGNA 2014: District Results
PGNA 2014: District ResultsLaura Jacob
 
Learner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended CourseLearner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended CourseLakeland Community College
 
Classroom diagnostic tools training 9.23.14
Classroom diagnostic tools training 9.23.14Classroom diagnostic tools training 9.23.14
Classroom diagnostic tools training 9.23.14nickpaolini81
 
Online roadkill
Online roadkillOnline roadkill
Online roadkillbbridges51
 
Portland Terman Conference Laumakis April 2009
Portland Terman Conference   Laumakis April 2009Portland Terman Conference   Laumakis April 2009
Portland Terman Conference Laumakis April 2009Mark Laumakis
 
Required Online Orientation: A Predictor of Success?
Required Online Orientation:  A Predictor of Success?Required Online Orientation:  A Predictor of Success?
Required Online Orientation: A Predictor of Success?ldefelice
 
Describing when and how feedback on my learners' performances will be given
Describing when and how feedback on my learners' performances will be givenDescribing when and how feedback on my learners' performances will be given
Describing when and how feedback on my learners' performances will be givenLianisDiaz
 
Tel survey, carmarthen lampeter (final)
Tel survey, carmarthen lampeter (final)Tel survey, carmarthen lampeter (final)
Tel survey, carmarthen lampeter (final)Tony Toole
 
2010 Exploring online faculty workload
2010 Exploring online faculty workload2010 Exploring online faculty workload
2010 Exploring online faculty workloadWCET
 
2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...
2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...
2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...eMadrid network
 
Techlogic presentation walker
Techlogic presentation walkerTechlogic presentation walker
Techlogic presentation walkerEMC-DE
 
Online Coursework: Making It Count - Lore Carvajal
Online Coursework: Making It Count - Lore CarvajalOnline Coursework: Making It Count - Lore Carvajal
Online Coursework: Making It Count - Lore Carvajalmhhighered
 

Similar a UCSD TritonEd Experience Analysis & Design Results (20)

Using Analytics to Increase Student Success
Using Analytics to Increase Student SuccessUsing Analytics to Increase Student Success
Using Analytics to Increase Student Success
 
2011Using Data Analytics
2011Using Data Analytics2011Using Data Analytics
2011Using Data Analytics
 
Using GradeMark to engage students in the feedback process
Using GradeMark to engage students in the feedback processUsing GradeMark to engage students in the feedback process
Using GradeMark to engage students in the feedback process
 
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
Online Tests: Can we do them better? | Bopelo Boitshwarelo, Jyoti Vemuri, Han...
 
Do i really want to know
Do i really want to knowDo i really want to know
Do i really want to know
 
Why a programme view? Why TESTA?
Why a programme view? Why TESTA?Why a programme view? Why TESTA?
Why a programme view? Why TESTA?
 
Presentations morning session 22 January 2018 HEFCE open event “Using data to...
Presentations morning session 22 January 2018 HEFCE open event “Using data to...Presentations morning session 22 January 2018 HEFCE open event “Using data to...
Presentations morning session 22 January 2018 HEFCE open event “Using data to...
 
Using Classroom Response Systems to Engage your Students
Using Classroom Response Systems to Engage your StudentsUsing Classroom Response Systems to Engage your Students
Using Classroom Response Systems to Engage your Students
 
PGNA 2014: District Results
PGNA 2014: District ResultsPGNA 2014: District Results
PGNA 2014: District Results
 
Learner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended CourseLearner Engagement, QM Standards and the Blended Course
Learner Engagement, QM Standards and the Blended Course
 
Classroom diagnostic tools training 9.23.14
Classroom diagnostic tools training 9.23.14Classroom diagnostic tools training 9.23.14
Classroom diagnostic tools training 9.23.14
 
Online roadkill
Online roadkillOnline roadkill
Online roadkill
 
Portland Terman Conference Laumakis April 2009
Portland Terman Conference   Laumakis April 2009Portland Terman Conference   Laumakis April 2009
Portland Terman Conference Laumakis April 2009
 
Required Online Orientation: A Predictor of Success?
Required Online Orientation:  A Predictor of Success?Required Online Orientation:  A Predictor of Success?
Required Online Orientation: A Predictor of Success?
 
Describing when and how feedback on my learners' performances will be given
Describing when and how feedback on my learners' performances will be givenDescribing when and how feedback on my learners' performances will be given
Describing when and how feedback on my learners' performances will be given
 
Tel survey, carmarthen lampeter (final)
Tel survey, carmarthen lampeter (final)Tel survey, carmarthen lampeter (final)
Tel survey, carmarthen lampeter (final)
 
2010 Exploring online faculty workload
2010 Exploring online faculty workload2010 Exploring online faculty workload
2010 Exploring online faculty workload
 
2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...
2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...
2020_09_24 «How Learning Analytics Can Inform E-Learning in the New Normal» -...
 
Techlogic presentation walker
Techlogic presentation walkerTechlogic presentation walker
Techlogic presentation walker
 
Online Coursework: Making It Count - Lore Carvajal
Online Coursework: Making It Count - Lore CarvajalOnline Coursework: Making It Count - Lore Carvajal
Online Coursework: Making It Count - Lore Carvajal
 

Más de Christopher Rice

Strategic Foresight and Post-Covid-19 Futures
Strategic Foresight and Post-Covid-19 FuturesStrategic Foresight and Post-Covid-19 Futures
Strategic Foresight and Post-Covid-19 FuturesChristopher Rice
 
Transforming the Workshop with and through Design Thinking
Transforming the Workshop with and through Design ThinkingTransforming the Workshop with and through Design Thinking
Transforming the Workshop with and through Design ThinkingChristopher Rice
 
Blackboard EAD Presentation (Educause 2011)
Blackboard EAD Presentation (Educause 2011)Blackboard EAD Presentation (Educause 2011)
Blackboard EAD Presentation (Educause 2011)Christopher Rice
 
Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...
Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...
Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...Christopher Rice
 
CiTE 2012 OpenClass Teaching & Design Partner Experience
CiTE 2012 OpenClass Teaching & Design Partner ExperienceCiTE 2012 OpenClass Teaching & Design Partner Experience
CiTE 2012 OpenClass Teaching & Design Partner ExperienceChristopher Rice
 
Teaching and Technology Overview (Pakistan 2015)
Teaching and Technology Overview (Pakistan 2015)Teaching and Technology Overview (Pakistan 2015)
Teaching and Technology Overview (Pakistan 2015)Christopher Rice
 
Hybrid Course Design (I+DL 2015)
Hybrid Course Design (I+DL 2015)Hybrid Course Design (I+DL 2015)
Hybrid Course Design (I+DL 2015)Christopher Rice
 
ARS Teaching Tips (i+dl 2015)
ARS Teaching Tips (i+dl 2015)ARS Teaching Tips (i+dl 2015)
ARS Teaching Tips (i+dl 2015)Christopher Rice
 
PS 240 Environmentalism(s) Spring 2015
PS 240 Environmentalism(s) Spring 2015PS 240 Environmentalism(s) Spring 2015
PS 240 Environmentalism(s) Spring 2015Christopher Rice
 
PS 240 Marxism Spring 2015
PS 240 Marxism Spring 2015PS 240 Marxism Spring 2015
PS 240 Marxism Spring 2015Christopher Rice
 
PS 240 Liberalism Spring 2015
PS 240 Liberalism Spring 2015PS 240 Liberalism Spring 2015
PS 240 Liberalism Spring 2015Christopher Rice
 
PS 240 Thinking Politically Spring 2015
PS 240 Thinking Politically Spring 2015PS 240 Thinking Politically Spring 2015
PS 240 Thinking Politically Spring 2015Christopher Rice
 
PS 240 Environmentalism Fall 2014
PS 240 Environmentalism Fall 2014PS 240 Environmentalism Fall 2014
PS 240 Environmentalism Fall 2014Christopher Rice
 
PS 240 Anarchism Fall 2014 (online)
PS 240 Anarchism Fall 2014 (online)PS 240 Anarchism Fall 2014 (online)
PS 240 Anarchism Fall 2014 (online)Christopher Rice
 
PS 240 Marxism Fall 2014 (online)
PS 240 Marxism Fall 2014 (online)PS 240 Marxism Fall 2014 (online)
PS 240 Marxism Fall 2014 (online)Christopher Rice
 
PS 240 Conservatism Fall 2014
PS 240 Conservatism Fall 2014PS 240 Conservatism Fall 2014
PS 240 Conservatism Fall 2014Christopher Rice
 
PS 240 Liberalism Fall 2014
PS 240 Liberalism Fall 2014PS 240 Liberalism Fall 2014
PS 240 Liberalism Fall 2014Christopher Rice
 
PS 240 Thinking Politically Fall 2014
PS 240 Thinking Politically Fall 2014PS 240 Thinking Politically Fall 2014
PS 240 Thinking Politically Fall 2014Christopher Rice
 
Advanced Social Media Techniques CBMI 2014
Advanced Social Media Techniques CBMI 2014Advanced Social Media Techniques CBMI 2014
Advanced Social Media Techniques CBMI 2014Christopher Rice
 

Más de Christopher Rice (20)

Strategic Foresight and Post-Covid-19 Futures
Strategic Foresight and Post-Covid-19 FuturesStrategic Foresight and Post-Covid-19 Futures
Strategic Foresight and Post-Covid-19 Futures
 
Transforming the Workshop with and through Design Thinking
Transforming the Workshop with and through Design ThinkingTransforming the Workshop with and through Design Thinking
Transforming the Workshop with and through Design Thinking
 
Blackboard EAD Presentation (Educause 2011)
Blackboard EAD Presentation (Educause 2011)Blackboard EAD Presentation (Educause 2011)
Blackboard EAD Presentation (Educause 2011)
 
Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...
Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...
Using the Business Model Canvas and Gamestorming for Hybrid and Online Course...
 
CiTE 2012 OpenClass Teaching & Design Partner Experience
CiTE 2012 OpenClass Teaching & Design Partner ExperienceCiTE 2012 OpenClass Teaching & Design Partner Experience
CiTE 2012 OpenClass Teaching & Design Partner Experience
 
Teaching and Technology Overview (Pakistan 2015)
Teaching and Technology Overview (Pakistan 2015)Teaching and Technology Overview (Pakistan 2015)
Teaching and Technology Overview (Pakistan 2015)
 
Hybrid Course Design (I+DL 2015)
Hybrid Course Design (I+DL 2015)Hybrid Course Design (I+DL 2015)
Hybrid Course Design (I+DL 2015)
 
ARS Teaching Tips (i+dl 2015)
ARS Teaching Tips (i+dl 2015)ARS Teaching Tips (i+dl 2015)
ARS Teaching Tips (i+dl 2015)
 
PS 240 Environmentalism(s) Spring 2015
PS 240 Environmentalism(s) Spring 2015PS 240 Environmentalism(s) Spring 2015
PS 240 Environmentalism(s) Spring 2015
 
PS 240 Marxism Spring 2015
PS 240 Marxism Spring 2015PS 240 Marxism Spring 2015
PS 240 Marxism Spring 2015
 
PS 240 Liberalism Spring 2015
PS 240 Liberalism Spring 2015PS 240 Liberalism Spring 2015
PS 240 Liberalism Spring 2015
 
PS 240 Thinking Politically Spring 2015
PS 240 Thinking Politically Spring 2015PS 240 Thinking Politically Spring 2015
PS 240 Thinking Politically Spring 2015
 
PS 240 Environmentalism Fall 2014
PS 240 Environmentalism Fall 2014PS 240 Environmentalism Fall 2014
PS 240 Environmentalism Fall 2014
 
PS 240 Fascism Fall 2014
PS 240 Fascism Fall 2014PS 240 Fascism Fall 2014
PS 240 Fascism Fall 2014
 
PS 240 Anarchism Fall 2014 (online)
PS 240 Anarchism Fall 2014 (online)PS 240 Anarchism Fall 2014 (online)
PS 240 Anarchism Fall 2014 (online)
 
PS 240 Marxism Fall 2014 (online)
PS 240 Marxism Fall 2014 (online)PS 240 Marxism Fall 2014 (online)
PS 240 Marxism Fall 2014 (online)
 
PS 240 Conservatism Fall 2014
PS 240 Conservatism Fall 2014PS 240 Conservatism Fall 2014
PS 240 Conservatism Fall 2014
 
PS 240 Liberalism Fall 2014
PS 240 Liberalism Fall 2014PS 240 Liberalism Fall 2014
PS 240 Liberalism Fall 2014
 
PS 240 Thinking Politically Fall 2014
PS 240 Thinking Politically Fall 2014PS 240 Thinking Politically Fall 2014
PS 240 Thinking Politically Fall 2014
 
Advanced Social Media Techniques CBMI 2014
Advanced Social Media Techniques CBMI 2014Advanced Social Media Techniques CBMI 2014
Advanced Social Media Techniques CBMI 2014
 

Último

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterMateoGardella
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.pptRamjanShidvankar
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...KokoStevan
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 

Último (20)

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 

UCSD TritonEd Experience Analysis & Design Results

  • 1. Understanding the Faculty and Student TritonEd Experience Using Experience Analysis and Design Methodology
  • 2. UC San Diego uses WebCT LMS Courses supported: 756 Blackboard buys WebCT UC San Diego migrates to Blackboard v7 Named “TED” Courses supported: 962 Blackboard v8 Courses supported: 1316 • 2014 Blackboard v9 Renamed “TritonEd” Courses supported: 2419 Students in TritonEd: 23,313 • Today Blackboard v9 Courses supported: 3823 Students in TritonEd: 31,032 A History of TritonEd/Ted at UC San Diego Pre-2006 2006 2010 2014 Today
  • 3. Have you ever used TritonEd/Ted in the a course you taught or supervised at UC San Diego? Have you had at least one course at UC San Diego in which the instructor used TritonEd/Ted? Response: No Number of Responses: 3 % of Total Responses: 0.14% Response: Yes Number of Responses: 2,072 % of Total Responses: 99.86% Response: Yes Number of Responses: 174 % of Total Responses: 84.06% Response: No Number of Responses: 33 % of Total Responses: 15.94% How extensive is TritonEd’s reach?
  • 4. Key Research Questions: Understand current Faculty and Student experience around TritonEd to gain measurable and actionable data to improve the LMS experience. Understand instructor and student learning technology needs beyond the TritonEd LMS. Identify KEY faculty and student teaching and learning needs to determine if Blackboard best meets the needs of UC San Diego and to inform feature and UI/UX requirements for a UCSD LMS RFP. TritonEd Experience Analysis and Design Study
  • 5. SURVEY RESULTS: Who were our instructors?
  • 6. Valid Faculty Responses (Population 3086) (5% Response Rate)
  • 7. Survey Results: Who Were Our Instructors? Instructor type: Instructional Assistants Number of Responses: 13 % of Total Responses: 7.39% Instructor type: Others Number of Responses: 13 % of Total Responses: 7.39% Instructor type: Professor Series Number of Responses: 41 % of Total Responses: 23.30% Instructor type: Lecturer (U18) Number of Responses: 69 % of Total Responses: 39.20% Instructor type: Teaching Prof Series Number of Responses: 40 % of Total Responses: 22.73% Classification: Part time Number of Responses: 86 % of Total Responses: 48.86% Classification: Full time Number of Responses: 90 % of Total Responses: 51.14%
  • 8. Have you taught or supervised the teaching of a course at UC San Diego in the past 2 years? How many courses have you taught in the last academic year? Survey Results: Who Were Our Instructors? Responses: No Number of Responses: 24 % of Total Responses: 11.59% Responses: Yes Number of Responses: 183 % of Total Responses: 88.41% Number of Courses: 4-6 Number of Responses: 41 % of Total Responses: 23.30% Number of Courses: 7-10 Number of Responses: 12 % of Total Responses: 6.82% Number of Courses: 16 Number of Responses: 1 % of Total Responses: 0.57% Number of Courses: 16 Number of Responses: 1 % of Total Responses: 0.57% Number of Courses: 1-3 Number of Responses: 121 % of Total Responses: 68.75%
  • 9. Have you used TritonEd/Ted in the most recent course you taught or supervised at UC San Diego? Have you ever used TritonEd/Ted in the a course you taught or supervised at UC San Diego? Survey Results: Who Were Our Instructors? Response: Yes Number of Responses: 174 % of Total Responses: 84.06% Response: No Number of Responses: 33 % of Total Responses: 15.94% Responses: No Number of Responses: 38 % of Total Responses: 18.36% Responses: Yes Number of Responses: 169 % of Total Responses: 81.64%
  • 10. Average Overall TritonEd Satisfaction by Instructor Type (7-point scale) Survey Results: Who Were Our Instructors?
  • 11. Faculty with higher self-perceived high technology skills are much less satisfied with TritonEd. Those who perceive their students as having higher technology skills are more satisfied with TritonEd. Survey Results: Who Were Our Instructors?
  • 12. Faculty with higher self-reported technology skill levels spend more time on course-related activities
  • 13. Most UC San Diego faculty have not used a technology outside of the “Big 3” in their teaching. Survey Results: Who Were Our Instructors? Have you used a technology other than TritonEd/Ted, iClickers or Piazza in your teaching at UC San Diego? Responses: Yes Number of Responses: 64 % of Total Responses: 34.41% Responses: No Number of Responses: 122 % of Total Responses: 65.59%
  • 14. SURVEY RESULTS: Who were our students?
  • 15. Valid Student Responses (Population 26,222) (7% Response Rate)
  • 16. Student respondents were a good representation of class year distribution at UC San Diego Survey Results: Who Were Our Students? Fifth +
  • 17. Students tend to have a higher overall Satisfaction with in-class learning experiences as their Instructors’ perceived technology skills increase. Survey Results: Who Were Our Students?
  • 18. Activity Gap Score Mean SAT Mean IMP Valid Cases Sharing my lecture notes or outlines with students 0.32 4.13 4.45 116 Sharing multimedia content with students 0.34 3.79 4.14 97 Sharing my PowerPoint presentations with students 0.36 4.23 4.60 125 Making TritonEd/Ted course available to students 0.38 4.22 4.60 150 Adding supplementary resources from textbook publishes 0.51 3.56 4.07 73 Testing and reviewing content in TritonEd/Ted from prior quarter 0.54 3.36 3.90 118 TritonEd works well for Instructors as a content repository Survey Results: Positive Gap Score Stories
  • 19. Activity Gap Score Mean SAT Mean IMP Valid Cases Contacting an instructional technology support person 0.39 4.25 4.64 69 Getting timely updates on problem resolution progress 0.42 4.13 4.55 62 Getting timely updates on a problem resolution progress during a high-stakes period of reliance on TritonEd/Ted 0.54 3.81 4.35 26 Getting timely resolution to a TritonEd/Ted or other instructional technology problem 0.55 3.91 4.46 65 Instructors are generally pleased with support from ETS Survey Results: Positive Gap Score Stories
  • 20. THEME 1 Understanding course performance using TritonEd gradebook is incredibly challenging THEME 2 Unwieldy TritonEd mobile experience is a barrier to student performance & planning THEME 3 Faculty use of TritonEd for more than information broadcasting causes student anxiety and expense Student Data: TritonEd Pain Themes
  • 21. Activity Gap Score Mean SAT Mean IMP Valid Cases Reviewing scores and instructor remarks on assignments 1.06 3.53 4.58 1,376 Receiving grades in a timely manner 1.04 3.57 4.61 1,418 Reviewing my overall course performance 1.03 3.64 4.67 1,401 Viewing quiz or exam results 0.85 3.83 4.68 1,398 Reviewing my class participation performance 0.84 3.66 4.50 1,311 Reviewing progress and scores on group assignments or projects 0.77 3.72 4.49 1,119 THEME 1: Understanding course performance using TritonEd gradebook is incredibly challenging
  • 22. Professors did not seem to feel the need to include feedback comments on assignments even though grading was subjective. Grades would not be posted until weeks later. Professors in about a quarter of my classes have never returned grades or comments on any of my papers, even after email requests. There is no way to improve on my writing skills if I get absolutely no feedback It's hard to gauge where you are in class with just points and no weighing system in place to actually reflect the syllabus grading. Viewing results on exams/quizzes are easy as long as the TAs or the professors submit the scores. I like how the professor could provide us with grading rubric so the students can know where the grades are coming from. For one Chemistry lab course in particular, it is impossible for me to view my score on lab reports done in pairs when my partner is the one who submitted the files through their TritonEd account. This is caused by instructors only accepting one report per pair. In any case, I always have to ask my partner to show me how we did on the report via their account since I cannot view the score on my own account. I've seen instructors that use GradeScope instead of Ted so show scores on group assignments. The one thing not to use Ted for is checking grades - grades on Ted as seen by students almost never match the professor's view It is hard and confusing to see the scores and instructor remarks on the assignments. Sometimes, I don't even know if there are scores and remarks on the assignments. Survey Results: What Students Said
  • 23. THEME 2: Unwieldy TritonEd mobile experience is a barrier to student performance & planning Activity Gap Score Mean SAT Mean IMP Valid Cases Using my mobile device to access TritonEd/Ted 0.83 3.65 4.48 1,391 Understanding when and/or where the final exam will occur 0.76 3.71 4.48 1,621 Identifying course activities and assignments to be done 0.73 3.84 4.57 1,722 Planning your time that you will spend on the course 0.51 3.18 3.69 1,436
  • 24. TritonEd is easily accessible on laptops but is not very mobile device friendly. I can't open documents that professors post on TritonEd using my phone and I can't easily check my grades using TritonEd either. Sometimes, some information is cut-off when I'm using my mobile devices (iPhone and iPad). When looking at grades on a mobile device (including comments on essays submitted in TurnItIn), the grades and comments are cut off from the screen and are not completely viewable even when you try to scroll down. Loading up TED on the phone is not terrible, but it just is not as user-friendly. I have to keep minimizing and maximizing the web page in order to reach certain buttons. It's almost like the page was not designed for mobile devices. Sometimes, my mobile device would not load the pdf files after I had clicked on them multiple times, even if I had WiFi. I also wish it were a bit faster and easier to navigate, and I can't access some of the tools on my computer such as "My grades" for all classes. Syllabus that's in .doc form or .pdf gets downloaded without being able to see them in browser on mobile. Trying to view grades on TritonEd mobile site is absolutely horrendous. Thank goodness the app works okay otherwise I'd be limited to only being able to check TritonEd when I'm using my laptop The website is just so gross and clunky. Most materials on TritonEd is only accessible for downloading on a laptop. You cannot open those files on your phone. When you open TritonEd on phone, you can't open documents like articles or the syllabus that are posted. For some articles, it shows only the first page. Survey Results: What Students Said
  • 25. Survey Results: What Students Said The date/times of the final exams are never placed on TritonEd . Instead, I must login to WebReg to find out that part of the course. TritonEd is annoying to navigate, so instructors rely on e-mail to communicate important messages such as final exam information. Almost every professor and/or TAs have never used TED for posting the final exam. Either they stay it in class, their website, send out an email, and/or use Webreg. I think it will be better if there's anything like calendar on the main page that indicates when and where the midterms or finals are. It is inconvenient…when I have multiple finals and have to click on every course site to find out the location. I want something I can check those stuff at once. TritonEd does not have a tab that shows this information, although it would be very helpful. It is up the professor to make an announcement on TritonEd to update students on any changes in exam location and time. However, since there is no notification system that alerts students without signing on, some students may miss the announcement. This usually was not posted on TritonEd. And if it was, it was hard to find. I wish there was a way to see important dates right after logging in (maybe like a calendar) Many professors put the date of the midterm on one tiny spot on the syllabus, and then post that syllabus in some other folder - at the very least let the syllabus be its own tab. Preferably, important information like this would be written down in the announcements, or somehow pinned to be the first announcement. I typically check the exam date on Webreg since Ted is not useful for checking the exam date. Always need to go to syllabus. And when I go to syllabus, I have to open it in a new tab. Too long for info I need really fast.
  • 26. THEME 3: Instructor use of TritonEd for more than information broadcasting causes student anxiety and expense Activity Gap Score Mean SAT Mean IMP Valid Cases Using online textbooks supplements (WileyPLUS, Pearson MyLab, WebAssign, Redshelf) 0.64 3.41 4.05 1,053 Taking Exams 0.64 3.82 4.46 929 Setting up an account for online textbook supplements (WileyPLUS, Pearson MyLab, WebAssign, Redshelf) 0.64 3.57 4.21 1,109 Taking Quizzes 0.62 3.88 4.50 1,220
  • 27. WebAssign is complete bullshit. It takes an additional hour to figure out the way WebAssign wants us to format the answer. Like you can get an answer exactly right, but WebAssign requires students to format it a certain way. Figuring that out on average takes another hour. The quizzes are hard to use because sometimes your answer won't get saved or depending on browser size or type the timer/overview covers questions as you scroll. Sometimes TritonEd quits unexpectedly and does not save my answers for the quizzes. it is also difficult to review the quizzes I've taken to see my score and learn from the mistakes I made. I have only had to deal with RedShelf and the system they used was bad. They automatically were going to charge my class $100 each for the online textbook unless we opted out online. It is so expensive. considering that there is no alternative we kinda have to be forced to spend $120 to turn in homework. which sucks when you’re poor and tuition is already killing you. Occasionally, when creating an account, the website will tell me that an account is already registered with my email address even though I would never have created one. This is probably a result of UCSD reusing school email addresses for multiple students. TritonEd is useful for accessing online textbook supplements (I've used WebAssign for Math), and it helps with preparing for exams and quizzes because I can review class materials and lectures. Quiz interface is horrible. I cannot go back when I put a wrong answer as a mistake, and I have to go all the way to the right when the answer is on the left. Triton Ed has never helped me with anything related to online material/homework. I don't think I have ever witnessed anything related to WebAssign, Wiley Plus. In my three years I have never taken an exam or a quiz on TritonEd. I don't think you have the faculty bought on it. Survey Results: What Students Said
  • 28. BONUS THEME: Poor group features in TritonEd drive students to outside services, causes communication challenges Activity Gap Score Mean SAT Mean IMP Valid Cases Resolving group conflicts 0.59 3.52 4.10 637 Conducting project work 0.56 3.57 4.13 746 Meeting with my project group online 0.56 3.47 4.03 690 Forming my project group 0.55 3.59 4.14 796 Producing project documents 0.54 3.60 4.14 733 Sharing my contact information with other group members 0.54 3.64 4.18 796 Presenting group project work 0.52 3.66 4.18 704
  • 29. In regards to group projects, I only used Ted to contact my group members initially. I would use Ted to send out an email to all of my group members to ask them to give me their preferred method(s) of contact. Then, my group and I would use those preferred method(s) of contact and Google Suites to conduct work for the remainder of the project. Usually use other modes of communication; Piazza, email, Facebook. Usually conducted group work on google docs and would only use Ted to submit the project. If you think I'd actually use ted to produce project documents you're out of your freaking mind. I can barely find my grades on ted and turn things in. Stop trying to do a million different things poorly, and instead focus on doing a few things really well. Group assignments are such terrifying prospects, not only does it put you in a vulnerable position but also requires you to work out with each other the confusing time slots where you can actually meet. I would never consider using TED over Google Drive for group work. The tools are clunky and slow to figure out. I've had to do one group project where the only place to form groups was on TED. I was fucked over and hung out to dry by several potential groups. It's a really shitty way to form groups and easily leaves people out and is so disconnected from everything. All done through email or google docs/sheets which are less cumbersome, easier to use, and are less likely to experience problems/downtime. It's not easy to do so and requires manually finding the person's ucsd email which isn't always checked by the student. It is not simple to do, trying to figure out the medium of communication and collect information, often within the last few minutes of a class. Some people might be left out for a week because contact information was not recorded well or at all. Survey Results: What Students Said
  • 30. THEME 1 Managing gradebook across the quarter is unintuitive, cumbersome and time-consuming THEME 2 Poor user interface design prevents effective grading and feedback THEME 3 TritonEd user interface makes it difficult to set up the basics of a course Instructor Data: TritonEd Pain Themes
  • 31. Activity Gap Score Mean SAT Mean IMP Valid Cases Submitting grades to eGrades 1.46 3.23 4.70 103 Developing accurate grading schemas or scales 1.42 3.05 4.47 79 Entering grades in TritonEd/Ted gradebook 1.41 3.21 4.63 122 Editing grades in TritonEd/Ted 1.26 3.38 4.64 124 Displaying accurate grades to students 0.83 3.84 4.67 131 THEME 1: Managing gradebook across the quarter is unintuitive, cumbersome and time-consuming
  • 32. THEME 1: Managing gradebook across the quarter is unintuitive, cumbersome and time-consuming Activity Gap Score Mean SAT Mean IMP Valid Cases Displaying accurate grades to students 0.83 3.84 4.67 131 Reviewing my overall course performance 1.03 3.64 4.67 1,401 Survey Results: Faculty vs. Students on Gradebook
  • 33. I can't convey how terrible I think the Blackboard gradebook function is. It simply doesn't navigate correctly. You can't search on all assignments/grades for a given student -- or if you do, it doesn't display them correctly. You can't manipulate grades in there. I mean, it's a freaking simple spreadsheet, and they can't even design that well. Entering individual grades is fine, but trying to download the grade book, edit, and then re-upload seems to always lead to grades getting rearranged. I only tried displaying grades to student one quarter. I found it a bit confusing to track various types of grades (e.g. points for participation, grades for assignments, etc.) and I went back to keeping track in an Excel sheet. For me the grade center is the most important part of TritonEd but it feels like it's 25 years old. It's slow to respond even on a high end computer, weird things happen when students submitted their homework more than once, going to the next line is tedious. still haven't figured out how to create letter grades and export them to eGrades, doing it manually. I should be able to upload to eGrades readily, whereas I ended up having to enter the eGrades manually. One bad thing about the TritonEd gradebook is that it has as a default a column displayed to the students that keeps track of the total point score over all assignments/exams, which may not correspond to how the total grade will be calculated after weighting, etc. So the students get a mistaken impression of how they are doing in the course. I would rather just have a blank spreadsheet where students can see only the column headings and their own row of data. Biggest pain in the ass Survey Results: What Instructors Said
  • 34. Survey Results: What Instructors Said What I see and what the students see are not always the same. This has been verified with them sending screenshots and/or showing me on their own tablets/laptops. Used TurnItIn to give feedback on papers but students couldn't see the comments I had entered in. had to pdf the page and then email it to them I only tried displaying grades to student one quarter. I found it a bit confusing to track various types of grades (e.g. points for participation, grades for assignments, etc.) and I went back to keeping track in an Excel sheet. I simply do not know if it's possible to do the calculation in TritonEd. I have been using excel and then manually enter the final grades. I manage all of my grade assignments in excel because I have more flexibility with calculations. The scrolling interface is impossible. Finding a student in particular is a daunting task of filtering or lucky scrolling. The TED "spreadsheet" is far too limited to calculate grades the way I need. I have to use an external spreadsheet and upload the grades. This is a lot of work, and sometimes leads to mistakes. The last time I tried this the procedure didn't work at all. eGrades refused to process the file I downloaded from TritonED. The total score column confuses them. (I know I can remove it, I just usually forget to.) Tritoned seems to create its own columns with total scores or weighted scores that I DO NOT want visible but make it impossible to remove. And properly scaled columns rarely calculate properly. Downloading the files to do some calculations and re-uploading is annoying. having more ability to manipulate the cells within TritonEd would be helpful
  • 35. Activity Gap Score Mean SAT Mean IMP Valid Cases Grading group projects/work 1.11 3.23 4.34 43 Grading written assignments 1.07 3.48 4.55 86 Providing feedback on written assignments 0.99 3.53 4.53 79 Viewing student assignment submissions 0.97 3.74 4.71 102 THEME 2: Poor user interface design prevents effective grading and feedback
  • 36. As with entering grades, viewing student submissions requires drilling down through too many menus. To make matters worse, Ted makes me repeat this process for each student. There isn't an obvious place to go to see submissions and then sometimes they show up strange if they didn't follow directions about file formats. The TurnItIn feedback function is a good idea that looks and works like it was executed by 2nd year CS majors. In a hurry. They earn a B- ...good idea, executed badly. Available tools for providing feedback on written assignments is greatly impoverished compared to what is afforded by using pen and paper. If it even has capacities to grade code, it's definitely not worth the 6000 button clicks to find these tools. My approach is always to use TritonED for the bare minimum, get assignments out of there, and grade with real, helpful tools. I haven't yet had students submit assignments online. I suppose that would save paper and avoid possibility of lost hardcopy assignments, but I haven't done so because it is so hard on the human eye to grade scanned paper assignments.” Can't write comments for the students -- see GradeScope, which does this pretty well. TurnItIn is an important tool, and in some ways it's good, and in some ways it's badly designed. It loses progress and you can't tell what students can see. Clunky. We use Gradescope so that we can provide written comments to students. TED is very restrictive in submission and feedback. Survey Results: What Instructors Said
  • 37. Survey Results: What Instructors Said Problems arise from columns not being visible (left-right scrolling ability seems to rarely show up). Except for auto-graded quizzes, why would you use TritonED? It's bloated, slow, and annoying. I grade using Gradescope. I have not done anything more than the quizzes. When I used TritionEd for grading online submissions it took my TAs triple the time to grade. Hard to download code, no code comparison possible but should be done automatically. I don't know how to [grade multimedia assignments] on TritonEd, and I am pretty well versed in the system. There doesn't appear to be an intuitive method for student submission or grading of multimedia assignments Clicking on 'View Attempt' fails to load a significant amount of time. Getting to students actual submissions is super clunky and opaque. The grading especially for Tas of the large courses is a bit difficult in terms of moving quickly between and amongst students' exams. TurnItIn does not allow for group grading of projects. Creates a ton of work to have to manual figure this out and messes up the whole grade center b/c you have columns that work for some people (the person who submitted the project) and not others (anyone else in their group).
  • 38. Activity Gap Score Mean SAT Mean IMP Valid Cases Conducting quizzes 1.03 3.26 4.29 68 Setting up quizzes 0.92 3.13 4.06 75 Conducting exams 0.86 3.26 4.11 39 Selecting/activating features, setting or tools in TritonEd/Ted 0.79 3.24 4.03 149 Organizing the structure of my TritonEd/Ted course 0.68 3.49 4.17 138 THEME 3: TritonEd user interface makes it difficult to set up the basics of a course
  • 39. I have not been able to conduct quizzes on TritonEd to a satisfactory level so I have stopped trying. I might like to conduct exams if there were built-in electronic features to reduce cheating -- and if it were possible to import a Word file into the quiz function so it wasn't so damned tedious to set up a quiz. Just getting the formatting to be uniform is a challenge. Hard to make sure all the settings that I want are activated I've been told not to do [use the TritonEd exam feature] because the WiFi infrastructure at UCSD can not handle it. I did try it last quarter, and had students not come to the lecture hall to complete it, but this led to other problems like cheating. It is so complex, it needs to be streamlined. Clunky, slow, unintuitive. Did I say slow? So slow. Ponderous. Circa 1990 user interface design. Quizzes are a pain to set up and hard to debug in Blackboard. Too many features, opaque descriptions of the settings, no sandbox for testing, and no confirmation of settings. Also, hard to copy paste from one to the other. [Quiz builder] crashes, unclear instructions, cumbersome to work with. The [question item] pool feature is unclear. I find it hard to decide how to organize files into folders and to organize the folders in a way that is obvious to the student where they can find things. I like TritonEd overall and it lets me do what I need to do, but I don't find it very intuitive. Survey Results: What Instructors Said
  • 40. As a piece of software, my perspective on Blackboard (as a student and TA) is that while it does, in fact, have some useful features, it's also bloated, clunky, frustrating, and something that I would burn in effigy for cathartic release, given a physical representation and the opportunity to do so. I am not computer-savvy, and I used TritonEd for the first time this winter, only to take advantage of Turnitin.com. I found setting THAT up absolutely baffling and found the entire website incomprehensible. TritonEd/TED requires such a long unintuitive learning curve. It does not facilitate any reasonable discussion platform (for that we go to Piazza) and the only reason I use TritonEd is so that my TAs can upload content and it manages grades moderately well. Setting up quizzes with flexible grading options on TritonEd is painful and not usually successful. Not useful as a training tool for students. In the past quarter, TritonED has made it very difficult to move content from an old course site to the new one--even if the class is the same. This meant that I had to manually upload all of the old files- -a process that took nearly 3 hours--instead of simply cloning the old course. If this cloning feature is still available, it needs to be marked much more clearly. If it is not, it needs to come back. After so many years, the Blackboard based system should be easier to use. I have started using some advanced features that I like, but they are really difficult to figure out, and the navigation has to be re-learned every year. I have my own class website that works a lot better/needs my needs a lot better than TritonEd. The buttons and contents were hidden. It took me about 15 minutes in search of the functionality I needed to change the front page of TritonEd.
  • 44. IDEATION: IT Services Stakeholders
  • 45. 1. Make the Best of What's Around • Quick Wins with Blackboard • Create Faculty-Developed Simplified Course Structure Template • Embrace tools currently used by faculty through enterprise adoption & integration 2. Promote Next Practices • Develop a student technology fee to fund technology improvements campus-wide, including wi-fi • Collaborate with the T&LC to promote a Community of Practice around Teaching with Technology Next Practices • Work with TLC to promote adoption and improve utilization of already-available campus collaboration tools such as Google Apps and/or Office 365 • Implement a student-led technology advisory group 3. Explore New Technology Paths • Adopt an LMS with a more modern user interface/user experience • Support for and integration of a wide variety of faculty-selected technologies (NGDLE) • UCSD-developed app that provides a unified calendar and simplified grade book for students RefinedSolutionsPortfolio
  • 46. 0 1 2 3 4 5 6 7 8 Quick Wins with Blackboard Create Faculty-Developed Simplified Course Structure Template Embrace tools currently used by faculty through enterprise adoption & integration Develop a student technology fee to fund technology improvements campus-wide, including wi-fi Collaborate with the T&LC to promote a Community of Practice around Teaching with Technology Next Practices Work with TLC to promote adoption and improve utilization of already-available campus collaboration tools such as Google… Implement a student-led technology advisory group Adopt an LMS with a more modern user interface/user experience Support for and integration of a wide variety of faculty-selected technologies (NGDLE) UCSD-developed app that provides a unified calendar and simplified grade book for students No. of Pain Themes Addressed by Solution