Screencasts, software developers, social studies, training, support, maintenance

1. …
Link…
?
Presented by Eric VITOULEY, trainee. Supervisor : Bram ADAMS

2. Two videos… (from www.youtube.com; keyword : firefox)
What is the fundamental difference ?

3. But… What is a screencast ?
A screencast is a digital video recording that captures actions taking place on a
computer desktop. Screencasts, which often contain voice-over narration, are useful for
demonstrating how to use specific operating systems, software applications or website
features.

4. 3 categories of screencasts

6. Identifying important features…
Virus Scanning
Link Scanner
Meta-data
Theme Changing

7. Report Bugs !
Which part
of the code
?
Information extraction &
Identifiers in source code

8. User feedback…
End user software
testing
Test/Comparison
screencasts
Ideas for next Release
Software Comparison

9. Keeping documentation up to date…
5s
Documentation
5s
Which part
of those doc
should be
changed ?
Release v1.0
New Release v1.1

10. So far…
Screencasts

11. Screencasts
Source
Code

12. About traceability…
Extraction
n
tio
rac
t
Ex

13. Research Questions
Does the audio file yield
syntactically correct,
meaningful text ?
Does a screencast file
yield syntactically
correct, meaningful text
?
Can we correctly link
screencast to source
code ?

14. If
Speech to text…
You
Handed
It
If you handed it Kannel with basic text editors like Notepad you're!probably
With s
Dragonfamiliar with Google Earth air messages like this parse e
Naturally
woefully
enc error on line 8
t
Speaking tool
e Basic
one set of waiting until you open your file in Google Earthndiscover errors in your
s Text
or invalidate your
f
Kannel this video tutorial will show you how to use Janet
ot
n
Editors
Kannel as you type the first step is to make sure that you have the Java runtime
ut
b
Like
ds don't have already you can get
environment installed on your computer you
r
o
Notepad
f w the latest stable version of genetic
it@Java.com next a J edit.org and o
install
You
ty
which is currently 4.2 was the ri
programs on your computer Glenn launch J edit
ajo
Re
first we
rm
fo
Filtered by Aspell list
tplug-ins to work with XML documentsProbably the plugneed to install some
so click on
ec
rr manager then click uninstall tab click on download options in
Woefully
o
ins menu plug-ins
xc
Familiar
na
an updatet from your list pick a location that's geographically close to you click
Sy
With
okay the list of plug-ins will refresh buttons for this alphabetically by
Google
clicking on the name column then scroll down to the bottom because were…
Earth

15. Places
Status
My
0 Latest Version Check
1.5
Loaded
III f
0 OuickNotepad
4.2
Loaded
Ffo
Remove
te
s
wa Add
Help
t er
Search
Download Options..
Plugin Options... grea
Close
Ma
IflPlugin Manager
ts 
c
MM
00®
Frames
rre !
o n
Ftft
Manage Update instai
inc tio
lly filtering weird
a
Places
Name Category
Version orm Size
tica f
!c in
My
□ Calculator Applications 1.1.6symbols +
124KB
nea
y t
on
s
d
Ed
□ Console
Applications 4.2.6.5 378KB
Aspell list
dds
a y
or
e
w
Add
□ JcrontabPlugin
Applications 0.7.2 81KB
er
rAl
o
M
SH
□ JMailApplications 14
431KB
Voice
My
□ JTAPIugin Applications 01
565KB _
Open
["I 1 arvfil Rrioftr
Annlir.atinns _2_l.fi -7_1 MR
Trctr
.........................................
Name [ Version
Text from video…

16. Images and video processing…
Feature Tracking
Contour Detection
Foreground Catching

17. Similarity Calculation Process
Array[n x m] words
e
oic
mv
o
t fr
Tex
FILTERED
FILTERED
m
fro
ext
T
WS4J
Documentation
ges
ima
Calulate similarity with
WordNet Similarity tool

18. Similarity Calculation Process (2)
WUP
LESK
• Threshold : 0,5
t
ien
ffic
e
Co
ice
D
JCN
WORDNET
SIMILARITY
PATH
LCH
HSO
g
hin
atc
M
e
rag
ave
LIN
RES
Source : Measuring similarities between sentences,
Thanh Ngoc Dao et al.,

19. Similarity Calculation Process (3)
 Relative similarity values to be able to compare.
 Max similaritiy values for each couple of file (X and Y)
A
C
P
1,0
1,0
1,0
N
 Relative similarity :
B
1,0
1,0
1,0
M
1,0
1,0
1,0

20. Case Study (1)
ut !
o
ugh
o
thr
y
arit
l
imi
s
ow
L

21. Case Study (2)
ut !
o
ugh
o
thr
y
arit
l
imi
s
ow
L

22. Work in progress…
 Split the screencast into scenes and compute similarities per scene.
 Advanced identifier splitting techniques for filtering the video/audio data.
 Deeper look on images/video processing to gain more information
 Similarity measurement without removing duplicate words
 Try to find link directly between screencasts and source code (by splitting identifiers)
 Build a model for traceability links retrieval between screencasts and source code

23. Conclusion