YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes

.

.

YALMS Basics

M.Zhanikeev, H.Koide -- maratishe@gmail.com --

YALMS: A Data Structure for Storage and Replay of Multimedia Content -- http://tinyurl.com/marat140116 --

2 /21
2/21

.

.

YALMS Basics
.
YALMS...
.
... stands for

Yet Another Lecture Management System
• a new generaction -- HTML5- and cloud-based LMS 06
•
•
•

one function: video annotation robot 07
another function: Group Drive -- a P2P version of cloud storage 08
high-performance multimedia system based on multicore, SSD, etc. 09

06 M.Zhanikeev+1 "YALMS: Yet Another Lecture Management System" IEICE ET研究会 (2013)
07 M.Zhanikeev+1 "...Automatic Slicing of Screen Capture Video using Slide PDFs" IEICE ET研究会 (2013)
08 M.Zhanikeev+1 "YALMS: A Group Drive API for Cloud-Based Classrooms" IEICE IN研究会 (2013)
09 M.Zhanikeev+1 "...Solid State Drives in Rich Multimedia Content Processing, Storage and Streaming" ITE-MMS研究会 (2013)


3 /21
3/21

.

.

YALMS Roadmap
2013.07・ET研

YALMS: Intro

2013.11・IN研

YALMS.cloud
clouds groupdrive
sync
2013.09・ET研

YALMS.annotation

2014.1・LOIS研

PDF video annotation

YALMS.format

2014.01・ET研

recording
replay storage
multimedia

YALMS.streaming
DASH Adaptive

HTML5

2013.10・ITE-MMS研

YALMS.hiperf
SSD
multicore

YALMS.done!


4 /21
4/21

.

.

YALMS.format : Objectives



5 /21
5/21

.

.

YALMS.format Objectives
single .yalms file
◦ official components: AV for audiovideo, S for slides or screen capture video, C is

1. pack all the contents of a lecture into a

◦ audiovideo, slides, files and versioning, etc.
for files and versioning

2.

replay .yalms files in a browser in standalone mode
◦ directly from .yalms file -- no backend system



6 /21
6/21

.

.

Objectives ... Visuallly
HTML5
Step 1: Record

A
V
YALMS
Robot

Lecturer
Files


Viewers

C

S

Step 2: Add PDF

Long-Term
Storage

YALMS
Robot

S
Lecturer


7 /21
7/21

.

.

YALMS vs... : Related Works



8 /21
8/21

.

.

YALMS.format vs Multimedia System
.
Traditional Multimedia System
.
• powerfull back-end
• HTTP streaming in realtime
.
.
YALMS.format
.
• .yalms file is a binary file -- can be stored anywhere
◦ like in cloud storage
•

.

no streaming, the file is simply traversed using exiting APIs
◦ any RESTful API, cloud storage, local filesystem



9 /21
9/21

.

.

YALMS.format vs SMIL
5:
6:<par>
7:
<video src="joe-video"/>
8:
<text src="http://www.example.com/joe-text"/>
9:
<seq>
10:
<audio src="rtsp://www.example.com/joe-audio"/>
11:
<audio src="tim-audio"/>
12:
</seq>
13:</par>
14:
15:

jow-audio

• close but not enough
• need to pack actual

content into the file

tim-audio

joe-text
joe-video


10 /21
10/21

.

.

YALMS.format in Browser



11 /21
11/21

.

.

HTML5 Functionality
Browser
Abilities

Traditional
JSON, BSON

HTML5
Flash

WebSockets
Adaptive Streaming?

?

Binary
Blob ByteArray

WebWorkers
structuredCopy
New Chrome feature


passByRef
postData( data, [ data])


12 /21
12/21

.

.

HTML5: the SaveAs Function
•

NOTE: JS now natively can save binary chunks to local filesystem



13 /21
13/21

.

.

YALMS.format : Design



14 /21
14/21

.

.

YALMS.format : Design
YALMS
Robot
Step 1: Record

A
V

A
V

•
Step 2: Add PDF

C

S

Watch
Watch
scene
filesystem change


• events are specific to each

content type

X

SE SE
Lecturer

even-driven packing

• events are used to

CE

Lecturer

PE

cut

.YALMS files into
blocks

S
YALMS.format

Annotation


15 /21
15/21

.

.

YALMS.format : Events
1.

SE : screen capture events
◦ screen capture is video, so -- scene changes

2.

CE : binary file diffs
◦ there are

3.

LibXDiff 15 and Xdelta 16, the latter is preferred

PE : page events -- replaces SE
◦ blocks based on page changes

15

"LibXDiff" http://www.xmailserver.org/xdiff.html (2013)

16

"Xdelta Project Page" http://xdelta.org/ (2013)



16 /21
16/21

.

.

1
2
3
4
5

Block border types
Fixed minimal size
Scene change (I-Frame)
Page change
New File(s)
New File Diff(s)

Block
border
Head

Bytes

.YALMS File Design
0
4
8
12
offset

Bits

8

16

24

Block Header Design
seqno

flags

Offset

Block length in bytes
Block 1: type(3) + offset(29)
... (the same for all blocks)
Block 1 (binary data) ...

…

Tail
The First Lecture.yalms

Time

The entire file

17 /21
17/21

.

.

YALMS.format Robot and Screen
Browser

A
V

Get binary
YALMS
Robot
HTML5
File API

CE
SE PE
or

Auto “download file”

Screen

A V
VIDEO

PNG

S
C MISC.

“download” on click


18 /21
18/21

.

.

Wrapup



19 /21
19/21

.

.

Wrapup
working version at 02
• release plan: end of March
•

◦ the entire package will be offered as open source

02 myself "Homepage of the YALMS.format Subproject" https://github.com/maratishe/yalms.format (2013)


20 /21
20/21

.

.

That’s all, thank you ...



21 /21
21/21

.

.

[01] MEXT (2013)
The enPiT Project
http://www.enpit.jp
[02] myself (2013)
Homepage of the YALMS.format Subproject
https://github.com/maratishe/yalms.format
[03] W3C (2013)
Synchronized Multimedia Integration Language (SMIL 3.0)
http://www.w3.org/TR/SMIL/
[04] W3C (2013)
HTML5: W3C Working Draft
http://www.w3.org/TR/html5/
[05] W3C (2013)
File API: W3C Working Draft
www.w3.org/TR/FileAPI


21 /21
21/21

.

.

[06] M.Zhanikeev+1 (2013)
YALMS: Yet Another Lecture Management System
IEICE ET研究会
...Automatic Slicing of Screen Capture Video using Slide PDFs
IEICE ET研究会
YALMS: A Group Drive API for Cloud-Based Classrooms
IEICE IN研究会
...Solid State Drives in Rich Multimedia Content Processing, Storage and Streaming
ITE-MMS研究会
...Content Aggregation in Browsers using Recent Advances in HTML5
COMPSAC


21 /21
21/21

.

.

Experiments with application throughput in a browser with full HTML5 support
IEICE ComEx
[12] H.Pucha+3 (2008)
Adaptive File Transfers for Diverse Environments
USENIX
[13] D.Frey+2 (2012)
Probabilistic Deduplication for Cluster-Based Storage Systems
3rd ACM SoCC
[14] D.Meyer+1 (2012)
A Study of Practical Deduplication
ACM Transactions on Storage (TOS)
[15]

(2013)
LibXDiff
http://www.xmailserver.org/xdiff.html



21 /21
21/21

.

.

[16]

(2013)
Xdelta Project Page
http://xdelta.org/

[17] IETF (2002)
The VCDIFF Generic Differencing and Compression Data Format
RFC3284



21 /21
21/21

YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes

Recomendados

Recomendados

Más contenido relacionado

Similar a YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes

Similar a YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes (20)

Más de Tokyo University of Science

Más de Tokyo University of Science (20)

Último

Último (20)

YALMS: A Data Structure for Storage and Replay of Multimedia Content in Digital Classes