SURFnet is a non-profit subsidiary that operates the national research and education network in the Netherlands. It provides advanced services including high performance networking, authentication, authorization, and advanced multimedia collaboration tools. MediaMosa is open source software that SURFnet uses to build its online media portal for video on demand and live streaming. SURFnet is exploring using transcripting technology to generate metadata from video content through speech recognition, which would allow for searching within video recordings.

1. Frans Ward
Senior Technical Product Manager
SURFnet Advanced Services
MediaMosa and Transcripting Technology
to enhance usability of video in education
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
`
Tuesday, June 28, 2011

2. OVERVIEW
• About SURFnet
And our services. Briefly...
• MediaMosa Introduction
What is it?
• Searching in Spoken Words
Disclosure of recorded content
• Transcripting Technology Scout
What can this do for you?
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

3. About SURFnet
• The SURFnet network is the
national computer network for
higher education and research in
the Netherlands (NREN)
• SURFnet is a subsidiary of the
SURF organization
• Not for profit, 80 employees
• 180 connected institutions,
serving 1 million users
NREN, National Research and Education Network
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

4. SURFnet Services
SURFnet provides advanced services to the
Dutch research and education community
High performance networking.
SURFnet plays a leading role in the development
of national, European and world-wide
networking.
Authentication and authorization
services to provide secure access to the
network and other resources.
Advanced multimedia collaboration
tools, including high quality audio/video
streaming and communication.
NREN, National Research and Education Network
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

5. SURFnet Video Services
SURFmedia
SURFnet’s online mediaportal
http://www.surfmedia.nl/
CDN
✓ Video On Demand (VOD)
✓ Live Streaming
Facts and Figures (June 2011)
• 97.610 assets
• 47.979 accounts
VP-Core
• 11.450 logins per month Powered by
• 43 institutions using federative logins
• 4 content suppliers
• 248.049 views per month
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

6. SURFnet Video Services
Front-ends
Back-ends
SURFmedia
SURFnet’s online mediaportal
http://www.surfmedia.nl/
CDN
✓ Video On Demand (VOD)
✓ Live Streaming
Facts and Figures (June 2011)
• 97.610 assets
• 47.979 accounts
VP-Core
• 11.450 logins per month Powered by
• 43 institutions using federative logins
• 4 content suppliers
• 248.049 views per month
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

7. MediaMosa
Open Source
Software to build a
Media Management and
Distribution Platform
In use by SURFnet and
Kennisnet on their
VP-Core platform since
July 2008
Main Entry: 1me·dia-mo-sa
Pronunciation: ˈmē-dē-ə-mō-ˈzā
Function: open source software to build a media
management and distribution platform
Release Date: 8 april 2009
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

8. MediaMosa is.....
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

9. MediaMosa is.....
Open Source (GPLv2) Software
For building an online delivery
and media management platform
For (streaming) video, audio and in fact
any content
Features flexible metadata sets, screening and transcoding services
Open as in Open Source, supporting Open Technology,
Open Formats, Open Content,...
MediaMosa is the basis for various successful
video services that SURFnet provide to
the Dutch educational sector
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

10. 189 REST services
http://mediamosa.org/api
UNINETT Lecture Recording Workshop - Trondheim, October 6, 2010
1 SURFnet. We make innovation work
SURFnet. We make innovation work
Tuesday, June 28, 2011

11. PROVEN TECHNOLOGY
MediaMosa is in production since 2008 with SURFnet and Kennisnet.
Also used by...
Tuesday, June 28, 2011

12. MediaMosa Community Website
& Online DEMO environment
http://mediamosa.org
http://demo.mediamosa.org
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

13. TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT
• Rich Media Systems Compared • Transcripting Technology
• MediaMosa Building Block for • Open Live Streaming
Blackboard
• MediaMosa RichMedia
• MediaMosa and support for Application
other content
• Content Supplier Application
• Full text search engines • MediaMosa and Opencast
• Content in the Cloud Matterhorn
• MediaMosa and Open API • HTML5 Video
Sco uts
Technology
MediaMosa
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

14. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the Internet
increases rapidly
• Archiving is not enough: disclosure and reusing is
required!
• The use of speech technology is needed
(Reduce human effort).
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

15. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

16. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the internet
increases rapidly.
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

17. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the internet
increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

18. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the internet
increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!
• Adding Metadata is the key component here.
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

19. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the internet
increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!
• Adding Metadata is the key component here.
• The use of speech technology is needed
(Reduce human effort).
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

20. Adding metadata, the traditional approach:
Manual annotation
Huge amount of work
and no time-coded relations with video
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

21. Adding metadata, the new approach:
Exploiting speech technology for
metadata generation
Audio Extraction
Speech Recognition
(Speech-to-Text)
Time-coded Transcript
Indexing and Search:
Search on fragment level
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

22. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• Transcripting: conversion of speech
into a written or electronic text
document.
• Automatic Speech Recognition (ASR)
seems to be the ideal technology for
this.
• In combination with Optical Character
Recognition (OCR) of slides.
• Goal: to provide additional metadata
for searching in video / lecture
recordings.
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

23. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
DEMO’s SPEECH RECOGNITION
http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demo
http://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

24. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
The Technology Scout Project. The process is complex...
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

25. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
SCOUTING PROJECT
Lecture Recording
End User • Recording of Teacher
Application • Recording of Slides
• Basic Metadata
• Reference material
Transcription Multi-Source
MediaMosa
by ‘Spraak’ Player
• Recognize the Speech • Transcode into audio • Enhanced Search
• Produce time-coded • Store all into an asset • Optional Subtitles
Transcript • Optional OCR of slides • Optional Reference links
Partners:
http://www.spraak.org/
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

26. OPEN SOURCE MULTI-SOURCE HTML5 PLAYER
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

27. MediaMosa Status & Roadmap
Available on
mediamosa.org
Release 2.3.11
Continued Development:
2011: Two major releases based on new Drupal 7 framework.
MediaMosa 3.0: focusses on Open Interfaces
MediaMosa 3.5: focusses on Transcripting Technology (speech-2-text)
Other MediaMosa Projects 2011:
• Weblecture Pilot MediaMosa - Matterhorn
• Proof of Concepts Transcripting Technology
• Proof of Concepts flexible workflows
(Enhanced support for other content than audio/video)
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

28. MediaMosa 3.0
Focus on open interfaces, open standards and OpenSocial
MediaMosa OpenAPI interface:
Own interface in MediaMosa for support for
open REST calls and other related functions:
• Search
• oAuth
• oEmbed
• open upload
Open standards:
• JSON, ATOM feed
OpenSocial:
• a common API for social applications across multiple websites
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

29. 1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

30. 1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011

31. WWW
MediaMosa Directions
http://mediamosa.org
Online Demo
Q&A
http://demo.mediamosa.org
sa
MediaMo
Forum MediaMosa
http://mediamosa.org/forum
MediaMosa
Issue Tracker
http://mediamosa.org/trac
Source Code
https://github.com/mediamosa
Slideshare
ur
http://www.slideshare.net/MediaMosa
yo
or
Twitter s f n!
http://twitter.com/mediamosa ank t io
Th en
att
1 SURFnet. We make innovation work
MediaMosa and Transcripting Technology
DIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Tuesday, June 28, 2011