MediaMosa 3.x Release & Transcripting Project - Community day - 8 december 2011
1. Frans Ward
Technical Product Manager
SURFnet Advanced Services
MediaMosa 3.x Release
& Transcripting Project
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
`
Tuesday, December 13, 11
2. OVERVIEW
• 15.00 - 15.10
MediaMosa 3.0 release
• 15.10 - 15.25
Transcripting Technology
• 15.25 - 15.30
Q&A
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
3. MediaMosa Status
Latest stable release on
Github
Release 3.0.7
• In production on the VP-Core platform
as of november 16, 2011
• Release Notes / Changelog:
http://www.mediamosa.org/trac/ticket/519
• Sourcecode:
https://github.com/mediamosa/mediamosa
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
4. MediaMosa 3.0
Focus on open interfaces, open standards and OpenSocial
MediaMosa OpenAPI interface:
Own interface in MediaMosa for support for
open REST calls and other related functions:
• Search
• oAuth
• oEmbed
• open upload
Open standards:
• JSON, ATOM feed
OpenSocial:
• a common API for social applications across multiple websites
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
5. New Feature: Open API
• OpenAPI support
- Search
- oAuth
- oEmbed
- Open upload
• MediaMosa OpenAPI interface
Own interface in MediaMosa for support for open REST calls and other
related functions
OpenAPI search with "alt" parameter:
http://openapi.acceptatie.vpcore.snkn.nl/openapi/search?query=test&alt=rss
Allowed values are 'xml', 'atom', 'rss', 'json'.
• http://openapi.acceptatie.vpcore.snkn.nl/openapi/search?
query=test&alt=atom
• http://openapi.acceptatie.vpcore.snkn.nl/openapi/mediaItems/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
6. New Feature: oAuth
• What is oAuth
- An open protocol to allow secure API authorization
• How does it work?
- Websites or software that supports oAuth
- Websites or software that knows MediaMosa REST
• What are the use-cases;
- External website/software that wants to copy media
- External website/software that supports video editing
• For more information;
- http://oauth.net/
- http://mediamosa.org/api
- http://mediamosa.org/trac/ticket/10
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
7. New Feature: oEmbed
• What is oEmbed?
- oEmbed is an open API format designed to allow embedding content
from a website into another page. This content is of the types photo,
video, link or rich. (converting a URL into an embed code)
• How does it work?
- A external website does a call to a front-end website that supports
oEmbed.
- MediaMosa will provide the REST calls to return the embedded
information
• What are the use-cases;
- Websites that want to support embedding of their MediaMosa media
in external websites
• For more information;
- http://www.oembed.com
- http://mediamosa.org/api
- http://mediamosa.org/trac/ticket/413
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
8. New Features: Other
• PDF Support
- PDFinfo: Integrated analyzer for meta data parsing
- PDF2SWF: Converts PDF to SWF to enable to view PDF
inside website (http://www.swftools.org/)
• Image Support
- ImageMagic tool: Convert, Edit, and Compose Images
http://www.imagemagick.org/
- Exiv2: Manipulate the Exif metadata of images
http://www.exiv2.org/
• Watermarking
- Allows stills to be watermarked
• Users can now be in more than one (quota) group
- No longer 1 on 1 relation between users and groups
• Status page improvements
- More information
- Real time and cached information
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
9. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the Internet
increases rapidly
• Archiving is not enough: disclosure and reusing is
required!
• The use of speech technology is needed
(Reduce human effort).
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
10. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
11. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the Internet
increases rapidly.
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
12. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the Internet
increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
13. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the Internet
increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!
• Adding Metadata is the key component here.
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
14. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure
of
audiovisual
archives
• The number of AV-archives on the Internet
increases rapidly.
• Archiving is not enough: disclosure and reusing
is required!
• Adding Metadata is the key component here.
• The use of speech technology is needed
(Reduce human effort).
UK National Film and Television Archive, Berkhamsted
http://www.flickr.com/people/footage/
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
15. Adding metadata, the traditional approach:
Manual annotation
Huge amount of work
and no time-coded relations with video
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
16. Adding metadata, the new approach:
Using speech-to-text technology for
metadata generation
Audio Extraction
Speech Recognition
(Speech-to-Text)
Time-coded Transcript
Indexing and Search:
Search on fragment level
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
17. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
The Technology Scout Project. The process is complex...
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
18. MEDIAMOSA TRANSCRIPTING TECHNOLOGY
SCOUTING PROJECT
Lecture Recording
End User • Recording of Teacher
Application • Recording of Slides
• Reference material
Transcription Multi-Source
MediaMosa
by Spraak / Player
Cmu Sphinx
• Recognize the Speech • Transcode into audio • Enhanced Search
• Produce time-coded • Store all into an asset • Optional Subtitles
Transcript • Mashup info
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
19. MEDIAMOSA TRANSCRIPTING PROJECT
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
20. MEDIAMOSA TRANSCRIPTING PROJECT
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
21. MEDIAMOSA TRANSCRIPTING PROJECT
Subtitles:
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
22. MediaMosa 3.5 release
Focus on transcription technology (speech-2-text) and flexible
workflows
• Development is started
• beta release available: december 2011
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11
23. WWW
MediaMosa Directions
http://mediamosa.org
Online Demo
Q&A
http://demo.mediamosa.org
sa
MediaMo
Forum MediaMosa
http://mediamosa.org/forum
MediaMosa
Issue Tracker
http://mediamosa.org/trac
Source Code
https://github.com/mediamosa
Slideshare
ur
http://www.slideshare.net/MediaMosa
yo
or
Twitter s f n!
http://twitter.com/mediamosa ank t io
Th en
att
1 SURFnet. We make innovation work
MediaMosa Community Day
Utrecht, December 8, 2011 - SURFnet. We make innovation work
Tuesday, December 13, 11