SlideShare a Scribd company logo
1 of 38
Advanced methods and
tools for Web-Based
education
Technologies for Structuring, Analyzing, Modelling, Personalisation
OCWC Global Conference 2013
Bali
Organiser and Sponsors
• Knowledge 4 All Foundation, London (http://www.k4all.org/)
• FP7 project Translectures (http://www.translectures.eu/)
• FP7 project MediaMixer (http://mediamixer.eu/)
• FP7 project X-Like (http://www.xlike.org/)
• FP7 project Pascal2 (http://pascallin2.ecs.soton.ac.uk/)
Agenda
• Brief introduction to the workshop (Mitja Jermol, K4A, JSI) (15’)
• Introducing K4A (Colin de La Higuera, K4A, Nantes) (15’)
• Some challenges in using Machine Learning in OER (Colin de La Higuera, K4A,
Nantes) (15’)
• Break
• Technologies and solutions for content structuring (Marko Grobelnik, K4A, JSI)
(45’)
• Technologies and solutions for user modelling and analytics (Marko Grobelnik,
K4A, JSI) (30’)
• Break
• Technologies, solutions and prospects of OER in the Videolectures.net case (Mitja
Jermol, K4A, JSI) (45’)
• Wrap up and discussion (20’)
Multimodal
and
multilingual
content
structuring
Learning
analytics and
user modelling
Personalisation,
recommendation
Technologies
Graph/Social Network Analysis
(GraphGarden/SNAP, IST-World,
FPIntelligence)
Complex Data Visualization
(DocAtlas, NewsExplorer, SearchPoint)
Computational Linguistics
(Enrycher, AnswerArt)
Social Computing/Web2.0 (LiveNetLife)
Decision Support (DEX)
Light-Weight Semantic Technologies
(OntoGen, OntoBridge)
Deep Semantics & Reasoning (Cyc)
Statistical Machine Learning
Data/Web/Text/Stream-Mining
(TextGarden Suite of tools)
From libraries to courses…
From courses to lectures….
From lectures to mass education…
From mass education to mass
accreditation…
Videolectures.net
development
WSA UNESCO AWARD
Personalisation
Modeling
(Needs and preferences)
Adaptation
Towards personalisation @
videolectures.net
Enrycher
(Contextualisation of
content objects)
Quintelligence
Miner
(user modeling and
segmentation)
Recommender
(Content/user matching)
Content/learning
object
Userbehavior
TEL environment
(videolectures.net)
Transcribing and Translating
Videos
Translectures
Our aim is to develop innovative, cost-effective solutions to produce
accurate transcriptions and translations in VideoLectures, with
generality across other Matterhorn-related repositories.
Three scientific and technological objectives:
• Improvement of transcription and translation quality by massive
adaptation.
• Improvement of transcription and translation quality by intelligent
interaction.
• Integration into Matterhorn to enable real-life evaluation.
4 June 2013 17
Results
Freely available tools and services for accurate transcriptions and translations:
- Automatic transcription of videos: English, Slovenian, German, French, Spanish
- Automated translation of videos: en⇆es, en⇆sl, en fr and en de.
Initial implementation:
- Videolectures
- poliMedia
- Matterhorn
18
Project factsheet
• Total Cost: €4,491,143.00
• EC Contribution: €3,125,000.00
• Execution: From: 11/2011 To: 10/2014
19
No Name Short
name
Country Exit
Month
Exit
month
1 UNIVERSITAT POLITECNICA DE VALENCIA UPV Spain 1 36
2 XEROX SAS XEROX France 1 36
3 INSTITUT JOZEF STEFAN JSI Slovenia 1 36
3+ KNOWLEDGE FOR ALL FOUNDATION K4A UK 1 36
4 RHEINISCH-WESTFAELISCHE
TECHNISCHE HOCHSCHULE AACHEN
RWTH Germany 1 36
5 EUROPEAN MEDIA LABORATORY GMBH EML Germany 1 36
6 Deluxe Digital Studios Ltd DDS UK 1 36
Massive Adaptation
22
massive
train from
large and diverse
data collections
adaptation target test domain
Overview About Adaptation
23
acoustic model
adaptation
translation model
adaptation
ASR SMT
language model
adaptation
investigate
• conditions
• models
• adaptation techniques
(time-aligned slides)
decide
Languages and Training Data
• ASR
24
Repository Language Acoustic Model
Training Hours
Language Model
Running Words
videolectures.net
English 768 4657 million
Slovenian 27 75 million
poliMedia Spanish 390 1609 million
Language Pairs and Training Data
• SMT
25
Repository Language Pair
Bilingual
Sentences
Monolingual
Running Words
poliMedia Spanish to English 12.9 million 57 million
videolectures.net
English to Spanish 12.9 million 34 million
English to Slovenian 4.7 million 378 million
English to French 4.0 million 119 million
English to German 2.2 million 621 million
Slovenian to English 1.1 million 57 million
Mixing media fragments
Media fragments
Media mixing is the process
by which self-contained parts
of media (fragments) are
identified and exposed via
media repository interfaces,
so that consumers can access
and re-use only the parts
they are interested in.
Media
Mixer
Hub
AV Content
Provider (1-n)
AV Content
Demander (1-m)
1) AV
material
analysis and
annotation
2) Fragment
Definition
3) Rights
and Cost
Assignment
6) Search.
Browsing
7) Rights
and Cost
Assessment
8) Download
4) Fragment
Upload
5) Clearing
(Sell)
9) Composition
of new AV
materials
10) Clearing
(Buy)
annotated &
linked Media
Fragments
Mediamixer (http://mediamixer.eu/)
• Community set-up and networking for the reMIXing of online MEDIA
fragments
• to set up and sustain a community of video producers, hosters, and
redistributors who will be supported in the adoption of semantic
multimedia technology in their systems and workflows to build a
European market for media fragment re-purposing and re-selling.
• http://community.mediamixer.eu/
Matterhorn (Opencast)
Matterhorn – Opencast
http://opencast.org/matterhorn/home
Matterhorn basic facts
• Opensource (http://opencast.org/matterhorn/download)
• Started July 2009
• Official Ver 1.3.1, March 2012, Ver 1.4 in testing
• Starting 2Y funds by:
• The Andrew W. Mellon: 1M US
• The William and Flora Hewlett foundations: 0.5 US
• Now supported by institutions itself
Adopting organisations
University College Cork
University of Applied Sciences Osnabrück
University of Bergen
University of California Berkeley
University of California Davis
University of Cape Town
University of Helsinki
University of Manchester
University of Nebraska-Lincoln
University of New Mexico
University of Osnabrueck
University of Saskatchewan
University Of The Arts London
University of Vigo
Vienna University of Technology
Visionaire Campus
Universidad Carlos III de Madrid
Universidad Distrital Francisco Jose de Caldas
Ben - Gurion University
Boise State University
Entwine
ETH Zurich
Ghent university
Loughborough University
North-West University
Northwestern University
OBIS/Oxford Brookes University, Oxford UK
Polytechnical University of Valencia (UPV)
Reformed Theological Seminary
Rice University
Rochester Institute of Technology
RRZE Uni-Erlangen
Tel Aviv University
Teltek Video Research
The Institute for Global Outreach Developments International
UNINETT AS
New and emerging models
Video journal - status
• Video Journal of Machine Learning Abstracts
• Volume 1, 2, 3 – now preparing Vol. 4
• 146 video abstracts, 15k views
• Building up review committes
• PlanetData NoE - Video Journal of Semantic Data Management Abstracts
• Volume 1, now preparing Vol.2
 Feedback from the community
 Have separate tracks
 Have different selection criteria (no need to check sound, etc).
 Allow submissions of more multimedia-like presentations
Live streaming via Ncast
UNESCO collaboration
• VideoLectures Winner of WSA in 2009
• March 2013 WSIS+10 Global Champion
• VideoLectures.Net was selected as the winner in the “e- Science & Technology” category
• 2 directors attended the Gala ceremony
• meeting with Mr Qian Tang, Assistant Director-General for Education, UNESCO and
discussed:
• Boost-up education in UNESCO member states
• Provide a hub for MA, MSc, PhD video content exchange
• Bring the latest research and development in Africa and globally to institutions in Africa
• Potential to improve and facilitate mobile learning
• Creation of AI training/research in developing countrires
• Visit of UNESCO director-general Irina Bokova in Ljubljana 9.4.2013
Already taken actions towards the future
• Future (not so distant)
• Responsive learning environments
• Learning companions
• New academia/research
• Speaker modelling
Links and contacts
Davor Orlic
Davor.Orlic@k4all.org
http://www.translectures.eu/
ajuan@dsic.upv.es
Alfons Juan-Ciscar
Universitat Politècnica de València (DSIC)
http://www.xlike.org/ Marko Grobelnik
Jozef Stefan Institute
marko.grobelnik@ijs.si
http://www.k4all.org/
http://mediamixer.eu/ Lyndon Nixon
STI - International
lyndon.nixon@sti2.org
Cronicle.com

More Related Content

What's hot

SCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/BelgiumSCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/BelgiumSven Schlarb
 
Experimental Workflow Development in Digitisation
Experimental Workflow Development in DigitisationExperimental Workflow Development in Digitisation
Experimental Workflow Development in Digitisationcneudecker
 
SCAPE general presentation
SCAPE general presentationSCAPE general presentation
SCAPE general presentationSCAPE Project
 
Automatic Preservation Watch
Automatic Preservation WatchAutomatic Preservation Watch
Automatic Preservation WatchSCAPE Project
 
Europeana Music Channel, wireframes
Europeana Music Channel, wireframesEuropeana Music Channel, wireframes
Europeana Music Channel, wireframesDavid Haskiya
 
packed-preforma@lleida2015
packed-preforma@lleida2015packed-preforma@lleida2015
packed-preforma@lleida2015PACKED vzw
 
Presentation of Hans-Jörg Lieder, BnF Information Day
Presentation of Hans-Jörg Lieder, BnF Information DayPresentation of Hans-Jörg Lieder, BnF Information Day
Presentation of Hans-Jörg Lieder, BnF Information DayEuropeana Newspapers
 
Refinement of Digitised Newspapers
Refinement of Digitised NewspapersRefinement of Digitised Newspapers
Refinement of Digitised Newspaperscneudecker
 
Up2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conferenceUp2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conferenceUp2Universe
 
Up2U Workshop at TNC 2018-introduction
Up2U Workshop at TNC 2018-introductionUp2U Workshop at TNC 2018-introduction
Up2U Workshop at TNC 2018-introductionUp2Universe
 
Presentation of Clemens Neudecker, BnF Information Day
Presentation of Clemens Neudecker, BnF Information DayPresentation of Clemens Neudecker, BnF Information Day
Presentation of Clemens Neudecker, BnF Information DayEuropeana Newspapers
 
Realising the value of Europe's newspaper heritage
Realising the value of Europe's newspaper heritage Realising the value of Europe's newspaper heritage
Realising the value of Europe's newspaper heritage Europeana Newspapers
 
Science Demonstrator Session: Social and Earth Sciences
Science Demonstrator Session: Social and Earth SciencesScience Demonstrator Session: Social and Earth Sciences
Science Demonstrator Session: Social and Earth SciencesEOSCpilot .eu
 
Consolidated ViBRANT Project Final Review Presentations
Consolidated ViBRANT Project Final Review PresentationsConsolidated ViBRANT Project Final Review Presentations
Consolidated ViBRANT Project Final Review PresentationsVince Smith
 

What's hot (20)

SCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/BelgiumSCAPE Presentation at the Elag2013 conference in Gent/Belgium
SCAPE Presentation at the Elag2013 conference in Gent/Belgium
 
Experimental Workflow Development in Digitisation
Experimental Workflow Development in DigitisationExperimental Workflow Development in Digitisation
Experimental Workflow Development in Digitisation
 
SCAPE general presentation
SCAPE general presentationSCAPE general presentation
SCAPE general presentation
 
Automatic Preservation Watch
Automatic Preservation WatchAutomatic Preservation Watch
Automatic Preservation Watch
 
Europeana Music Channel, wireframes
Europeana Music Channel, wireframesEuropeana Music Channel, wireframes
Europeana Music Channel, wireframes
 
packed-preforma@lleida2015
packed-preforma@lleida2015packed-preforma@lleida2015
packed-preforma@lleida2015
 
Presentation of Hans-Jörg Lieder, BnF Information Day
Presentation of Hans-Jörg Lieder, BnF Information DayPresentation of Hans-Jörg Lieder, BnF Information Day
Presentation of Hans-Jörg Lieder, BnF Information Day
 
Conversatorio: estado de las National Research and Education Networks (NREN)...
 Conversatorio: estado de las National Research and Education Networks (NREN)... Conversatorio: estado de las National Research and Education Networks (NREN)...
Conversatorio: estado de las National Research and Education Networks (NREN)...
 
Refinement of Digitised Newspapers
Refinement of Digitised NewspapersRefinement of Digitised Newspapers
Refinement of Digitised Newspapers
 
UK Chapter Europortfolio
UK Chapter Europortfolio UK Chapter Europortfolio
UK Chapter Europortfolio
 
Up2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conferenceUp2U Worskshop at the TNC18 conference
Up2U Worskshop at the TNC18 conference
 
Up2U Workshop at TNC 2018-introduction
Up2U Workshop at TNC 2018-introductionUp2U Workshop at TNC 2018-introduction
Up2U Workshop at TNC 2018-introduction
 
ExPaNDS
ExPaNDSExPaNDS
ExPaNDS
 
Metadata
MetadataMetadata
Metadata
 
Refinement
RefinementRefinement
Refinement
 
Presentation of Clemens Neudecker, BnF Information Day
Presentation of Clemens Neudecker, BnF Information DayPresentation of Clemens Neudecker, BnF Information Day
Presentation of Clemens Neudecker, BnF Information Day
 
Realising the value of Europe's newspaper heritage
Realising the value of Europe's newspaper heritage Realising the value of Europe's newspaper heritage
Realising the value of Europe's newspaper heritage
 
Science Demonstrator Session: Social and Earth Sciences
Science Demonstrator Session: Social and Earth SciencesScience Demonstrator Session: Social and Earth Sciences
Science Demonstrator Session: Social and Earth Sciences
 
Europeana Newspapers Project
Europeana Newspapers ProjectEuropeana Newspapers Project
Europeana Newspapers Project
 
Consolidated ViBRANT Project Final Review Presentations
Consolidated ViBRANT Project Final Review PresentationsConsolidated ViBRANT Project Final Review Presentations
Consolidated ViBRANT Project Final Review Presentations
 

Similar to Intelligent tools-mitja-jermol-2013-bali-7 may2013

The Sci-GaIA project
The Sci-GaIA projectThe Sci-GaIA project
The Sci-GaIA projectBruce Becker
 
Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...
Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...
Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...African Open Science Platform
 
Project Overview_MINKE
Project Overview_MINKEProject Overview_MINKE
Project Overview_MINKEMinkeProject
 
Archiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award CeremonyArchiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award CeremonyArchiver
 
Archiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award CeremonyArchiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award CeremonyArchiver
 
European Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunitiesEuropean Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunitiesEOSC-hub project
 
Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...
Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...
Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...FIAT/IFTA
 
Presto4U Overview @BAAC2014 in Riga
Presto4U Overview @BAAC2014 in RigaPresto4U Overview @BAAC2014 in Riga
Presto4U Overview @BAAC2014 in RigaMarco Rendina
 
Seminar 20111122 - MediaMosa projects
Seminar 20111122 - MediaMosa projectsSeminar 20111122 - MediaMosa projects
Seminar 20111122 - MediaMosa projectsMediaMosa
 
Digital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the PondDigital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the PondBenoit Pauwels
 
Digital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the PondDigital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the PondULB - Bibliothèques
 
MuSa. Combined use of mooc, e learning and workplace learning to support prof...
MuSa. Combined use of mooc, e learning and workplace learning to support prof...MuSa. Combined use of mooc, e learning and workplace learning to support prof...
MuSa. Combined use of mooc, e learning and workplace learning to support prof...EADTU
 
WEBINAR: "How to manage your data to make them open and fair"
WEBINAR:  "How to manage your data to make them open and fair"  WEBINAR:  "How to manage your data to make them open and fair"
WEBINAR: "How to manage your data to make them open and fair" OpenAIRE
 
The Ascent of Open Science and the European Open Science Cloud
The Ascent of Open Science and the European Open Science CloudThe Ascent of Open Science and the European Open Science Cloud
The Ascent of Open Science and the European Open Science CloudTiziana Ferrari
 

Similar to Intelligent tools-mitja-jermol-2013-bali-7 may2013 (20)

The Sci-GaIA project
The Sci-GaIA projectThe Sci-GaIA project
The Sci-GaIA project
 
Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...
Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...
Conjugating Open Science & Open Education: The Sci-GaIA e-Research Hackfest m...
 
Project Overview_MINKE
Project Overview_MINKEProject Overview_MINKE
Project Overview_MINKE
 
Enoll hannover-2013-anna
Enoll hannover-2013-annaEnoll hannover-2013-anna
Enoll hannover-2013-anna
 
Archiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award CeremonyArchiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award Ceremony
 
Archiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award CeremonyArchiver pilot phase kick off Award Ceremony
Archiver pilot phase kick off Award Ceremony
 
European Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunitiesEuropean Open Science Cloud: Concept, status and opportunities
European Open Science Cloud: Concept, status and opportunities
 
UPV Digital Content Creation Services
UPV Digital Content Creation ServicesUPV Digital Content Creation Services
UPV Digital Content Creation Services
 
Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...
Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...
Presto Centre, Preserving the Initiative, FIAT/IFTA Workshop, October 22, Mar...
 
Presto4U Overview @BAAC2014 in Riga
Presto4U Overview @BAAC2014 in RigaPresto4U Overview @BAAC2014 in Riga
Presto4U Overview @BAAC2014 in Riga
 
Seminar 20111122 - MediaMosa projects
Seminar 20111122 - MediaMosa projectsSeminar 20111122 - MediaMosa projects
Seminar 20111122 - MediaMosa projects
 
Digital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the PondDigital Preservation Best Practices: Lessons Learned From Across the Pond
Digital Preservation Best Practices: Lessons Learned From Across the Pond
 
Digital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the PondDigital Presentation Best Practices: Lessons Learned From Across the Pond
Digital Presentation Best Practices: Lessons Learned From Across the Pond
 
Intro-EOSC.pptx
Intro-EOSC.pptxIntro-EOSC.pptx
Intro-EOSC.pptx
 
MuSa. Combined use of mooc, e learning and workplace learning to support prof...
MuSa. Combined use of mooc, e learning and workplace learning to support prof...MuSa. Combined use of mooc, e learning and workplace learning to support prof...
MuSa. Combined use of mooc, e learning and workplace learning to support prof...
 
Videolectures for ocwc2010
Videolectures for ocwc2010Videolectures for ocwc2010
Videolectures for ocwc2010
 
Bne impact co_c
Bne impact co_cBne impact co_c
Bne impact co_c
 
WEBINAR: "How to manage your data to make them open and fair"
WEBINAR:  "How to manage your data to make them open and fair"  WEBINAR:  "How to manage your data to make them open and fair"
WEBINAR: "How to manage your data to make them open and fair"
 
The Ascent of Open Science and the European Open Science Cloud
The Ascent of Open Science and the European Open Science CloudThe Ascent of Open Science and the European Open Science Cloud
The Ascent of Open Science and the European Open Science Cloud
 
iBrussels Partnership Program
iBrussels Partnership ProgramiBrussels Partnership Program
iBrussels Partnership Program
 

More from MediaMixerCommunity

VideoLecturesMashup: using media fragments and semantic annotations to enable...
VideoLecturesMashup: using media fragments and semantic annotations to enable...VideoLecturesMashup: using media fragments and semantic annotations to enable...
VideoLecturesMashup: using media fragments and semantic annotations to enable...MediaMixerCommunity
 
Re-using Media on the Web: Media fragment re-mixing and playout
Re-using Media on the Web: Media fragment re-mixing and playoutRe-using Media on the Web: Media fragment re-mixing and playout
Re-using Media on the Web: Media fragment re-mixing and playoutMediaMixerCommunity
 
Remixing Media on the Web: Media Fragment Specification and Semantics
Remixing Media on the Web: Media Fragment Specification and SemanticsRemixing Media on the Web: Media Fragment Specification and Semantics
Remixing Media on the Web: Media Fragment Specification and SemanticsMediaMixerCommunity
 
Re-using Media on the Web tutorial: Media Fragment Creation and Annotation
Re-using Media on the Web tutorial: Media Fragment Creation and AnnotationRe-using Media on the Web tutorial: Media Fragment Creation and Annotation
Re-using Media on the Web tutorial: Media Fragment Creation and AnnotationMediaMixerCommunity
 
Re-using Media on the Web Tutorial: Introduction and Examples
Re-using Media on the Web Tutorial: Introduction and ExamplesRe-using Media on the Web Tutorial: Introduction and Examples
Re-using Media on the Web Tutorial: Introduction and ExamplesMediaMixerCommunity
 
Semantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking Task
Semantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking TaskSemantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking Task
Semantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking TaskMediaMixerCommunity
 
Opening up audiovisual archives for media professionals and researchers
Opening up audiovisual archives for media professionals and researchersOpening up audiovisual archives for media professionals and researchers
Opening up audiovisual archives for media professionals and researchersMediaMixerCommunity
 
The Sensor Web - New Opportunities for MediaMixing
The Sensor Web - New Opportunities for MediaMixingThe Sensor Web - New Opportunities for MediaMixing
The Sensor Web - New Opportunities for MediaMixingMediaMixerCommunity
 
Building a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ ArchivesBuilding a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ ArchivesMediaMixerCommunity
 
Media Mixing in the broadcast TV industry
Media Mixing in the broadcast TV industryMedia Mixing in the broadcast TV industry
Media Mixing in the broadcast TV industryMediaMixerCommunity
 
Building a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ ArchivesBuilding a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ ArchivesMediaMixerCommunity
 
Semantic technologies for copyright management
Semantic technologies for copyright managementSemantic technologies for copyright management
Semantic technologies for copyright managementMediaMixerCommunity
 
Tell me why! ain't nothin' but a mistake describing media item differences w...
Tell me why! ain't nothin' but a mistake  describing media item differences w...Tell me why! ain't nothin' but a mistake  describing media item differences w...
Tell me why! ain't nothin' but a mistake describing media item differences w...MediaMixerCommunity
 
A feature analysis based fragment remix instrument
A feature analysis based fragment remix instrumentA feature analysis based fragment remix instrument
A feature analysis based fragment remix instrumentMediaMixerCommunity
 
Video concept detection by learning from web images
Video concept detection by learning from web imagesVideo concept detection by learning from web images
Video concept detection by learning from web imagesMediaMixerCommunity
 
Fast object re detection and localization in video for spatio-temporal fragme...
Fast object re detection and localization in video for spatio-temporal fragme...Fast object re detection and localization in video for spatio-temporal fragme...
Fast object re detection and localization in video for spatio-temporal fragme...MediaMixerCommunity
 
Example-Based Remixing of Multimedia Contents
Example-Based Remixing of Multimedia ContentsExample-Based Remixing of Multimedia Contents
Example-Based Remixing of Multimedia ContentsMediaMixerCommunity
 
Analysis of visual similarity in news videos with robust and memory efficient...
Analysis of visual similarity in news videos with robust and memory efficient...Analysis of visual similarity in news videos with robust and memory efficient...
Analysis of visual similarity in news videos with robust and memory efficient...MediaMixerCommunity
 

More from MediaMixerCommunity (19)

VideoLecturesMashup: using media fragments and semantic annotations to enable...
VideoLecturesMashup: using media fragments and semantic annotations to enable...VideoLecturesMashup: using media fragments and semantic annotations to enable...
VideoLecturesMashup: using media fragments and semantic annotations to enable...
 
Re-using Media on the Web: Media fragment re-mixing and playout
Re-using Media on the Web: Media fragment re-mixing and playoutRe-using Media on the Web: Media fragment re-mixing and playout
Re-using Media on the Web: Media fragment re-mixing and playout
 
Remixing Media on the Web: Media Fragment Specification and Semantics
Remixing Media on the Web: Media Fragment Specification and SemanticsRemixing Media on the Web: Media Fragment Specification and Semantics
Remixing Media on the Web: Media Fragment Specification and Semantics
 
Re-using Media on the Web tutorial: Media Fragment Creation and Annotation
Re-using Media on the Web tutorial: Media Fragment Creation and AnnotationRe-using Media on the Web tutorial: Media Fragment Creation and Annotation
Re-using Media on the Web tutorial: Media Fragment Creation and Annotation
 
Re-using Media on the Web Tutorial: Introduction and Examples
Re-using Media on the Web Tutorial: Introduction and ExamplesRe-using Media on the Web Tutorial: Introduction and Examples
Re-using Media on the Web Tutorial: Introduction and Examples
 
Semantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking Task
Semantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking TaskSemantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking Task
Semantic Multimedia Remixing - MediaEval 2013 Search and Hyperlinking Task
 
Opening up audiovisual archives for media professionals and researchers
Opening up audiovisual archives for media professionals and researchersOpening up audiovisual archives for media professionals and researchers
Opening up audiovisual archives for media professionals and researchers
 
The Sensor Web - New Opportunities for MediaMixing
The Sensor Web - New Opportunities for MediaMixingThe Sensor Web - New Opportunities for MediaMixing
The Sensor Web - New Opportunities for MediaMixing
 
Building a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ ArchivesBuilding a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ Archives
 
Media Mixing in the broadcast TV industry
Media Mixing in the broadcast TV industryMedia Mixing in the broadcast TV industry
Media Mixing in the broadcast TV industry
 
Building a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ ArchivesBuilding a linked data based content discovery service for the RTÉ Archives
Building a linked data based content discovery service for the RTÉ Archives
 
Semantic multimedia remixing
Semantic multimedia remixingSemantic multimedia remixing
Semantic multimedia remixing
 
Semantic technologies for copyright management
Semantic technologies for copyright managementSemantic technologies for copyright management
Semantic technologies for copyright management
 
Tell me why! ain't nothin' but a mistake describing media item differences w...
Tell me why! ain't nothin' but a mistake  describing media item differences w...Tell me why! ain't nothin' but a mistake  describing media item differences w...
Tell me why! ain't nothin' but a mistake describing media item differences w...
 
A feature analysis based fragment remix instrument
A feature analysis based fragment remix instrumentA feature analysis based fragment remix instrument
A feature analysis based fragment remix instrument
 
Video concept detection by learning from web images
Video concept detection by learning from web imagesVideo concept detection by learning from web images
Video concept detection by learning from web images
 
Fast object re detection and localization in video for spatio-temporal fragme...
Fast object re detection and localization in video for spatio-temporal fragme...Fast object re detection and localization in video for spatio-temporal fragme...
Fast object re detection and localization in video for spatio-temporal fragme...
 
Example-Based Remixing of Multimedia Contents
Example-Based Remixing of Multimedia ContentsExample-Based Remixing of Multimedia Contents
Example-Based Remixing of Multimedia Contents
 
Analysis of visual similarity in news videos with robust and memory efficient...
Analysis of visual similarity in news videos with robust and memory efficient...Analysis of visual similarity in news videos with robust and memory efficient...
Analysis of visual similarity in news videos with robust and memory efficient...
 

Intelligent tools-mitja-jermol-2013-bali-7 may2013

  • 1. Advanced methods and tools for Web-Based education Technologies for Structuring, Analyzing, Modelling, Personalisation OCWC Global Conference 2013 Bali
  • 2. Organiser and Sponsors • Knowledge 4 All Foundation, London (http://www.k4all.org/) • FP7 project Translectures (http://www.translectures.eu/) • FP7 project MediaMixer (http://mediamixer.eu/) • FP7 project X-Like (http://www.xlike.org/) • FP7 project Pascal2 (http://pascallin2.ecs.soton.ac.uk/)
  • 3. Agenda • Brief introduction to the workshop (Mitja Jermol, K4A, JSI) (15’) • Introducing K4A (Colin de La Higuera, K4A, Nantes) (15’) • Some challenges in using Machine Learning in OER (Colin de La Higuera, K4A, Nantes) (15’) • Break • Technologies and solutions for content structuring (Marko Grobelnik, K4A, JSI) (45’) • Technologies and solutions for user modelling and analytics (Marko Grobelnik, K4A, JSI) (30’) • Break • Technologies, solutions and prospects of OER in the Videolectures.net case (Mitja Jermol, K4A, JSI) (45’) • Wrap up and discussion (20’)
  • 5. Technologies Graph/Social Network Analysis (GraphGarden/SNAP, IST-World, FPIntelligence) Complex Data Visualization (DocAtlas, NewsExplorer, SearchPoint) Computational Linguistics (Enrycher, AnswerArt) Social Computing/Web2.0 (LiveNetLife) Decision Support (DEX) Light-Weight Semantic Technologies (OntoGen, OntoBridge) Deep Semantics & Reasoning (Cyc) Statistical Machine Learning Data/Web/Text/Stream-Mining (TextGarden Suite of tools)
  • 6. From libraries to courses…
  • 7. From courses to lectures….
  • 8. From lectures to mass education…
  • 9. From mass education to mass accreditation…
  • 11.
  • 14. Towards personalisation @ videolectures.net Enrycher (Contextualisation of content objects) Quintelligence Miner (user modeling and segmentation) Recommender (Content/user matching) Content/learning object Userbehavior TEL environment (videolectures.net)
  • 16. Translectures Our aim is to develop innovative, cost-effective solutions to produce accurate transcriptions and translations in VideoLectures, with generality across other Matterhorn-related repositories. Three scientific and technological objectives: • Improvement of transcription and translation quality by massive adaptation. • Improvement of transcription and translation quality by intelligent interaction. • Integration into Matterhorn to enable real-life evaluation. 4 June 2013 17
  • 17. Results Freely available tools and services for accurate transcriptions and translations: - Automatic transcription of videos: English, Slovenian, German, French, Spanish - Automated translation of videos: en⇆es, en⇆sl, en fr and en de. Initial implementation: - Videolectures - poliMedia - Matterhorn 18
  • 18. Project factsheet • Total Cost: €4,491,143.00 • EC Contribution: €3,125,000.00 • Execution: From: 11/2011 To: 10/2014 19 No Name Short name Country Exit Month Exit month 1 UNIVERSITAT POLITECNICA DE VALENCIA UPV Spain 1 36 2 XEROX SAS XEROX France 1 36 3 INSTITUT JOZEF STEFAN JSI Slovenia 1 36 3+ KNOWLEDGE FOR ALL FOUNDATION K4A UK 1 36 4 RHEINISCH-WESTFAELISCHE TECHNISCHE HOCHSCHULE AACHEN RWTH Germany 1 36 5 EUROPEAN MEDIA LABORATORY GMBH EML Germany 1 36 6 Deluxe Digital Studios Ltd DDS UK 1 36
  • 19.
  • 20.
  • 21. Massive Adaptation 22 massive train from large and diverse data collections adaptation target test domain
  • 22. Overview About Adaptation 23 acoustic model adaptation translation model adaptation ASR SMT language model adaptation investigate • conditions • models • adaptation techniques (time-aligned slides) decide
  • 23. Languages and Training Data • ASR 24 Repository Language Acoustic Model Training Hours Language Model Running Words videolectures.net English 768 4657 million Slovenian 27 75 million poliMedia Spanish 390 1609 million
  • 24. Language Pairs and Training Data • SMT 25 Repository Language Pair Bilingual Sentences Monolingual Running Words poliMedia Spanish to English 12.9 million 57 million videolectures.net English to Spanish 12.9 million 34 million English to Slovenian 4.7 million 378 million English to French 4.0 million 119 million English to German 2.2 million 621 million Slovenian to English 1.1 million 57 million
  • 26. Media fragments Media mixing is the process by which self-contained parts of media (fragments) are identified and exposed via media repository interfaces, so that consumers can access and re-use only the parts they are interested in. Media Mixer Hub AV Content Provider (1-n) AV Content Demander (1-m) 1) AV material analysis and annotation 2) Fragment Definition 3) Rights and Cost Assignment 6) Search. Browsing 7) Rights and Cost Assessment 8) Download 4) Fragment Upload 5) Clearing (Sell) 9) Composition of new AV materials 10) Clearing (Buy) annotated & linked Media Fragments
  • 27. Mediamixer (http://mediamixer.eu/) • Community set-up and networking for the reMIXing of online MEDIA fragments • to set up and sustain a community of video producers, hosters, and redistributors who will be supported in the adoption of semantic multimedia technology in their systems and workflows to build a European market for media fragment re-purposing and re-selling. • http://community.mediamixer.eu/
  • 30. Matterhorn basic facts • Opensource (http://opencast.org/matterhorn/download) • Started July 2009 • Official Ver 1.3.1, March 2012, Ver 1.4 in testing • Starting 2Y funds by: • The Andrew W. Mellon: 1M US • The William and Flora Hewlett foundations: 0.5 US • Now supported by institutions itself
  • 31. Adopting organisations University College Cork University of Applied Sciences Osnabrück University of Bergen University of California Berkeley University of California Davis University of Cape Town University of Helsinki University of Manchester University of Nebraska-Lincoln University of New Mexico University of Osnabrueck University of Saskatchewan University Of The Arts London University of Vigo Vienna University of Technology Visionaire Campus Universidad Carlos III de Madrid Universidad Distrital Francisco Jose de Caldas Ben - Gurion University Boise State University Entwine ETH Zurich Ghent university Loughborough University North-West University Northwestern University OBIS/Oxford Brookes University, Oxford UK Polytechnical University of Valencia (UPV) Reformed Theological Seminary Rice University Rochester Institute of Technology RRZE Uni-Erlangen Tel Aviv University Teltek Video Research The Institute for Global Outreach Developments International UNINETT AS
  • 33. Video journal - status • Video Journal of Machine Learning Abstracts • Volume 1, 2, 3 – now preparing Vol. 4 • 146 video abstracts, 15k views • Building up review committes • PlanetData NoE - Video Journal of Semantic Data Management Abstracts • Volume 1, now preparing Vol.2  Feedback from the community  Have separate tracks  Have different selection criteria (no need to check sound, etc).  Allow submissions of more multimedia-like presentations
  • 35. UNESCO collaboration • VideoLectures Winner of WSA in 2009 • March 2013 WSIS+10 Global Champion • VideoLectures.Net was selected as the winner in the “e- Science & Technology” category • 2 directors attended the Gala ceremony • meeting with Mr Qian Tang, Assistant Director-General for Education, UNESCO and discussed: • Boost-up education in UNESCO member states • Provide a hub for MA, MSc, PhD video content exchange • Bring the latest research and development in Africa and globally to institutions in Africa • Potential to improve and facilitate mobile learning • Creation of AI training/research in developing countrires • Visit of UNESCO director-general Irina Bokova in Ljubljana 9.4.2013
  • 36. Already taken actions towards the future • Future (not so distant) • Responsive learning environments • Learning companions • New academia/research • Speaker modelling
  • 37. Links and contacts Davor Orlic Davor.Orlic@k4all.org http://www.translectures.eu/ ajuan@dsic.upv.es Alfons Juan-Ciscar Universitat Politècnica de València (DSIC) http://www.xlike.org/ Marko Grobelnik Jozef Stefan Institute marko.grobelnik@ijs.si http://www.k4all.org/ http://mediamixer.eu/ Lyndon Nixon STI - International lyndon.nixon@sti2.org