Authors/Presenters: Vasileios Mezaris and Benoit Huet. Video hyperlinking is the introduction of links that originate from pieces of video material and point to other relevant content, be it video or any other form of digital content. The tutorial presents the state of the art in video hyperlinking approaches and in relevant enabling technologies, such as video analysis and multimedia indexing and retrieval. Several alternative strategies, based on text, visual and/or audio information are introduced, evaluated and discussed, providing the audience with details on what works and what doesn’t on real broadcast material.

1. Video Hyperlinking
Part A: Motivation and Vision
Vasileios Mezaris
Information Technologies Institute (ITI)
Centre for Research and Technology Hellas (CERTH)
Information Technologies Institute
Centre for Research and Technology Hellas
Benoit Huet
EURECOM
IEEE ICIP’14 Tutorial, Oct. 2014
ACM MM’14 Tutorial, Nov. 2014

2. Overview
• Part A: Motivation and Vision
• Part B: Video Fragment Creation and
Annotation for Hyperlinking
• Part C: Insights into Hyperlinking Video
Content
• Concluding remarks
Information Technologies Institute 1.2
Centre for Research and Technology Hellas

3. Supporting Projects (1/2)
• LinkedTV: Linking Television to
Web content,
FP7 ICT IP, 2011-2015
• Second screen scenarios for
eennrriicchhiinngg tteelleevviissiioonn ccoonntteenntt and
achieving iinntteerraaccttiioonn between
user and content
Information Technologies Institute 1.3
Centre for Research and Technology Hellas

4. Supporting Projects (2/2)
• MediaMixer: Community set-up
and networking for the
remixing of oonnlliinnee mmeeddiiaa
ffrraaggmmeennttss,
FP7 ICT CSA, 2012-2014
• Promoting technologies
enabling eeaassiieerr mmeeddiiaa
ccoonntteenntt aacccceessss aanndd
rreeppuurrppoossiinngg
• Focus on Media Fragments
Information Technologies Institute 1.4
Centre for Research and Technology Hellas

5. Audio-Visual Explosion
• EU alone hosts 500+ online video platforms
• 42.7m hrs of footage in online archives of broadcasters
and producers (61% of archive footage is online)
• UGC on the advance:
– YouTube receives 100 hrs of video/minute
– Vine and Instagram video
• Internet video is now 40 percent of consumer Internet
traffic, and will reach 62 percent by the end of 2015, 75%
in 2017
(source: CISCO)
•• HHooww ttoo mmaakkee tthhee ccoonntteenntt aacccceessssiibbllee?
– Browsing, Searching, HHyyppeerrlliinnkkiinngg
Information Technologies Institute 1.5
Centre for Research and Technology Hellas

6. Search
• Efficient and Effective Search techniques for
Textual Information (i.e. Google Page Rank)
• What about Multimedia Documents?
Audio-Visual and Beyond
– Much work on Audio (Fingerprint/ASR)
– Two decades of work on Content-Based Image
Search
– Little work on MMuullttiimedia
Information Technologies Institute 1.6
Centre for Research and Technology Hellas

7. Defining Hyperlinking
• Linking multimedia documents with rreellaatteedd ccoonntteenntt
Information Technologies Institute 1.7
Centre for Research and Technology Hellas

8. Defining Hyperlinking
• Linking multimedia documents with rreellaatteedd ccoonntteenntt
Information Technologies Institute 1.8
Centre for Research and Technology Hellas

9. Hyperlinking in practice
• Linking multimedia documents with related
content
• Automatic Hyperlink Creation
– Different from Search (no user query)
– Query automatically crafted from source document
content
• Outreach
– Recommendation system
– Second screen applications
Information Technologies Institute 1.9
Centre for Research and Technology Hellas

10. Video Analysis for Hyperlinking
• Extracting meaningful information for
hyperlinking
– Video segmentation
– Video analysis
Information Technologies Institute 1.10
Centre for Research and Technology Hellas

11. Video Hyperlinking tutorial continued
• Video Hyperlinking Part B: Video Fragment
Creation and Annotation for Hyperlinking:
http://www.slideshare.net/linkedtv/video-hyperlinking-
tutorialpartb
• Video Hyperlinking Part C: Insights into
Hyperlinking Video Content:
http://www.slideshare.net/linkedtv/video-hyperlinking-
tutorial-part-c
Information Technologies Institute 1.11
Centre for Research and Technology Hellas