SlideShare una empresa de Scribd logo

Multimedia Information Retrieval: What is it, and why isn't ...

•Descargar como PPT, PDF•
•
W
webhostingguy
1 de 74
Video Search: Opportunities and Challenges Keynote Speech at ACM MIR Workshop ACM Multimedia Conference 2005 Singapore Dr. Ramesh R. Sarukkai Yahoo! Search { [email_address] [email_address] }
About the Presenter ,[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Introduction ,[object Object],[object Object],[object Object],[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Market Trends ,[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object]
Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data
Video Search ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Features 1970 2000 1990 1980 2010 Texture: Autocorrelation; Wavelet transforms; Gabor Filters Shape: Edge Detectors; Moment invariants; Animate Vision Marr; Finite Element Methods; Shape from Motion; Color: Color Moments Color Histograms Color Autocorrelograms Segmentation: Scene segmentation; Scene Segmentation; Shot detection; OCR: Modeling; Successful OCR deployments; Face: Face Detection algorithms; Neural Networks; EigenFaces ASR: Acoustic analysis; HMMS; N-grams; CSR; LVCSR; Domain Specific; NIST Video TREC Starts Media IR systems Web Media Search
Video Search: Features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Features ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Video TREC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Video TREC ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: Browsing ,[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search: ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object]
Video Search ,[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search ,[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data Web Video Search Traditional Media Search
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object]
 
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object]
Play Video 1 Play Video 2
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Play Video
Opportunities ,[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast
Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast Millions of non-audio Text Data Hundreds of Hours of Audio Data Modeling Framework Milestones
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object]
Opportunities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object]
Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object]
Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Conclusion ,[object Object],[object Object]
Appendix: Leveraging Research & Industrial Communities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Recomendados

Machine learning and multimedia information retrieval
Machine learning and multimedia information retrievalMachine learning and multimedia information retrieval
Machine learning and multimedia information retrievalSi Krishan
 
Multimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.pptMultimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.pptgovintech1
 
Content based video retrieval system
Content based video retrieval systemContent based video retrieval system
Content based video retrieval systemeSAT Publishing House
 
A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)Raphael Troncy
 
Video Indexing And Retrieval
Video Indexing And RetrievalVideo Indexing And Retrieval
Video Indexing And RetrievalYvonne M
 
Multimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and InteractionMultimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and InteractionRaphael Troncy
 
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORYBUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORYJonathon Hare
 
Video Indexing and Retrieval
Video Indexing and RetrievalVideo Indexing and Retrieval
Video Indexing and RetrievalRachmat Wahid Saleh Insani
 

Recomendados

Machine learning and multimedia information retrieval
Machine learning and multimedia information retrievalMachine learning and multimedia information retrieval
Machine learning and multimedia information retrievalSi Krishan
 
Multimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.pptMultimedia content based retrieval slideshare.ppt
Multimedia content based retrieval slideshare.pptgovintech1
 
Content based video retrieval system
Content based video retrieval systemContent based video retrieval system
Content based video retrieval systemeSAT Publishing House
 
A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)A Semantic Multimedia Web (Part 1)
A Semantic Multimedia Web (Part 1)Raphael Troncy
 
Video Indexing And Retrieval
Video Indexing And RetrievalVideo Indexing And Retrieval
Video Indexing And RetrievalYvonne M
 
Multimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and InteractionMultimedia Semantics: Metadata, Analysis and Interaction
Multimedia Semantics: Metadata, Analysis and InteractionRaphael Troncy
 
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORYBUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORY
BUILDING A SCALABLE MULTIMEDIA WEB OBSERVATORYJonathon Hare
 
Video Indexing and Retrieval
Video Indexing and RetrievalVideo Indexing and Retrieval
Video Indexing and RetrievalRachmat Wahid Saleh Insani
 
Semantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisSemantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisAllenWu
 
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...Jonathon Hare
 
Towards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityTowards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityRaphael Troncy
 
Motaz_CV
Motaz_CVMotaz_CV
Motaz_CVMotaz El-Saban
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverviewMotaz El-Saban
 
Kadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A Peker
 
Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)Národní technická knihovna (NTK)
 
Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Arjen de Vries
 
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Jonathon Hare
 
SP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiSP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiJohn Breslin
 
Enhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsEnhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsIJCSIS Research Publications
 
Computer Vision Crash Course
Computer Vision Crash CourseComputer Vision Crash Course
Computer Vision Crash CourseJia-Bin Huang
 
User-centric Networks for Immersive Communication
User-centric Networks for Immersive CommunicationUser-centric Networks for Immersive Communication
User-centric Networks for Immersive Communicationlauratoni4
 
Image and video annotation
Image and video annotationImage and video annotation
Image and video annotationNityJaiswal1
 
Resume
ResumeResume
Resumebutest
 
Big-Data Analytics for Media Management
Big-Data Analytics for Media ManagementBig-Data Analytics for Media Management
Big-Data Analytics for Media Managementtechkrish
 
Deep Learning
Deep LearningDeep Learning
Deep LearningRiri Kusumarani
 
Sign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture AnalysisSign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture Analysispaperpublications3
 
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)Universitat Politècnica de Catalunya
 
Multimedia Information Retrieval
Multimedia Information RetrievalMultimedia Information Retrieval
Multimedia Information RetrievalStephane Marchand-Maillet
 
Calgary Multimedia Company
Calgary Multimedia CompanyCalgary Multimedia Company
Calgary Multimedia Companybrandsmultimedia
 
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...maranlar
 

Más contenido relacionado

La actualidad más candente

Semantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisSemantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisAllenWu
 
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...Jonathon Hare
 
Towards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityTowards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityRaphael Troncy
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverviewMotaz El-Saban
 
Kadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A Peker
 
Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Arjen de Vries
 
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Jonathon Hare
 
SP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiSP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiJohn Breslin
 
Enhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsEnhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsIJCSIS Research Publications
 
Computer Vision Crash Course
Computer Vision Crash CourseComputer Vision Crash Course
Computer Vision Crash CourseJia-Bin Huang
 
User-centric Networks for Immersive Communication
User-centric Networks for Immersive CommunicationUser-centric Networks for Immersive Communication
User-centric Networks for Immersive Communicationlauratoni4
 
Image and video annotation
Image and video annotationImage and video annotation
Image and video annotationNityJaiswal1
 
Resume
ResumeResume
Resumebutest
 
Big-Data Analytics for Media Management
Big-Data Analytics for Media ManagementBig-Data Analytics for Media Management
Big-Data Analytics for Media Managementtechkrish
 
Sign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture AnalysisSign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture Analysispaperpublications3
 

La actualidad más candente (19)

Semantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual AnalysisSemantics In Digital Photos A Contenxtual Analysis
Semantics In Digital Photos A Contenxtual Analysis
 
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
OpenIMAJ and ImageTerrier: Java Libraries and Tools for Scalable Multimedia A...
 
Towards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video AccessibilityTowards Collaborative Annotation for Video Accessibility
Towards Collaborative Annotation for Video Accessibility
 
Motaz_CV
Motaz_CVMotaz_CV
Motaz_CV
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverview
 
Kadir A_20160804_res_tea
Kadir A_20160804_res_teaKadir A_20160804_res_tea
Kadir A_20160804_res_tea
 
Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)Podobnostní hledání v netextových datech (Pavel Zezula)
Podobnostní hledání v netextových datech (Pavel Zezula)
 
Twente ir-course 20-10-2010
Twente ir-course 20-10-2010Twente ir-course 20-10-2010
Twente ir-course 20-10-2010
 
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
Multimodal Searching and Semantic Spaces: ...or how to find images of Dalmati...
 
SP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with GephiSP1: Exploratory Network Analysis with Gephi
SP1: Exploratory Network Analysis with Gephi
 
Enhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart CredentialsEnhancing Social Network Security through Smart Credentials
Enhancing Social Network Security through Smart Credentials
 
Computer Vision Crash Course
Computer Vision Crash CourseComputer Vision Crash Course
Computer Vision Crash Course
 
User-centric Networks for Immersive Communication
User-centric Networks for Immersive CommunicationUser-centric Networks for Immersive Communication
User-centric Networks for Immersive Communication
 
Image and video annotation
Image and video annotationImage and video annotation
Image and video annotation
 
Resume
ResumeResume
Resume
 
Big-Data Analytics for Media Management
Big-Data Analytics for Media ManagementBig-Data Analytics for Media Management
Big-Data Analytics for Media Management
 
Deep Learning
Deep LearningDeep Learning
Deep Learning
 
Sign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture AnalysisSign Language Recognition with Gesture Analysis
Sign Language Recognition with Gesture Analysis
 
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
Speaker ID II (D4L1 Deep Learning for Speech and Language UPC 2017)
 

Destacado

Calgary Multimedia Company
Calgary Multimedia CompanyCalgary Multimedia Company
Calgary Multimedia Companybrandsmultimedia
 
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...maranlar
 
Social in Motion: The Rise of the Video Format
Social in Motion: The Rise of the Video FormatSocial in Motion: The Rise of the Video Format
Social in Motion: The Rise of the Video FormatSpredfast
 
Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3megrobbo95
 
Deal, Brandon R. Resume
Deal, Brandon R. ResumeDeal, Brandon R. Resume
Deal, Brandon R. ResumeBrandon Deal
 
Multimedia information management
Multimedia information managementMultimedia information management
Multimedia information managementSara Egidi
 
Media, Multimedia & Digital Media
Media, Multimedia & Digital MediaMedia, Multimedia & Digital Media
Media, Multimedia & Digital Medianylysy
 
Motion and its description
Motion and its descriptionMotion and its description
Motion and its descriptionindianeducation
 
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ..."Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...ExternalEvents
 
multimedia chapter1
multimedia chapter1multimedia chapter1
multimedia chapter1nes
 
Edtech101report
Edtech101reportEdtech101report
Edtech101reporterwinmate
 
Design, selection and utilization of media
Design, selection and utilization of mediaDesign, selection and utilization of media
Design, selection and utilization of mediaAlaa Sadik
 
Handout: Motion Media
Handout: Motion MediaHandout: Motion Media
Handout: Motion Mediaaquino_lca
 
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...Arniel Ping
 
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...Arniel Ping
 
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...Arniel Ping
 
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...Arniel Ping
 
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...Arniel Ping
 

Destacado (20)

Multimedia Information Retrieval
Multimedia Information RetrievalMultimedia Information Retrieval
Multimedia Information Retrieval
 
Calgary Multimedia Company
Calgary Multimedia CompanyCalgary Multimedia Company
Calgary Multimedia Company
 
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
Multimedia Information Retrieval: Bytes and pixels meet the challenges of hum...
 
Social in Motion: The Rise of the Video Format
Social in Motion: The Rise of the Video FormatSocial in Motion: The Rise of the Video Format
Social in Motion: The Rise of the Video Format
 
Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3Motion graphics and_compositing_video_analysis_worksheet_3
Motion graphics and_compositing_video_analysis_worksheet_3
 
Deal, Brandon R. Resume
Deal, Brandon R. ResumeDeal, Brandon R. Resume
Deal, Brandon R. Resume
 
Multimedia information management
Multimedia information managementMultimedia information management
Multimedia information management
 
Media, Multimedia & Digital Media
Media, Multimedia & Digital MediaMedia, Multimedia & Digital Media
Media, Multimedia & Digital Media
 
Motion and its description
Motion and its descriptionMotion and its description
Motion and its description
 
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ..."Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
"Cahier de charges couscous salé de mil de l’île de Fadouth (Sentinelle Slow ...
 
multimedia chapter1
multimedia chapter1multimedia chapter1
multimedia chapter1
 
Multimedia database
Multimedia databaseMultimedia database
Multimedia database
 
Edtech101report
Edtech101reportEdtech101report
Edtech101report
 
Design, selection and utilization of media
Design, selection and utilization of mediaDesign, selection and utilization of media
Design, selection and utilization of media
 
Handout: Motion Media
Handout: Motion MediaHandout: Motion Media
Handout: Motion Media
 
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
Media and Information Literacy (MIL) 4.MIL Media Literacy (Part 1)- Definitio...
 
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
Media and Information Literacy (MIL) - 6. Media and Information Languages (Pa...
 
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
Media and Information Literacy (MIL) - 10. Media and Information Literate Ind...
 
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
Media and Information Literacy (MIL) - Intellectual Property, Fair Use, and C...
 
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
Media and Information Literacy (MIL) 1. Introduction to Media and Informatio...
 

Similar a Multimedia Information Retrieval: What is it, and why isn't ...

Similarity-based retrieval of multimedia content
Similarity-based retrieval of multimedia contentSimilarity-based retrieval of multimedia content
Similarity-based retrieval of multimedia contentSymeon Papadopoulos
 
Interactive Video Search: Where is the User in the Age of Deep Learning?
Interactive Video Search: Where is the User in the Age of Deep Learning?Interactive Video Search: Where is the User in the Age of Deep Learning?
Interactive Video Search: Where is the User in the Age of Deep Learning?klschoef
 
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...MaRS Discovery District
 
New coding techniques, standardisation, and quality metrics
New coding techniques, standardisation, and quality metricsNew coding techniques, standardisation, and quality metrics
New coding techniques, standardisation, and quality metricsTouradj Ebrahimi
 
Digital Signage Explained
Digital Signage ExplainedDigital Signage Explained
Digital Signage Explainedt1mrv1
 
Wearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesWearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesJeffrey Funk
 
How to Enhance Your Career with AI
How to Enhance Your Career with AIHow to Enhance Your Career with AI
How to Enhance Your Career with AIKeita Broadwater
 
A Semantic Multimedia Web: Create, Annotate, Present and Share your Media
A Semantic Multimedia Web: Create, Annotate, Present and Share your MediaA Semantic Multimedia Web: Create, Annotate, Present and Share your Media
A Semantic Multimedia Web: Create, Annotate, Present and Share your MediaRaphael Troncy
 
37 million reasons to give a damn about the disabled
37 million reasons to give a damn about the disabled37 million reasons to give a damn about the disabled
37 million reasons to give a damn about the disabledChris Merkel
 
Video Analytics on Hadoop webinar victor fang-201309
Video Analytics on Hadoop webinar victor fang-201309Video Analytics on Hadoop webinar victor fang-201309
Video Analytics on Hadoop webinar victor fang-201309DrVictorFang
 
Big Video Data Revolution, Challenges Unresolved
Big Video Data Revolution, Challenges UnresolvedBig Video Data Revolution, Challenges Unresolved
Big Video Data Revolution, Challenges UnresolvedAlbert Y. C. Chen
 
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...multimediaeval
 
AI for voice recognition.pptx
AI for voice recognition.pptxAI for voice recognition.pptx
AI for voice recognition.pptxJhalakDashora
 
Automatic multi-modal metadata annotation based on trained cognitive solution...
Automatic multi-modal metadata annotation based on trained cognitive solution...Automatic multi-modal metadata annotation based on trained cognitive solution...
Automatic multi-modal metadata annotation based on trained cognitive solution...FIAT/IFTA
 
110419 ENSWERS INTRODUCTION
110419 ENSWERS INTRODUCTION110419 ENSWERS INTRODUCTION
110419 ENSWERS INTRODUCTIONJack Kim
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalEmTech
 
Introduction
IntroductionIntroduction
IntroductionKh Ravy
 
Multimediaexercise
MultimediaexerciseMultimediaexercise
MultimediaexerciseRony Mohamed
 

Similar a Multimedia Information Retrieval: What is it, and why isn't ... (20)

Guru_poster
Guru_posterGuru_poster
Guru_poster
 
Similarity-based retrieval of multimedia content
Similarity-based retrieval of multimedia contentSimilarity-based retrieval of multimedia content
Similarity-based retrieval of multimedia content
 
Interactive Video Search: Where is the User in the Age of Deep Learning?
Interactive Video Search: Where is the User in the Age of Deep Learning?Interactive Video Search: Where is the User in the Age of Deep Learning?
Interactive Video Search: Where is the User in the Age of Deep Learning?
 
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
Deep Learning: Changing the Playing Field of Artificial Intelligence - MaRS G...
 
New coding techniques, standardisation, and quality metrics
New coding techniques, standardisation, and quality metricsNew coding techniques, standardisation, and quality metrics
New coding techniques, standardisation, and quality metrics
 
Digital Signage Explained
Digital Signage ExplainedDigital Signage Explained
Digital Signage Explained
 
Wearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer InterfacesWearable Computing and Human Computer Interfaces
Wearable Computing and Human Computer Interfaces
 
How to Enhance Your Career with AI
How to Enhance Your Career with AIHow to Enhance Your Career with AI
How to Enhance Your Career with AI
 
A Semantic Multimedia Web: Create, Annotate, Present and Share your Media
A Semantic Multimedia Web: Create, Annotate, Present and Share your MediaA Semantic Multimedia Web: Create, Annotate, Present and Share your Media
A Semantic Multimedia Web: Create, Annotate, Present and Share your Media
 
37 million reasons to give a damn about the disabled
37 million reasons to give a damn about the disabled37 million reasons to give a damn about the disabled
37 million reasons to give a damn about the disabled
 
Video Analytics on Hadoop webinar victor fang-201309
Video Analytics on Hadoop webinar victor fang-201309Video Analytics on Hadoop webinar victor fang-201309
Video Analytics on Hadoop webinar victor fang-201309
 
Big Video Data Revolution, Challenges Unresolved
Big Video Data Revolution, Challenges UnresolvedBig Video Data Revolution, Challenges Unresolved
Big Video Data Revolution, Challenges Unresolved
 
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
MediaEval 2016 - COSMIR and the OpenMIC Challenge: A Plan for Sustainable Mus...
 
AI for voice recognition.pptx
AI for voice recognition.pptxAI for voice recognition.pptx
AI for voice recognition.pptx
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Automatic multi-modal metadata annotation based on trained cognitive solution...
Automatic multi-modal metadata annotation based on trained cognitive solution...Automatic multi-modal metadata annotation based on trained cognitive solution...
Automatic multi-modal metadata annotation based on trained cognitive solution...
 
110419 ENSWERS INTRODUCTION
110419 ENSWERS INTRODUCTION110419 ENSWERS INTRODUCTION
110419 ENSWERS INTRODUCTION
 
Raskar Emtech2010 Mar Final
Raskar Emtech2010 Mar FinalRaskar Emtech2010 Mar Final
Raskar Emtech2010 Mar Final
 
Introduction
IntroductionIntroduction
Introduction
 
Multimediaexercise
MultimediaexerciseMultimediaexercise
Multimediaexercise
 

Más de webhostingguy

Running and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test FrameworkRunning and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test Frameworkwebhostingguy
 
MySQL and memcached Guide
MySQL and memcached GuideMySQL and memcached Guide
MySQL and memcached Guidewebhostingguy
 
Novell® iChain® 2.3
Novell® iChain® 2.3Novell® iChain® 2.3
Novell® iChain® 2.3webhostingguy
 
Load-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web serversLoad-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web serverswebhostingguy
 
SQL Server 2008 Consolidation
SQL Server 2008 ConsolidationSQL Server 2008 Consolidation
SQL Server 2008 Consolidationwebhostingguy
 
Master Service Agreement
Master Service AgreementMaster Service Agreement
Master Service Agreementwebhostingguy
 
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...webhostingguy
 
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...webhostingguy
 
Managing Diverse IT Infrastructure
Managing Diverse IT InfrastructureManaging Diverse IT Infrastructure
Managing Diverse IT Infrastructurewebhostingguy
 
Web design for business.ppt
Web design for business.pptWeb design for business.ppt
Web design for business.pptwebhostingguy
 
IT Power Management Strategy
IT Power Management Strategy IT Power Management Strategy
IT Power Management Strategy webhostingguy
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandiserswebhostingguy
 
Parallels Hosting Products
Parallels Hosting ProductsParallels Hosting Products
Parallels Hosting Productswebhostingguy
 
Microsoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 MbMicrosoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 Mbwebhostingguy
 

Más de webhostingguy (20)

File Upload
File UploadFile Upload
File Upload
 
Running and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test FrameworkRunning and Developing Tests with the Apache::Test Framework
Running and Developing Tests with the Apache::Test Framework
 
MySQL and memcached Guide
MySQL and memcached GuideMySQL and memcached Guide
MySQL and memcached Guide
 
Novell® iChain® 2.3
Novell® iChain® 2.3Novell® iChain® 2.3
Novell® iChain® 2.3
 
Load-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web serversLoad-balancing web servers Load-balancing web servers
Load-balancing web servers Load-balancing web servers
 
SQL Server 2008 Consolidation
SQL Server 2008 ConsolidationSQL Server 2008 Consolidation
SQL Server 2008 Consolidation
 
What is mod_perl?
What is mod_perl?What is mod_perl?
What is mod_perl?
 
What is mod_perl?
What is mod_perl?What is mod_perl?
What is mod_perl?
 
Master Service Agreement
Master Service AgreementMaster Service Agreement
Master Service Agreement
 
Notes8
Notes8Notes8
Notes8
 
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...PHP and MySQL PHP Written as a set of CGI binaries in C in ...
PHP and MySQL PHP Written as a set of CGI binaries in C in ...
 
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...Dell Reference Architecture Guide Deploying Microsoft® SQL ...
Dell Reference Architecture Guide Deploying Microsoft® SQL ...
 
Managing Diverse IT Infrastructure
Managing Diverse IT InfrastructureManaging Diverse IT Infrastructure
Managing Diverse IT Infrastructure
 
Web design for business.ppt
Web design for business.pptWeb design for business.ppt
Web design for business.ppt
 
IT Power Management Strategy
IT Power Management Strategy IT Power Management Strategy
IT Power Management Strategy
 
Excel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for MerchandisersExcel and SQL Quick Tricks for Merchandisers
Excel and SQL Quick Tricks for Merchandisers
 
OLUG_xen.ppt
OLUG_xen.pptOLUG_xen.ppt
OLUG_xen.ppt
 
Parallels Hosting Products
Parallels Hosting ProductsParallels Hosting Products
Parallels Hosting Products
 
Microsoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 MbMicrosoft PowerPoint presentation 2.175 Mb
Microsoft PowerPoint presentation 2.175 Mb
 
Reseller's Guide
Reseller's GuideReseller's Guide
Reseller's Guide
 

Multimedia Information Retrieval: What is it, and why isn't ...

  • 1. Video Search: Opportunities and Challenges Keynote Speech at ACM MIR Workshop ACM Multimedia Conference 2005 Singapore Dr. Ramesh R. Sarukkai Yahoo! Search { [email_address] [email_address] }
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16. Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data
  • 17.
  • 18.
  • 19.
  • 20.
  • 21. Video Search: Features 1970 2000 1990 1980 2010 Texture: Autocorrelation; Wavelet transforms; Gabor Filters Shape: Edge Detectors; Moment invariants; Animate Vision Marr; Finite Element Methods; Shape from Motion; Color: Color Moments Color Histograms Color Autocorrelograms Segmentation: Scene segmentation; Scene Segmentation; Shot detection; OCR: Modeling; Successful OCR deployments; Face: Face Detection algorithms; Neural Networks; EigenFaces ASR: Acoustic analysis; HMMS; N-grams; CSR; LVCSR; Domain Specific; NIST Video TREC Starts Media IR systems Web Media Search
  • 22.
  • 23.
  • 24.
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36. Video Search Meta-Content Video Production Unstructured Data Video Consumption /Community Content Features + Meta-Content Structured + Unstructured Data Web Video Search Traditional Media Search
  • 37.
  • 38.
  • 39.  
  • 40.
  • 41.  
  • 42.
  • 43. Play Video 1 Play Video 2
  • 44.
  • 46.
  • 47.
  • 48. Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast
  • 49. Opportunities 1970 2000 1990 1980 2010 Acoustic Modeling Vocal Tract Modeling Formant Analysis DSP: FFT, MFCC Digit Recognizers Viterbi search; HMMs Sub-phonetic Models FSMs, Grammars, Statistical N-grams Digit Recognition; Small Vocabulary Discrete Medium Vocabulary Continuous Large Vocabulary Continuous LVCSR Telephony/Broadcast Millions of non-audio Text Data Hundreds of Hours of Audio Data Modeling Framework Milestones
  • 50.
  • 51.
  • 52.
  • 53.
  • 54.
  • 55.
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61.
  • 62.
  • 63.
  • 64.
  • 65.
  • 66.
  • 67.
  • 68.
  • 69.
  • 70.
  • 71.
  • 72.
  • 73.
  • 74.