This is a one year old keynote I gave on my thoughts about challenges in multimedia search and a high level description of JPSearch standard. JPSearch has been progressing further since then, but responding to frequent and popular demands, I am sharing these with you!
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
Keynote speech at COST 292 final workshop on future of multimedia search and retrieval with emphasis on JPEsearch
1. The Future of Multimedia !
Retrieval Research !
The Good, The Bad, !
and The Ugly !
Touradj Ebrahimi!
Multimedia Signal Processing Group!
EPFL!
Touradj.Ebrahimi@epfl.ch!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
2. A two decade old dream …!
Search, and retrieve multimedia content
as easily as for text!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
3. The
Good!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
4. The Good!
Text (keyword) based multimedia search
works to some extent!
Searching based on text around
images on the Web!
Social tagging!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
5. The Good!
Tremendous progress in the performance of
multimedia content analysis during the past
decade!
TRECVID!
Huge financial incentives !
Video surveillance for security!
Business models around search and retrieval on
the web!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
6. The Good!
Increasing efforts in standardization!
MPEG-7 in MPEG!
JPSearch in JPEG!
CB-Search in MPEG!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
7. JPSearch in a nutshell!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
8. OSI Layers!
Structure!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
10. JPSearch
Structure
and Parts!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
11. JPSearch Workplan!
Part Title WD PDTR DTR TR
1 System framework and components 05/07 06/07 07/04 07/07
Part Title WD CD FCD FDIS IS
Schema and ontology registration and
2 08/07 09/01 09/07 09/10 10/04
identification
3 JPSearch Query Format -- 08/07 08/10 09/04 09/07
4 Metadata embedded in image data (JPEG and 08/03 08/07 09/04 09/10 10/04
JPEG 2000) file format
5 Data interchange format between image 08/03 09/01 09/07 09/10 10/04
repositories
(following ISO procedures - WD: Working Draft; PDTR: Proposed Draft Technical Report; DTR: Draft
Technical Report; TR: Technical Report; CD: Committee Draft; FCD: Final Committee Draft; FDIS: Final
Draft International Standard; IS: International Standard)!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
12. JPSearch Part 1!
Part-1: Framework and system components: !
This is a technical report which provides a global view of
JPSearch. In particular, it describes a number of use cases to
identify user needs and requirements. It then introduces the
JPSearch architecture. Finally, the technical report outlines
the organization of the JPSearch specification!
Status: !
" " "Technical Report issued in July 2007!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
13. JPSearch Part 2!
Part-2: Schema and ontology registration and
identification: !
This part standardizes a platform-independent format for the
import, export and exchange of ontologies. It also defines a
registry of ontologies which can be imported into a JPSearch
compliant system.!
Status:!
" " "Working Draft issued in July 2008!
" " "Committee Draft planned in January 2009!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
14. JPSearch Part 3!
Part-3: JPSearch query format: !
This part provides three standardized functionalities between users
and image repositories: to allow users to express their search criteria,
to describe the aggregated return result sets for user presentation or
machine consumption, and to define query management processes
such as relevance feedback. !
Status: !
" " "Final Committee Draft issue in October 2008!
" " "Final Draft International Standard planned in
April 2009 !
COST 292 Workshop!
November 28th, 2008, Lyon, France!
15. JPSearch Part 4!
Part-4: Metadata embedded in image data (JPEG-1
and JPEG-2000) file format: !
This part specifies image data exchange format with
associated metadata to accelerate the re-use of metadata. It
supports two functionalities, namely the mobility of
metadata and the persistent association of metadata with
image.!
Status:!
" " "Committee Draft issued in July 2008!
" " "Final Committee Draft planned in April 2009!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
16. JPSearch Part 5!
Part-5: Data interchange format between image
repositories: !
This part standardizes a format for the exchange of image
collections and respective metadata between JPSearch
compliant repositories. It enables the synchronization of
repositories in order to facilitate simple and fully
interoperable exchange across different devices and platforms. !
Status: !
" " "Working Draft issued in March 2008!
" " "Committee Draft planned in January 2009!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
17. Further information!
Last meeting: October 2008 in Busan,
South Korea!
Next meeting: January 2009 in San
Francisco, USA!
Website: http://www.jpeg.org!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
19. The Bad!
The semantic gap is still here and won’t close
any soon!
Virtually all big success stories in multimedia
search and retrieval are based on text (keyword)!
Performance of low level multimedia content
analysis is still often immature for prime time
applications!
People tagging in google’s Picasa!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
20. Theserious ! and successful application based on
No
Bad
MPEG-7 after eight years since its
standardization!
Has MPEG-7 failed because it standardized too little, too
deep, too early ?!
Will JPSearch approach be more successful?!
Major search and retrieval companies are
uninterested in standardization of multimedia
retrieval solutions!
To avoid competition?!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
21. The !
Ugly!
COST 292 Workshop!
November 28th, 2008, Lyon, France!
22. The Ugly!
Privacy issues in multimedia search and
retrieval!
Content rights issues in multimedia search and
retrieval!
Will the major search companies redefine and
steer the future of culture and information in
society?!
No or too little research in technologies to counter
these side effects !
COST 292 Workshop!
November 28th, 2008, Lyon, France!
23. Thank you for your attention!
And looking forward to a fruitful discussion!
COST 292 Workshop!
November 28th, 2008, Lyon, France!