SlideShare una empresa de Scribd logo
1 de 21
The state of semantic technology today: overview of the first SEALS evaluation campaings Lyndon Nixon , STI International Raul Garcia-Castro , Universidad Politécnica de Madrid Stuart Wrigley , University of Sheffield Mikalai Yatskevich , University of Oxford Cassia Trojahn , INRIA Liliana Cabral , The Open University 07.09.11
Outline ,[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
SEALS  (Semantic Evaluation At Large Scale) Universidad Politécnica de Madrid, Spain (Coordinator) University of Sheffield, UK Forschungszentrum Informatik, Germany University of Innsbruck, Austria Institut National de Recherche en  Informatique et en Automatique,  France University of Mannheim, Germany University of Zurich, Switzerland STI International, Austria Open University, UK Oxford University, UK Contact person:  Asunción Gómez Pérez <asun@fi.upm.es> http://www.seals-project.eu/ Duration:  June 2009-May 2012 I-SEMANTICS 2011 1 3 1 2 1 2
SEALS Objectives ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Service  Activities Research  Activities Networking  Activities I-SEMANTICS 2011
The SEALS Platform ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
SEALS  Service Manager Runtime   Evaluation Service SEALS Portal Test Data  Repository  Tools  Repository  Results  Repository  Evaluation Descriptions Repository  Technology Adopters Software agents, i.e.,  technology evaluators SEALS Repositories The SEALS Platform Evaluation organizers I-SEMANTICS 2011 Technology Providers Entity  management  requests Evaluation requests
The Evaluation Process ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
The SEALS Evaluation Campaigns 2010 Next evaluation campaigns during 2011 - 2012 Ontology Engineering Tools Reasoning Tools Ontology Matching Tools Semantic Search Tools Semantic Web Service Tools OET Conformance 2010 Conformance OET Interoperability 2010 Interoperability OET Scalability 2010 Efficiency Scalability DLBS Classification 2010 DLBS Class satisfiability 2010 DLBS Ontology satisfiability 2010 DLBS Logical entailment 2010 MT Benchmark 2010  Compliance  Efficiency  MT Anatomy 2010  Compliance Efficiency  MT Conference 2010   Compliance  Efficiency  Alignment coherence SST Automated Search Performance 2010 Search quality SST Automated Performance and Scalability 2010  Resource consumption SST Automated Query Expressiveness 2010 Query expressiveness SST Automated Quality of Documentation 2010 Usability SST User Usability 2010  Usability SST User Query Expressiveness 2010 Query expressiveness SWS Tool Discovery Evaluation 2010 : Performance
Ontology Engineering Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
Ontology Engineering Results ,[object Object],I-SEMANTICS 2011
Storage and Reasoning Tools  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
Storage and Reasoning Results ,[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
Ontology Matching Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
Matching Tools ,[object Object],[object Object],[object Object],I-SEMANTICS 2011
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Ontology Matching Tools I-SEMANTICS 2011
Semantic Search Tools ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
[object Object],[object Object],[object Object],[object Object],Semantic Search Results I-SEMANTICS 2011 Tool  UITL  Auto  K-Search  x  x Ginseng x  x  NLP-Reduce x  x  Jena Arq   x  PowerAqua x  x 
Semantic Web Services ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
Semantic Web Services Results ,[object Object],[object Object],[object Object],I-SEMANTICS 2011
Coming next: 2nd campaign ,[object Object],[object Object],[object Object],[object Object],I-SEMANTICS 2011
Thank you for your attention ,[object Object],[object Object],I-SEMANTICS 2011

Más contenido relacionado

Similar a SEALS @ I-Semantics 2011

1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...
1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...
1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...
SEALS - Semantic Evaluation at Large Scale
 
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software SystemsQUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
Tom Mens
 
Education Data Standards Overview
Education Data Standards OverviewEducation Data Standards Overview
Education Data Standards Overview
Frank Walsh
 
Quality Analyst with 5 yrs Exp
Quality Analyst with 5 yrs ExpQuality Analyst with 5 yrs Exp
Quality Analyst with 5 yrs Exp
Justin Jacob
 
umakantpanjray_4_ year exp_testing
umakantpanjray_4_ year exp_testingumakantpanjray_4_ year exp_testing
umakantpanjray_4_ year exp_testing
umakant panjraye
 
Software testing automation a comparative study on productivity rate of ope...
Software testing automation   a comparative study on productivity rate of ope...Software testing automation   a comparative study on productivity rate of ope...
Software testing automation a comparative study on productivity rate of ope...
Conference Papers
 
MD Tareque Automation
MD Tareque AutomationMD Tareque Automation
MD Tareque Automation
MD Tareque
 
Continuous Improvement for Testers, TMF 201102
Continuous Improvement for Testers, TMF 201102Continuous Improvement for Testers, TMF 201102
Continuous Improvement for Testers, TMF 201102
Farid Vaswani
 

Similar a SEALS @ I-Semantics 2011 (20)

1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...
1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...
1st SEALS evaluation campaign results: a worldwide evaluation of semantic tec...
 
Solo Requisitos 2008 - 07 Upc
Solo Requisitos 2008 - 07 UpcSolo Requisitos 2008 - 07 Upc
Solo Requisitos 2008 - 07 Upc
 
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software SystemsQUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
QUALGEN: Modeling and Analysing the Quality of Evolving Software Systems
 
Epic2011 Assessement Portfolios
Epic2011 Assessement PortfoliosEpic2011 Assessement Portfolios
Epic2011 Assessement Portfolios
 
MIT521 software testing (2012) v2
MIT521   software testing  (2012) v2MIT521   software testing  (2012) v2
MIT521 software testing (2012) v2
 
Education Data Standards Overview
Education Data Standards OverviewEducation Data Standards Overview
Education Data Standards Overview
 
Quality Analyst with 5 yrs Exp
Quality Analyst with 5 yrs ExpQuality Analyst with 5 yrs Exp
Quality Analyst with 5 yrs Exp
 
Hitesh lalwani resume
Hitesh lalwani resumeHitesh lalwani resume
Hitesh lalwani resume
 
Introducing the HOBBIT platform into the Ontology Alignment Evaluation Campaign
Introducing the HOBBIT platform into the Ontology Alignment Evaluation CampaignIntroducing the HOBBIT platform into the Ontology Alignment Evaluation Campaign
Introducing the HOBBIT platform into the Ontology Alignment Evaluation Campaign
 
M Ravichandran_V2
M Ravichandran_V2M Ravichandran_V2
M Ravichandran_V2
 
umakantpanjray_4_ year exp_testing
umakantpanjray_4_ year exp_testingumakantpanjray_4_ year exp_testing
umakantpanjray_4_ year exp_testing
 
Enhanced Feature Analysis Framework for Comparative Analysis & Evaluation of ...
Enhanced Feature Analysis Framework for Comparative Analysis & Evaluation of ...Enhanced Feature Analysis Framework for Comparative Analysis & Evaluation of ...
Enhanced Feature Analysis Framework for Comparative Analysis & Evaluation of ...
 
Software testing automation a comparative study on productivity rate of ope...
Software testing automation   a comparative study on productivity rate of ope...Software testing automation   a comparative study on productivity rate of ope...
Software testing automation a comparative study on productivity rate of ope...
 
Importance of Testing in SDLC
Importance of Testing in SDLCImportance of Testing in SDLC
Importance of Testing in SDLC
 
MD Tareque Automation
MD Tareque AutomationMD Tareque Automation
MD Tareque Automation
 
A Method for Evaluating End-User Development Technologies
A Method for Evaluating End-User Development TechnologiesA Method for Evaluating End-User Development Technologies
A Method for Evaluating End-User Development Technologies
 
Ijetcas14 413
Ijetcas14 413Ijetcas14 413
Ijetcas14 413
 
Continuous Improvement for Testers, TMF 201102
Continuous Improvement for Testers, TMF 201102Continuous Improvement for Testers, TMF 201102
Continuous Improvement for Testers, TMF 201102
 
Leveraging Open Source Automation: A Selenium WebDriver Example
Leveraging Open Source Automation: A Selenium WebDriver ExampleLeveraging Open Source Automation: A Selenium WebDriver Example
Leveraging Open Source Automation: A Selenium WebDriver Example
 
Test Automation Maturity: A Self-Assessment Tool
Test Automation Maturity: A Self-Assessment ToolTest Automation Maturity: A Self-Assessment Tool
Test Automation Maturity: A Self-Assessment Tool
 

Último

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 

Último (20)

Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 

SEALS @ I-Semantics 2011

  • 1. The state of semantic technology today: overview of the first SEALS evaluation campaings Lyndon Nixon , STI International Raul Garcia-Castro , Universidad Politécnica de Madrid Stuart Wrigley , University of Sheffield Mikalai Yatskevich , University of Oxford Cassia Trojahn , INRIA Liliana Cabral , The Open University 07.09.11
  • 2.
  • 3. SEALS (Semantic Evaluation At Large Scale) Universidad Politécnica de Madrid, Spain (Coordinator) University of Sheffield, UK Forschungszentrum Informatik, Germany University of Innsbruck, Austria Institut National de Recherche en Informatique et en Automatique, France University of Mannheim, Germany University of Zurich, Switzerland STI International, Austria Open University, UK Oxford University, UK Contact person: Asunción Gómez Pérez <asun@fi.upm.es> http://www.seals-project.eu/ Duration: June 2009-May 2012 I-SEMANTICS 2011 1 3 1 2 1 2
  • 4.
  • 5.
  • 6. SEALS Service Manager Runtime Evaluation Service SEALS Portal Test Data Repository Tools Repository Results Repository Evaluation Descriptions Repository Technology Adopters Software agents, i.e., technology evaluators SEALS Repositories The SEALS Platform Evaluation organizers I-SEMANTICS 2011 Technology Providers Entity management requests Evaluation requests
  • 7.
  • 8. The SEALS Evaluation Campaigns 2010 Next evaluation campaigns during 2011 - 2012 Ontology Engineering Tools Reasoning Tools Ontology Matching Tools Semantic Search Tools Semantic Web Service Tools OET Conformance 2010 Conformance OET Interoperability 2010 Interoperability OET Scalability 2010 Efficiency Scalability DLBS Classification 2010 DLBS Class satisfiability 2010 DLBS Ontology satisfiability 2010 DLBS Logical entailment 2010 MT Benchmark 2010 Compliance Efficiency MT Anatomy 2010 Compliance Efficiency MT Conference 2010 Compliance Efficiency Alignment coherence SST Automated Search Performance 2010 Search quality SST Automated Performance and Scalability 2010 Resource consumption SST Automated Query Expressiveness 2010 Query expressiveness SST Automated Quality of Documentation 2010 Usability SST User Usability 2010 Usability SST User Query Expressiveness 2010 Query expressiveness SWS Tool Discovery Evaluation 2010 : Performance
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20.
  • 21.

Notas del editor

  1. The SEALS platform is composed of seven components, four vertical components each one devoted to deal with the management of a SEALS entitiy, and two horizontal components, the first one devoted to the integration and coordination of the rest of the components, and the other devoted to the execution of the evaluations. The las t one is the SEALS portal that will be the UI of the platform. And this is how the different components are meant to be related to each other. The users will use the SEALS portal to submit entitiy management requests to the SEALS service manager, which will redirect to the appropriate entity management component. The user will also use the portal to submit evaluation requests to the SEALS service manager, which will forward the request to the Runtime Evaluation Service.