Languages are inherently ambiguous. Four out of five words
in English have more than one meaning. Nowadays there is a growing
number of small proprietary thesauri used for knowledge management
for different applications. In order to enable the usage of these thesauri
for automatic text annotations, we introduce a robust method for dis-
criminating word senses using hypernyms. The method uses collocations
to induce word senses and to discriminate the thesaural sense from the
other senses by utilizing hypernym entries taken from a thesaurus. The
main novelty of this work is the usage of hypernyms already at the stage
sense induction. The hypernyms enable us to cast the task to a binary
scenario, namely teasing apart thesaural senses from all the rest. The
introduced method outperforms the baseline and has indicates accuracy
above 80%.
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Discrimination of Word Senses with Hypernyms
1. Discrimination of Word Senses with Hypernyms
Artem Revenko Victor Mireles
research@semantic-web.com
LD4IE @ ISWC
October 22, 2017
2. Problem Statement Method Experimental Results
Problem Statement
Method
Experimental Results
2 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
3. Problem Statement Method Experimental Results
Finding Mentioned Entity
A Knowledge Base
Thing
Animal
Jaguar
Car
BMW
Jaguar
BMW has designed a
car that is going to drive
Jaguar X1 out of the
market.
3 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
4. Problem Statement Method Experimental Results
Finding Mentioned Entity
A Knowledge Base
Thing
Animal
Jaguar
Car
BMW
Jaguar
BMW has designed a
car that is going to drive
Jaguar X1 out of the
market.
3 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
5. Problem Statement Method Experimental Results
Finding Mentioned Entity
A Knowledge Base
Thing
Animal
Jaguar
BMW has designed a car
that is going to drive
Jaguar X1 out of the
market.
?
4 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
6. Problem Statement Method Experimental Results
PoolParty poolparty.biz
Entity Matching for Enabling Search
5 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
7. Problem Statement Method Experimental Results
Problem Statement
Input:
Thesaurus
A
B
C
D
Target Entity
C with
different labels li
Corpus
l1
l2
. . .
lN
6 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
8. Problem Statement Method Experimental Results
Problem Statement
Input:
Thesaurus
A
B
C
D
Target Entity
C with
different labels li
Corpus
l1
l2
. . .
lN
Output:
“This” Corpus
C
C
. . .
“Other” Corpus
C
C
. . .
6 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
9. Problem Statement Method Experimental Results
Problem Statement
Method
Experimental Results
7 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
10. Problem Statement Method Experimental Results
Overall Description
Plan
1. Find all senses of the target E
Describing Senses
You shall know a word by the company it keeps.
Firth, J. R. 1957
8 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
11. Problem Statement Method Experimental Results
Overall Description
Plan
1. Find all senses of the target E
1 Represent senses space
Describing Senses
You shall know a word by the company it keeps.
Firth, J. R. 1957
8 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
12. Problem Statement Method Experimental Results
Overall Description
Plan
1. Find all senses of the target E
1 Represent senses space
2 Introduce information from the knowledge base
Describing Senses
You shall know a word by the company it keeps.
Firth, J. R. 1957
8 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
13. Problem Statement Method Experimental Results
Overall Description
Plan
1. Find all senses of the target E
1 Represent senses space
2 Introduce information from the knowledge base
3 Cluster senses
Describing Senses
You shall know a word by the company it keeps.
Firth, J. R. 1957
8 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
14. Problem Statement Method Experimental Results
Overall Description
Plan
1. Find all senses of the target E
1 Represent senses space
2 Introduce information from the knowledge base
3 Cluster senses
2. Disambiguate the senses
Describing Senses
You shall know a word by the company it keeps.
Firth, J. R. 1957
8 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
15. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
0.2
0.15
0.12 0.1
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
16. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
17. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
18. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
Sense1
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
19. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
Sense1
Sense2
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
20. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
Hypernym
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
21. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
Hypernym
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
“This” Sense
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
22. Problem Statement Method Experimental Results
Word Sense Induction
Entity
Term1Term2
Term3
Term4
Term5
Term6
Hypernym
0.2
0.15
0.12 0.1
0.22
0.16
0.2
0.1
0.2
“This” Sense
“Other” Sense
9 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
23. Problem Statement Method Experimental Results
Example
Americano
45 texts: 13 about cocktail, 32 about coffee.
Potential hubs:
1. “campari”
2. “mix”
3. “espresso”
10 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
24. Problem Statement Method Experimental Results
Example
Americano
45 texts: 13 about cocktail, 32 about coffee.
Potential hubs:
1. “campari”
2. “mix”
3. “espresso”
With hypernyms cocktail, Mixed drink, The Unforgettables: mix .
10 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
25. Problem Statement Method Experimental Results
Example
Americano
45 texts: 13 about cocktail, 32 about coffee.
Potential hubs:
1. “campari”
2. “mix”
3. “espresso”
With hypernyms cocktail, Mixed drink, The Unforgettables: mix .
Reorder potential hubs:
1. “espresso”
2. “campari”
10 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
26. Problem Statement Method Experimental Results
Example
Americano
45 texts: 13 about cocktail, 32 about coffee.
Potential hubs:
1. “campari”
2. “mix”
3. “espresso”
With hypernyms cocktail, Mixed drink, The Unforgettables: mix .
Reorder potential hubs:
1. “espresso”
2. “campari”
Final hubs: mix , espresso .
10 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
27. Problem Statement Method Experimental Results
Problem Statement
Method
Experimental Results
11 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
28. Problem Statement Method Experimental Results
Setup
Data: github.com/artreven/thesaural_wsi
Wikilinks http://www.iesl.cs.umass.edu/data/wiki-links
Document URL surface form (label) wiki/concept
12 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
29. Problem Statement Method Experimental Results
Setup
Data: github.com/artreven/thesaural_wsi
Wikilinks http://www.iesl.cs.umass.edu/data/wiki-links
Document URL surface form (label) wiki/concept
Cocktails
Knowledge base 250 concepts about cocktails
Corpora 13 corpora, 1227 texts.
Examples Americano, B52, Margarita, . . .
12 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
30. Problem Statement Method Experimental Results
Setup
Data: github.com/artreven/thesaural_wsi
Wikilinks http://www.iesl.cs.umass.edu/data/wiki-links
Document URL surface form (label) wiki/concept
Cocktails
Knowledge base 250 concepts about cocktails
Corpora 13 corpora, 1227 texts.
Examples Americano, B52, Margarita, . . .
MeSH
Knowledge base 28000 concepts about cocktails
Corpora 8 corpora, 784 texts.
Examples Amnesia, Vertigo, . . .
12 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
31. Problem Statement Method Experimental Results
Evaluation
Cocktails
Method Macro average Micro average
Baseline 0.725 0.737
HyperLex 0.784 0.821
HyperHyperLex 0.841 0.896
13 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
32. Problem Statement Method Experimental Results
Evaluation
Cocktails
Method Macro average Micro average
Baseline 0.725 0.737
HyperLex 0.784 0.821
HyperHyperLex 0.841 0.896
MeSH
Method Macro average Micro average
Baseline 0.68 0.735
HyperLex 0.617 0.621
HyperHyperLex 0.723 0.739
13 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
33. Problem Statement Method Experimental Results
Conclusion
Link to domain specific knowledge base without having
knowledge of all senses!
Combined unsupervised / knowledge-based approach
Takes knowledge graph into account, but no external resources
Thank you!Thank you!
research.semantic-web.at
14 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
34. Problem Statement Method Experimental Results
Conclusion
Link to domain specific knowledge base without having
knowledge of all senses!
Combined unsupervised / knowledge-based approach
Takes knowledge graph into account, but no external resources
Thank you!Thank you!
research.semantic-web.at
14 / 14
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
SEMANTIC WEB COMPANY
school • consulting • projects • events • media
SEMANTIC WEB COMPANY
SEMANTIC
WEB COMPANY
