The Semantic Quilt

The Semantic Quilt: Contexts, Co-occurrences, Kernels, and Ontologies Ted Pedersen University of Minnesota, Duluth http:// www.d.umn.edu/~tpederse

Sew together different materials

Ontologies Co-Occurrences Kernels Contexts

Semantics in NLP ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What do we mean by semantics ? …it depends on our resources… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What level of granularity? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Terrible Tension : Ambiguity versus Granularity ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Current State of Affairs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Similarity as Organizing Principle ,[object Object],[object Object],[object Object],[object Object],[object Object]

Things we can do now… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Things we want to do… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Semantic Patches to Sew Together ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ngram Statistics Package http:// ngram.sourceforge.net Co-Occurrences

Co-occurrences and semantics? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why pairs of words? ,[object Object],[object Object],[object Object],[object Object],[object Object]

Bigrams ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

“ occur together more often than expected by chance…” ,[object Object],[object Object],[object Object],[object Object]

Measures and Tests of Association http:// ngram.sourceforge.net ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What do we get at the end? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SenseClusters http:// senseclusters.sourceforge.net Contexts

Identify Similar Contexts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

SenseClusters Methodology ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Second Order Features ,[object Object],[object Object],[object Object]

Similar Contexts may have the same meaning… ,[object Object],[object Object],[object Object],[object Object],[object Object]

Second Order Context Representation ,[object Object],[object Object],[object Object],[object Object],[object Object]

2 nd Order Context Vectors ,[object Object],0 6272.85 2.9133 62.6084 20.032 1176.84 51.021 O2 context 0 18818.55 0 0 0 205.5469 134.5102 guy 0 0 0 136.0441 29.576 0 0 Oscar 0 0 8.7399 51.7812 30.520 3324.98 18.5533 won needle family war movie actor football baseball

After context representation… ,[object Object],[object Object],[object Object],[object Object],[object Object]

What do we get at the end? ,[object Object],[object Object],[object Object]

Ontologies WordNet-Similarity Co-Occurrences Ngram Statistics Package Kernels WSD-Shell Contexts SenseClusters

Oh…we also get plenty of these… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The WSD-Shell http:// www.d.umn.edu/~tpederse/supervised.html Kernels

Machine Learning Approach ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Kernel Methods ,[object Object],[object Object],[object Object]

Kernels are similarity matrices ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What do we get at the end? ,[object Object],[object Object]

WordNet-Similarity http://wn-similarity.sourceforge.net Ontologies

Similarity and Relatedness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

WordNet-Similarity http://wn-similarity.sourceforge.net ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Path Finding ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

watercraft instrumentality object artifact conveyance vehicle motor-vehicle car boat ark article ware table-ware cutlery fork from Jiang and Conrath [1997]

Information Content ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Observed “car”... motor vehicle (327 +1) *root* (32783 + 1) minicab (6) cab (23) car (73 +1) bus (17) stock car (12)

Observed “stock car”... motor vehicle (328+1) *root* (32784+1) minicab (6) cab (23) car (74+1) bus (17) stock car (12+1)

After Counting Concepts... motor vehicle (329) IC = 1.9 *root* (32785) minicab (6) cab (23) car (75) bus (17) IC = 3.5 stock car (13) IC = 3.1

Similarity and Information Content ,[object Object],[object Object],[object Object]

Wait a minute … ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Using Dictionary Glosses to Measure Relatedness ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Gloss Vectors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why measure conceptual similarity? ,[object Object],[object Object],[object Object],[object Object]

Word Sense Disambiguation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

WordNet-SenseRelate http:// senserelate.sourceforge.net SenseRelate

SenseRelate Algorithm ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Coverage… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Ontologies WordNet-Similarity Co-Occurrences Ngram Statistics Package Kernels WSD-Shell Contexts SenseClusters SenseRelate

Kernels are similarity matrices ,[object Object],[object Object],[object Object],[object Object],[object Object]

SenseClusters Input … matrices ,[object Object],[object Object],[object Object],[object Object]

Identifying Collocations ,[object Object],[object Object]

Conclusion ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Many Thanks… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

URLs ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

The Semantic Quilt

Recomendados

Recomendados

Más contenido relacionado

Similar a The Semantic Quilt

Similar a The Semantic Quilt (20)

Más de University of Minnesota, Duluth

Más de University of Minnesota, Duluth (20)

Último

Último (20)

The Semantic Quilt