1. ACL2011
EXPLOITING WEB-DERIVED
SELECTIONAL PREFERENCE TO
IMPROVE STATISTICAL DEPENDENCY
PARSING (1156)
GUANGYOU ZHOU, JUN ZHAO, KANG LIU, AND LI CAI
2011/09/03
Yuya Unno (@unnonouno)
2011 9 3

2. • (selectional preference) web
• Higher-order Eisner N PMI
• :-)
2011 9 3

3. •
•
•
2011 9 3

4. •
• …
•
• http://d.hatena.ne.jp/usata3/20070416/p2
2011 9 3

5. •
•
• Web
2011 9 3

6. PMI
• (Point-wise Mutual Information)
•
• PMI(x, y) = log (P(x, y) / P(x)P(y))
•
•
2011 9 3

7. • Google V1
• Web
• Google API
•
2011 9 3

8. •
• PMI(x, y, z) = log ( P(x, y, z) / P(x, y)P(y, z) )
• x, y y, z PMI
2011 9 3

9. PP-ATACHEMENT
•
• PMIIN(x, z) = P(x, IN, z) / P(x)
• PMI
• 3
2011 9 3

10. EISNER LOG-
LINEAR
ρ →
• Eisner
•
• CKY
•
• http://www.slideshare.net/unnonouno/ss-5724050
• PMI (PMI - μ) / σ
2011 9 3

11. • dep1: 1 Eisner, dep2: 2 Eisner, +hits: Google API, +V1: Google V1 Corpus
•
• Google API
2011 9 3

12. •
•
2011 9 3

13. • Gigword
(NEWS)
• Unigram
•
2011 9 3

14. •
2011 9 3

15. WEB
NGRAM
•
• Bio
•
2011 9 3

16. •
•
•
2011 9 3

17. • Web
• PMI
•
•
2011 9 3