ACL 2015 - P15-1128

1. Scott Wen-tau Yih

4. Knowledge
Base
𝜆𝑥. sister_of(justin_bieber, 𝑥)
Who is Justin Bieber’s sister?
𝜆𝑥. sibling_of(justin_bieber, x) ∧ gender(x, female)
semantic parsing
query
matching
Jazmyn Bieber

5. Knowledge
Base
Who is Justin Bieber’s sister?
𝜆𝑥. sibling_of(justin_bieber, x) ∧ gender(x, female)
semantic parsing
query
Jazmyn Bieber

6. “What was the date that Minnesota became a state?”
“When was the state Minnesota created?”
“Minnesota's date it entered the union?”
location.dated_location.date_founded

7. directly
grows staged
Basic idea

8. Addresses Key Challenges
52.5

9. • Introduction
• Background
• Graph knowledge base
• Query graph

10. •
•
• Family Guy cvt2
Meg Griffin
Lacey Chabert
1/31/1999
cvt1
from
12/26/1999
cvt3
series
Mila Kunis

11. Family Guy cast
Meg Griffinargmin
xy
topic entity core inferential chain
constraints

12. • Introduction
• Background
• Staged Query Graph Generation (Our Approach)
• Link topic entity
• Identify core inferential chain
• Augment constraints

13. Staged
Meg Family Guy
Family Guy
s1
Meg Griffin
s2
ϕ
s0
(1) Link Topic Entity

14. Staged
Meg Family Guy
(2) Identify Core Inferential Chain
Family Guy
s1
Family Guy cast actor xy
s3
Family Guy writer start xy
s4
Family Guy genre x
s5

15. Staged
Meg Family Guy
(3) Augment Constraints
Family Guy cast actor xy
Family Guy cast actor xy
Meg Griffin
Family Guy xy
Meg Griffinargmin
s3
s6
s7

16. Family Guy
s1
Meg Griffin
s2
ϕ
s0

17. Family Guy
s1
Family Guy cast actor xy
s3
Family Guy writer start xy
s4
Family Guy genre x
s5
Who first voiced Meg on Family Guy?
{cast−actor, writer−start, genre}

18. • Input is mapped to two 𝑘-dimensional vectors
𝑃 𝑅 𝑃 =
exp cos(𝑦 𝑅, 𝑦 𝑃)
𝑅′ exp cos(𝑦 𝑅′, 𝑦 𝑃)
𝑦 𝑃 ∈ R 𝑘 𝑦 𝑅 ∈ R 𝑘
who voiced meg on 𝑒 cast−actor
15K 15K 15K 15K 15K
1000 1000 1000
max max
...
...
... max
300
...
...
<s> w1 w2 wT </s>
... ...
300

19. • Who voiced Family Guy
cast FamilyGuy 𝑦 actor 𝑦 𝑥
• One or more constraint nodes can be added to 𝑦 or 𝑥
• 𝑦 : Additional property of this event (e.g., character 𝑦 MegGriffin )
• 𝑥 : Additional property of the answer entity (e.g., gender)
Family Guy cast actor xy
Family Guy cast actor xy
Meg Griffin
Family Guy xy
Meg Griffinargmin
s3
s6
s7
Family Guy cast actor xy
s3

20. Who first voiced Meg on Family Guy?
Family Guy cast actor xy
s3
Family Guy writer start xy
s4

21. Who first voiced Meg on Family Guy?
Family Guy cast actor xy
s3
Family Guy xy
Meg Griffinargmin
s7

22. 𝑞 =Who first voiced Meg on Family Guy?
Family Guy cast
Meg Griffinargmin
xy
𝑠 =

23. • Introduction
• Background
• Staged Query Graph Generation (Our Approach)
• Experiments
• Data & evaluation metric
• Creating training data from Q/A pairs
• Results

24. • What character did Natalie Portman play in Star Wars? Padme Amidala
• What currency do you use in Costa Rica? Costa Rican colon
• What did Obama study in school? political science
• What do Michelle Obama do for a living? writer, lawyer
• What killed Sammy Davis Jr? throat cancer [Examples from Berant]

25. Relation Matching (Identifying Core Inferential Chain)
Pattern Inferential Chain
what was <e> known for people.person.profession
what kind of government does <e> have location.country.form_of_government
what year were the <e> established sports.sports_team.founded
what city was <e> born in people.person.place_of_birth
what did <e> die from people.deceased_person.cause_of_death
who married <e> people.person.spouse_s
people.marriage.spouse

26. Reward Function 𝛾

27. 33
35.7
37.5
39.2 39.9 41.3
44.3 45.3
52.5
0
10
20
30
40
50
60
Avg. F1 (Accuracy) on WebQuestions Test Set
Yao-14 Berant-13 Bao-14 Bordes-14b Berant-14 Yang-14 Yao-15 Wang-14 Yih-15

28. Method #Entities Covered Ques. Labeled Ent.
Freebase API 19,485 98.8% 81.2%
Yang & Chang, ACL-15 9,147 99.8% 87.8%
52.5% 48.4%

29. 49.6 52.5

30. A random sample of 100 incorrectly answered questions

31. directly

32. http://aka.ms/sent2vec
http://aka.ms/codalab-webq
http://aka.ms/stagg