Interaction Beyond the Individual: A Lecture on HCI-Oriented Collaborative an...
Machine translation vs. common language: Effects on idea exchange in cross-lingual groups (CSCW 2013)
1. Machine Translation vs. Common Language: !
Effects on Idea Exchange in Cross-Lingual Groups
Hao$Chuan)Wang )Na#onal'Tsing'Hua'University,'Taiwan'
Susan)R.)Fussell )Cornell'University,'NY,'USA'
Dan)Cosley ) )Cornell'University,'NY,'USA'
'
)
'
ACM'CSCW'2013'.'San'Antonio,'TX,'USA'
' !
!
7. Experimental Design
Randomly)assign)cross$lingual)groups)to)media?on)condi?on)
MT-mediated English-mediated
American-Chinese Dyad American-Chinese Dyad
Brainstorm)two)trials)(15)min)each)))
in)counterbalanced)order)
“Benefits and costs “Benefits and costs
for having an extra for having an extra
thumb” eye”
Measure)
Produc?vity)and)Comprehensibility)
!
Wang, Fussell, Cosley
!
8)
8. Measurement: Productivity
Produc-vity)
• Manually)translated)Chinese)contribu?ons)to)English)for)
consistency)of)coding'
• Count)number'of'original'ideas'by)manually)coding)
brainstorming)conversa?ons)
Idea? Original?
( How about sleeping, with one eye contac5ng with
A pillow? idea 1‐some originality
New opportuni5es for business: glasses for the 3
B eyed person. idea 1‐some originality
I think sleeping on your side would become the
B norm. idea 0‐duplicate
A Are we s5ll talking about the advan? no_idea
B New hats would need to be made. idea 1‐some originality
B sure. no_idea
A ok no_idea
B haircuts would certainly be modified. idea 1‐some originality
!
Wang, Fussell, Cosley
!
9)
9. Results: Productivity
14
English MT
12 In)English)groups,)Americans)
(na?ve)speaker))produced)
10
more)ideas)than)Chinese)
Idea Productivity
8 (non$na?ve)speaker).)
6
4
2
0
American Chinese
!
Wang, Fussell, Cosley
!
10)
10. Results: Productivity
14
English MT
Chinese)produce)more)ideas)
12 using)MT)than)English.))
p<.05)for)the)second)trial;))
10
p=.1)overall.)
Idea Productivity
8 )(H1:'MT(benefit(>(MT(cost))
6
)
MT)did)not)affect)Americans’)
4
produc?vity.))
2 )(H2'not'supported:'no)MT)
0
cost)on)produc?vity))
American Chinese )
)
!
Wang, Fussell, Cosley
!
11)