Social and Discourse Contributions to the Determination of Reference in Cross-Situational Word Learning

How do children infer the meanings of their first words? Even in infant-directed speech, object nouns are often used in complex contexts with many possible referents and in sentences with many other words. Previous work has argued that children can learn word meanings via cross-situational observation of correlations between words and their referents. While cross-situational associations can sometimes be informative, social cues to what a speaker is talking about can provide a powerful shortcut to word meaning. The current study takes steps toward quantifying the informativeness of cues that signal speakers' chosen referent, including their eye-gaze, the position of their hands, and the referents of their previous utterances. We present results based on a hand-annotated corpus of 24 videos of child-caregiver play sessions with children from 6 to 18 months old, which we make available to researchers interested in similar issues. Our analyses suggest that although they can be more useful than cross-situational information in some contexts, social and discourse information must also be combined probabilistically to be effective in determining reference.