Mason Archival Repository Service

Collecting Psycholinguistic Response Time Data Using Amazon Mechanical Turk

Show simple item record

dc.contributor.author Enochson, Kelly
dc.contributor.author Culbertson, Jennifer
dc.date.accessioned 2015-09-23T15:47:19Z
dc.date.available 2015-09-23T15:47:19Z
dc.date.issued 2015-03-30
dc.identifier.citation Enochson K, Culbertson J (2015) Collecting Psycholinguistic Response Time Data Using Amazon Mechanical Turk. PLoS ONE 10(3): e0116946. doi:10.1371/journal.pone.0116946 en_US
dc.identifier.uri https://hdl.handle.net/1920/9905
dc.description.abstract Researchers in linguistics and related fields have recently begun exploiting online crowd-sourcing tools, like Amazon Mechanical Turk (AMT), to gather behavioral data. While this method has been successfully validated for various offline measures—grammaticality judgment or other forced-choice tasks—its use for mainstream psycholinguistic research remains limited. This is because psycholinguistic effects are often dependent on relatively small differences in response times, and there remains some doubt as to whether precise timing measurements can be gathered over the web. Here we show that three classic psycholinguistic effects can in fact be replicated using AMT in combination with open-source software for gathering response times client-side. Specifically, we find reliable effects of subject definiteness, filler-gap dependency processing, and agreement attraction in self-paced reading tasks using approximately the same numbers of participants and/or trials as similar laboratory studies. Our results suggest that psycholinguists can and should be taking advantage of AMT and similar online crowd-sourcing marketplaces as a fast, low-resource alternative to traditional laboratory research.
dc.description.sponsorship Publication of this article was funded in part by the George Mason University Libraries Open Access Publishing Fund en_US
dc.language.iso en_US en_US
dc.publisher Public Library of Science en_US
dc.relation.haspart http://hdl.handle.net/1920/9116
dc.rights Attribution 3.0 United States *
dc.rights.uri http://creativecommons.org/licenses/by/3.0/us/ *
dc.subject psycholinguistics
 en_US
dc.subject replication studies
 en_US
dc.subject research laboratories
 en_US
dc.subject attention
 en_US
dc.subject computer software
 en_US
dc.subject computing methods en_US
dc.subject research validity
 en_US
dc.subject undergraduates en_US
dc.title Collecting Psycholinguistic Response Time Data Using Amazon Mechanical Turk en_US
dc.type Article en_US
dc.identifier.doi http://dx.doi.org/10.1371/journal.pone.0116946


Files in this item

The following license files are associated with this item:

This item appears in the following Collection(s)

Show simple item record

Attribution 3.0 United States Except where otherwise noted, this item's license is described as Attribution 3.0 United States

Search MARS


Browse

My Account

Statistics