The State of Amazon Mechanical Turk

Like many other areas of the social sciences, experimental philosophy is nowadays heavily fueled by Amazon Mechanical Turk. (This blog certainly helped with that too!) So I thought it might be
Philosophy News image
Like many other areas of the social sciences, experimental philosophy is nowadays heavily fueled by Amazon Mechanical Turk. (This blog certainly helped with that too!) So I thought it might be helpful to consider the state of Amazon Mechanical Turk, for both experimental philosophers and critics of experimental philosophy. (By the way, the Experimental Turk blog / website remains an invaluable resource!)In my view, the best academic paper that gives a thorough overview of Amazon Mechanical Turk's strengths and weaknesses is Gabriele Paolacci and Jesse Chandler's "Inside the Turk: Understanding Mechanical Turk as a Participant Pool" (2014). My main takeaways from the paper areIn general, MTurk data quality is at least as good as university lab data quality.However, there is serious concern about MTurk participants' non-naivety. So the data quality of common experimental paradigms (such as cognitive reflection test, ultimatum game, and in my view, trolley problems) is relatively. . .

Continue reading . . .

News source: Experimental Philosophy

blog comments powered by Disqus