tailieunhanh - Conducting behavioral research on Amazon’s Mechanical Turk

A long-term goal of our work is to develop the basic control theory for me- chanical systems, and Lagrangian systems in particular. There are several reasons why mechanical systems are good candidates for new results in nonlinear control. On the practical end, mechanical systems are often quite well identified, and ac- curate models exist for specific systems, such as robots, airplanes, and spacecraft. Furthermore, instrumentation of mechanical systems is relatively easy to achieve and hence modern nonlinear techniques (which often rely on full state feedback) can be readily applied. We also note that the present setup suggests that some of the traditional concepts such as controllability itself may. | Behav Res DOI s13428-011-0124-6 Conducting behavioral research on Amazon s Mechanical Turk Winter Mason Siddharth Suri Psychonomic Society Inc. 2011 Abstract Amazon s Mechanical Turk is an online labor market where requesters post jobs and workers choose which jobs to do for pay. The central purpose of this article is to demonstrate how to use this Web site for conducting behavioral research and to lower the barrier to entry for researchers who could benefit from this platform. We describe general techniques that apply to a variety of types of research and experiments across disciplines. We begin by discussing some of the advantages of doing experiments on Mechanical Turk such as easy access to a large stable and diverse subject pool the low cost of doing experiments and faster iteration between developing theory and executing experiments. While other methods of conducting behavioral research may be comparable to or even better than Mechanical Turk on one or more of the axes outlined above we will show that when taken as a whole Mechanical Turk can be a useful tool for many researchers. We will discuss how the behavior of workers compares with that of experts and laboratory subjects. Then we will illustrate the mechanics of putting a task on Mechanical Turk including recruiting subjects executing the task and reviewing the work that was submitted. We also provide solutions to common problems that a researcher might face when executing their research on this platform including techniques for conducting synchronous experiments methods for ensuring high-quality work how to keep data private and how to maintain code security. Keywords Crowdsourcing. Online research. Mechanical turk W. Mason S. Suri Yahoo Research New York USA e-mail m@ S. Suri e-mail suri@ Published online 30 June 2011 Introduction The creation of the Internet and its subsequent widespread adoption has provided behavioral researchers with an additional medium for .