Discussion: View Thread

After a little summer break, our first EOS masterclass for the 23/24 season will take place at 1PM UTC on October 18th (i.e. 3PM Central European Time, 9AM ET)  when Kariyushi Rao and Ty Hayes will speak on "Confronting Challenges in the Design and Execution of Interactive Online Experiments". Please find a short abstract of the talk below:

"In this seminar, we provide a high-level overview of the key challenges and concerns related to the design, architecture, and execution of experimental studies with interactive groups online.  We highlight important decisions researchers must make at each stage of this process.  We take a deeper dive into the most common issues researchers confront, and provide illustrative examples of solutions from our own work.  At the design stage, we discuss the data collection and capture, cross-device compatibility, and developing effective pilot tests.  On the subject of architecture, we discuss efficient participant grouping mechanisms, best practices for minimizing attrition, and how to deal with attrition when it does occur.  Finally, we offer advice for successful execution, including pre-screening methods to protect against bad actors, live monitoring, and designing payment schemes for maximum retention and attention.  Throughout the presentation, we offer anecdotes from our own experience using the oTree platform to design and run experiments on Mechanical Turk and Prolific.  There is no pre-reading required, but audience members interested in some of the finer-grained details related to execution in the oTree environment may view the working paper by Ty Hayes, and Kariyushi Rao has prepared a checklist for web experiments with a list of resources.  The seminar will present an expanded and updated version of the working paper, with additional topics noted above."

To get the Zoom link and a calendar invite, please register in advance for this meeting: https://us05web.zoom.us/meeting/register/tZIufuqvqj0tHdCUBLy_Ut8Z_yDXavRASTf8

Upon registering, you will receive a confirmation email containing details about joining the meeting.

A few days before the session, we will share a GoogleDoc for you to post your questions ahead of the session to enrich our discussion.

Until then, please do not hesitate to reach out with any question!

Best,

Marlo, Jerry, Franziska, and Thorsten

SignUp - Experimental Organization Science

About EOS:

EOS offers a home for researchers conducting experiments – lab studies with randomized treatment and control groups – aimed at advancing the understanding of organizations. EOS emphasizes any form of experimental study that furthers our understanding of how individual and group-level processes aggregate to organizational-level behaviour and outcomes. Examples of topics of interest include group decisions, organization learning, crowdsourcing, organizational culture and human-algorithm collaboration. Thriving on a narrow focus relating to the study of mechanisms of aggregation that link the actions of individuals to behaviour at the organizational level (which distinguishes organization science from research on either individuals or markets), EOS aspires to advance experimental rigour while appealing to a broad array of disciplines and a variety of interdisciplinary approaches.