The Replication Recipe: What makes for a convincing replicat

Studies of mental functions, behaviors and the nervous system.

Moderators: Calilasseia, ADParker

The Replication Recipe: What makes for a convincing replicat

#1  Postby kennyc » Nov 11, 2013 1:23 pm

The Replication Recipe: What makes for a convincing replication?


Close replications are an important part of cumulative science.

Yet, little agreement exists about what makes a replication convincing.

We develop a Replication Recipe to facilitate close replication attempts.

This includes the faithful recreation of a study with high statistical power.

We discuss evaluating replication results and limitations of replications.
Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge base; however, there is no consensus about what constitutes a convincing close replication study. To facilitate convincing close replication attempts we have developed a Replication Recipe, outlining standard criteria for a convincing close replication. Our Replication Recipe can be used by researchers, teachers, and students to conduct meaningful replication studies and integrate replications into their scholarly habits.

Replication; Statistical power; Research method; Pre-registration; Solid Science

Replicability in research is an important component of cumulative science (Asendorpt et al., 2013, Jasny et al., 2011, Nosek et al., 2012, Rosenthal, 1990 and Schmidt, 2009), yet relatively few close replication attempts are reported in psychology (Makel, Plucker, & Hegarty, 2012). Only recently have researchers systematically reported replications online (e.g.,, and experimented with special issues to incorporate replications into academic publications (e.g., Nosek and Lakens, 2013 and Zwaan and Zeelenberg, 2013). Moreover, some prestigious psychology journals (e.g., Journal of Experimental Social Psychology, Journal of Personality and Social Psychology, Psychological Science) are recently willing to publish both failed and successful replication attempts (e.g., Brandt, 2013, Chabris et al., 2012, LeBel and Campbell, 2013, Matthews, 2012 and Pashler et al., 2013) and even devote ongoing sections to replications (see the new section in Perspectives on Psychological Science, Registered replication reports, 2013).

From initial conclusions drawn from replication attempts of important findings in the empirical literature, it is clear that replication studies can be quite controversial.
.... ... 113001819# ... +Digest%29
Kenny A. Chaffin
Art Gallery - Photo Gallery - Writing&Poetry
"Strive on with Awareness" - Siddhartha Gautama
User avatar
Name: Kenny A. Chaffin
Posts: 8698

Country: U.S.A.
United States (us)
Print view this post

Ads by Google

Re: The Replication Recipe: What makes for a convincing replicat

#2  Postby Asta666 » Nov 28, 2013 3:50 pm

:coffee: Interesting, thanks for sharing.
The behavioral account sets the task for the physiologist. Mentalism on the other hand has done a great disservice by leading physiologists on false trails in search of the neural correlates of images, memories, consciousness, and so on. Skinner
User avatar
Name: Leandro
Posts: 259
Age: 33

Country: Argentina
Argentina (ar)
Print view this post

Return to Psychology & Neuroscience

Who is online

Users viewing this topic: No registered users and 1 guest