Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The . gov means it’s official. Federal government websites often end in . gov or . mil. Before sharing sensitive information, make sure you’re on a federal government site. VSports app下载.

Https

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely. V体育官网.

. 2016 Jul;11(4):539-44.
doi: 10.1177/1745691616646366.

What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science

Affiliations

What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science

VSports手机版 - Prasad Patil et al. Perspect Psychol Sci. 2016 Jul.

Abstract

A recent study of the replicability of key psychological findings is a major contribution toward understanding the human side of the scientific process. Despite the careful and nuanced analysis reported, the simple narrative disseminated by the mass, social, and scientific media was that in only 36% of the studies were the original results replicated. In the current study, however, we showed that 77% of the replication effect sizes reported were within a 95% prediction interval calculated using the original effect size. Our analysis suggests two critical issues in understanding replication of psychological studies VSports手机版. First, researchers' intuitive expectations for what a replication should show do not always match with statistical estimates of replication. Second, when the results of original studies are very imprecise, they create wide prediction intervals-and a broad range of replication effects that are consistent with the original estimates. This may lead to effects that replicate successfully, in that replication results are consistent with statistical expectations, but do not provide much information about the size (or existence) of the true effect. In this light, the results of the Reproducibility Project: Psychology can be viewed as statistically consistent with what one might expect when performing a large-scale replication experiment. .

Keywords: Reproducibility Project: Psychology; p values; prediction intervals; replication; reproducibility V体育安卓版. .

PubMed Disclaimer

Figures

Figure 1
Figure 1. 95% prediction intervals suggest most replication effects fall in the expected range
A plot of original effects on the correlation scale (x-axis) and replication effects (y-axis). Each vertical line is the 95% prediction interval based on the original effect size. Replication effects could either be below (pink), inside (grey), or above (blue) the 95% prediction interval.

References (V体育平台登录)

    1. Anderson SF, Maxwell SE. There’s more than one way to conduct a replication study: Beyond statistical significance. Psychological Methods. 2015 http://dx.doi.org/10.1037/met0000051. - DOI - PubMed
    1. Asendorpf JB, Conner M, De Fruyt F, De Houwer J, Denissen JJ, Fiedler K, et al. Recommendations for increasing replicability in psychology. European Journal of Personality. 2013;27(2):108–119.
    1. Baker M. Over half of psychology studies fail reproducibility test. 2015 Aug; ( http://www.nature.com/news/over-half-of-psychology-studies-fail-reproduc... [Online; posted 27-August-2015])
    1. Berry DA. Adaptive clinical trials: the promise and the caution. Journal of Clinical Oncology. 2011;29(6):606–609. - PubMed
    1. Braver SL, Thoemmes FJ, Rosenthal R. Continuously cumulating meta-analysis and replicability. Perspectives on Psychological Science. 2014;9(3):333–342. - PubMed

"VSports在线直播" Grants and funding

LinkOut - more resources