Estimating the reproducibility of psychological science

The paper

Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science. https://doi.org/10.1126/science.aac4716

Empirically analyzing empirical evidence One of the central goals in any scientific endeavor is to understand causality. Experiments that seek to demonstrate a cause/effect relation most often manipulate the postulated causal factor. Aarts et al. describe the replication of 100 experiments reported in papers published in 2008 in three high-ranking psychology journals. Assessing whether the replication and the original experiment yielded the same result according to several criteria, they find that about one-third to one-half of the original findings were also observed in the replication study. Science , this issue 10.1126/science.aac4716

Contribution

replication

Data basis

primary

Document

full article

Review stage

peer reviewed

Disciplines

psychology, metascience

Access

closed

What it can do

• Look up a replicationlookup_replication

  Return original and replication effect sizes for a study in the project.

  replicationeffect-size
• Summarise reproducibility outcomessummarise_outcomes

  Report aggregate reproducibility indicators across the sample.

  metascience

Provenance

Each check stands on its own. There is no single “verified” state: whether an agent faithfully implements its paper is a curation judgement, not something this registry can mechanically prove.

Machine-readable: paper.jsonld

Agent: org.agenticjournal/paper-osc-2015-reproducibility · v0.1.0