failed_experiment.db
← Back to browse

Decision Sciences› Statistics, Probability and Uncertainty› Meta-analysis and systematic reviews

Meta-research and research methodology — Editorial instructions to authors aimed at reducing spin

Submitted 2026-10-22

Field: Decision Sciences › Statistics, Probability and UncertaintyType: No effect foundArea: meta-research and research methodologyTarget: Editorial instructions to authors aimed at reducing spinStage: randomized trial

Hypothesis

Short instructions sent to authors alongside peer-review comments would reduce spin in the conclusion of a revised abstract.

What failed

Of 184 manuscripts randomized at BMJ Open, 108 revisions could be assessed; spin was present in 57% (31/54) of intervention manuscripts versus 63% (34/54) of controls, a 6% difference with a confidence interval from 24% lower to 13% higher, and the counts for each prespecified spin type were similar between arms.

Broken assumption

Authors will drop overstated conclusions when a journal simply asks them to.

Why

The authors note the confidence interval rules out a large effect and call for different interventions against spin.

From the published paper: Ghannad et al. Journal of Clinical Epidemiology, 2020. ↗CC BY

Research ideas from this failure

Unvetted lead — read the papers

New hypotheses this failure suggests, each with a crucial experiment, a rival explanation of the original result, and the papers it rests on. Written by AI from paper titles and abstracts found on OpenAlex (and Europe PMC, for life and health sciences).

Related failures

Nothing else logged looks close to this one yet.

Links in published research

Where this experiment's genes are known to matter outside its own research area, and the papers behind those links. Sources: Open Targets Platform and Europe PMC.