Researchers report that studies that cannot be confirmed and could be false are far more likely to be quoted in the media because they are more compelling.
They examined research published in top psychology, economic, and nature/science journals and discovered that only 39% of 100 psychology articles were successfully reproduced. The replication rates for 18 economic experiments were 61 percent, and 62 percent for 21 nature/science studies.
However, articles whose results could not be reproduced subsequently received a lot of coverage after they were published: they were quoted 153 times more often than those whose findings could be replicated.
Unverifiable research tends to be cited as if the results were true long after the publication failed to replicate, the researchers noted.
“We also know that experts can predict well which papers will be replicated,” wrote authors Marta Serra-Garcia, assistant professor of economics and strategy, and Uri Gneezy, a professor of behavioral economics. “Given this prediction, we ask, ‘Why are non-replicable papers accepted for publication in the first place?'”
A possible reason is that journals use lower standards for replication if a study is more interesting, the researchers suggested.
“Interesting or appealing findings are also covered more by media or shared on platforms like Twitter, generating a lot of attention, but that does not make them true,” Gneezy said in a university news release.
Publishing unverified studies can have significant and lasting impacts, according to the study authors. They pointed to a false study published in The Lancet in 1998 that implied a link between the measles, mumps and rubella vaccine and autism, which led tens of thousands of parents worldwide to turn against the vaccine.
The incorrect findings were retracted by The Lancet 12 years later, but many people still cite the study to claim that autism is linked to vaccines.
“We hope our research encourages readers to be cautious if they read something that is interesting and appealing,” Serra-Garcia said in the release.
“Whenever researchers cite work that is more interesting or has been cited a lot, we hope they will check if replication data is available and what those findings suggest,” Gneezy said.
The findings were published recently in the journal Science Advances.
More informationThe U.S. National Library of Medicine offers advice on understanding medical research.
Copyright © 2021 HealthDay. All rights reserved.