IT IS to the running of the scientific enterprise what democracy is to the running of a country. , the UKâs national academy, where the took place in 1665.
Peer review is the system through which scientists vet each otherâs work to judge whether or not it is fit to be published or funded. That makes it the very cornerstone of all research. And yet this foundation is cracked. described it as âbiased, unjust, unaccountable, incomplete, easily fixed, often insulting, usually ignorant, occasionally foolish and frequently wrongâ. that it is âcomplex, expensive and prone to abuseâ.
These long-running concerns take on fresh resonance in the light of 51¶ŻÂțâs analysis of a highly competitive area of stem cell biology, which shows that researchers in the US get their papers published faster, and in higher-profile journals, than rivals elsewhere (see âInside the stem cell warsâ).
Advertisement
âUS labs get their papers published faster, and in higher-profile journals, than rivals elsewhereâ
We focused on stem cells because a group of scientists in that field â mostly from outside the US â recently took the unusual step of to leading journals protesting at âunreasonable or obstructiveâ peer reviews. But share a drink with scientists in other disciplines and youâll hear similar accusations of researchers sabotaging competitors by raising excessive objections â or worse, stealing ideas. If there is any truth to these allegations, it could undermine scientific progress.
The problem with peer review is also its strength. Reviews are typically seen only by journal editors and then sent in anonymous form to authors of a submitted paper. This allows scientists to comment without fear of retribution, but the scope for abuse is obvious.
Even so, authors of the letter were surprised that our analysis found such a difference in the fate of papers from researchers in the US compared with those from elsewhere. Our study shows that it is possible to use publicly available information to probe the dynamics of publication, but fully explaining our findings would require journals to lift the veil of secrecy.
Are papers from scientists outside the âin-crowdâ of top US labs given unfair, harsh treatment? Or are US-based scientists simply doing better work? Without seeing reviewersâ comments and learning their identities, weâll never know. Hopefully our analysis will prompt journals to conduct internal audits to ensure that each paper, whether from Harvard University or a little-known lab in China, is considered on its merits.
Complete disclosure of peer review is unlikely. But the authors of the protest letter suggest a compromise, which should make abuses easier to spot while preserving the main strength of peer review: keep anonymity, so scientists arenât discouraged from being critical, but publish the reviews and editorial correspondence. Indeed, already does this.
For justice to be seen to be done more widely, other journals should follow this lead. Like democracy, peer review may be flawed but itâs the least-worst system weâve got. It should be nurtured, through exposure to a little more sunlight.