Let’s review the peer review process
Times Higher Education -
We must hold up a mirror to scientific peer review if we are to stamp out fraud and uphold the discipline’s reputation, argues Philip Moriarty.
The website Science-fraud.org was established in July 2012 by the pseudonymous Frances de Triusce (an anagram of “science fraudster”) with the aim of highlighting suspicious papers in the scientific literature. Barely six months later, having brought to light around 500 examples of what might best be called questionable data, and with a daily readership in the thousands, the website was shut down.
Its founder’s true identity had been uncovered – he was Paul Brookes, an associate professor at the University of Rochester Medical Center in the US – and an email had been sent to around 85 scientists whose data had been questioned on the site, encouraging them to sue him for defamation. The email, which described Science-fraud.org as a “hate site” and, rather ironically, as a menace to “scientific society”, was also copied to Brookes’ superiors at Rochester (including its president), the editors of journals in which he had published and prominent people in his field who might be expected to be involved in peer reviewing his grants and papers.
Brookes’ immense frustration with both this deplorable act and the current state of scientific peer review was clear in his final post on the Science Fraud site: “As I have learned the hard way, anyone who dares to stick their neck on the line and question the data of their peers is ostracised, stone walled and subjected to lawsuits.” He went on to argue that the way forward would be to assemble what he called a “coalition of the willing” – to be known as the Association for Anonymous Post-Publication Peer Review – to effectively police the literature, flagging up questionable data and papers. A Science Fraud 2.0, in other words, albeit with a less incendiary name.
I have an immense amount of respect for Brookes, and for all those who will join his coalition. His integrity and commitment to science is laudable and inspiring. But why should he have to stick his neck on the line again? Do we really have to rely on what amounts to academic vigilantism to preserve the integrity of the scientific record? And who decides what constitutes a breach of scientific integrity in any case?
This latter question is, perhaps surprisingly, rather vexed. Even in cases of straightforward fraud – the manipulation, modification, and/or direct fabrication of data – establishing beyond doubt the guilt of the authors is rarely straightforward. But at least journal editors’ responsibility in these circumstances is clear: the paper must be retracted.
A study by medical communications consultant R. Grant Steen of papers retracted from the PubMed database between 2000 and 2010, which was published in the Journal of Medical Ethics in 2010, found that retractions had increased from fewer than 10 in 2000 to close to 180 in 2010. Even more worryingly, in nearly a third of cases journals did not even highlight (via, for example, a watermark on the article) that the paper had been retracted. However, only 27 per cent of the retractions were because of fraud; the rest were attributable either to “undisclosed” reasons or what appears to be genuine scientific error.
Read More: timeshighereducation.co.uk
2013-04-24 02:00:14
Source:
