Reckless Research Race, Results in Rising Retractions. Reform Required?

As our regular readers know, SRxA’s Word on Health loves nothing more than a good alliteration to start the day!  Although the blog post title may rank as one of our more classic tongue twisters, there is nothing amusing about the content.  As involved as we are in medical communications and peer-reviewed, scientific publishing, we are saddened to report on the rise of a recent trend of falsified research. An unsettling pattern is emerging. The rate at which articles are retracted (meaning the study was published, only to later be dubbed unfit for print — typically due to either deliberate misconduct or an honest scientific mistake) is increasing. To our knowledge, at least three scientific journals have published articles over the past two years warning of the rise in retractions and misconduct by researchers who have fudged results.

Last year Nature reported a tenfold increase in retractions over the past decade even though the number of published papers only increased by 44%. Before that, the Journal of Medical Ethics published a study in 2010 that said a rise in recent retractions was the fault of misconduct and “honest scientific mistakes.” It calculated that the number of retractions had more than tripled from 50 in 2005 to 180 in 2009.

The latest publication to highlight this issue is Infection and Immunity. In the fall of 2010, Dr. Ferric C. Fang, editor in chief of the journal made an unsettling discovery – one of his authors had doctored several papers. The journal wound up retracting six of the papers from the author, Naoki Mori of the University of the Ryukyus. It soon became clear that Infection and Immunity was hardly the only victim of Dr. Mori’s misconduct. Since then, according to the blog Retraction Watch, other scientific journals, including the International Journal of Cancer  have retracted another 24 of his papers. This was a new experience for Fang. Prior to this incident Infection and Immunity had only retracted nine articles over a 40-year period. “Nobody had noticed the whole thing was rotten,” said Fang, a professor at the University of Washington School of Medicine. Dr. Fang became curious how far the rot extended. To find out, he teamed up with a fellow editor at the journal, and before long they reached a troubling conclusion: not only that retractions were rising at an alarming rate, but that retractions were just a manifestation of a much more profound problem.

Dr. Fang’s colleague, Dr. Arturo Casadevall, said he feared that science had turned into a winner-take-all game with perverse incentives that led scientists to cut corners and, in some cases, commit acts of misconduct. Last month, in a pair of editorials in Infection and Immunity, the two editors issued a plea for fundamental reforms. While no one claims that science was ever free of misconduct or bad research, the new raft of retractions appears to be a mix of misconduct and honest scientific mistakes. Several factors are at play here, scientists say. One may be that because journals are now online, bad papers are simply reaching a wider audience, making it more likely that errors will be spotted. But other forces are more pernicious. To survive professionally, scientists feel the need to publish as many papers as possible, and to get them into high-profile journals. And sometimes they cut corners or even commit misconduct to get there. To measure this claim, Drs. Fang and Casadevall looked at the rate of retractions in 17 journals from 2001 to 2010 and compared it with the journals’ “impact factor,”  – a score based on how often their papers are cited by scientists. The higher a journal’s impact factor, the higher its retraction rate. The highest “retraction index” in the study went to one of the world’s leading medical journals, The New England Journal of Medicine.

The scramble to publish in high-impact journals may be leading to more and more errors. Each year, every laboratory produces a new crop of Ph.D.s, who must compete for a small number of jobs, and the competition is getting fiercer. In 1973, more than half of biologists had a tenure-track job within six years of getting a Ph.D. By 2006 the figure was down to 15 percent. In such an environment, a high-profile paper can mean the difference between a career in science or leaving the field. The scramble isn’t over once young scientists get a job. “What people do is they count papers, and they look at the prestige of the journal in which the research is published, and they see how many grant dollars scientists have, and if they don’t have funding, they don’t get promoted,” Dr. Fang said. “It’s not about the quality of the research.”

With all this pressure on scientists, they may lack the extra time to check their own research. Instead, they have to be concerned about publishing papers before someone else publishes the same results. Adding to the pressure, thousands of new Ph.D. scientists are coming out of China and India, countries that offer cash rewards to scientists who get papers into high-profile journals. Dr. Fang worries that the situation could be become much worse if nothing happens soon. To change the system, Fang and Casadevall say graduate students need a better understanding of science’s ground rules. They would also move away from the winner-take-all system, in which grants are concentrated among a small fraction of scientists by putting a cap on the grants any one lab can receive. A little bit of old fashioned honesty wouldn’t hurt either!

3 thoughts on “Reckless Research Race, Results in Rising Retractions. Reform Required?

  1. Disturbing. I’m sure the ease of getting published (self-publishing venues, new magazines, websites like webmd.com) doesn’t help this situation either.

  2. This is a remarkable study and further supports some of the hipocrisy of the elitists in medicine, who feel that accomplishments are only determined by high impact journals and NIH grants. Granted these are very important measures of success and they are also important to health care advances. That said, many of the greatest findings in medicine were not supported by a NIH grant or published in the highest impact journals. This study is similar to one performed in the late 1990’s that showed that the desire for promotion (and not other things like relationships with industry) was the major source of authors manipulating their data.

  3. Great update on the topic from Ed Silverman published 10-2-12 in Pharmalot:

    Medical fraud has become more noticeable in recent years as more studies are retracted all the time. In fact, a blog called Retraction Watch now covers the issue. But how bad is it, really? Well, a new review of peer-reviewed journals finds the percentage of studies withdrawn because of fraud or suspected fraud has zoomed. In 1976, there were fewer than 10 fraud retractions for every 1 million studies published, compared with 96 retractions per million in 2007.
    To be specific, the study reviewed 2,047 biomedical and life-science research articles indexed by PubMed and noted as retracted as of May 3, 2012. They found that only 21.3 percent of retractions were attributed to errors. But 67.4 percent were due to misconduct, including fraud or suspected fraud at 43.4 percent; duplicate publication at 14.2 percent and plagiarism at 9.8 percent.
    “Incomplete, uninformative or misleading retraction announcements have led to a previous underestimation of the role of fraud in the ongoing retraction epidemic,” the authors conclude. Although they maintain the problem is still relatively small, they can only speculate about the reasons for the dramatic increase. The study was published in the Proceedings of the National Academy of Sciences (here is the abstract).
    “Very few people are doing it, but when they do it, they are doing it in areas that are very important,” Arturo Casadevall, a professor of microbiology at the Albert Einstein College of Medicine in New York and the lead study author tells the Associated Press. “And when these things come out, society loses faith in science.” Most “scientists out there are well meaning and honest people who are going to be totally appalled by this.”
    While other studies have shown a rise in retractions, no previous study has found scientific misconduct as the leading cause, Nicholas Steneck, director of the research ethics program at the University of Michigan, who was not involved in the study, tells the AP. This indicates a need for a better reporting system for retractions by journals, although there is also the possibility that more journals have become more sensitive to retraction issues recently, he adds.
    Of course, the issue is likely motivated by the increasing pressure on academics and scientists to publish more and more papers – and have them published in the most prominent journals. Those who succeed in doing so are more likely to receive more grants for more research and more job offers. And unfortunately, human nature suggests this increases the temptation to fudge figures.
    Perhaps the most notable example of scientific fraud involved Andrew Wakefield, who cobbled together various conclusions and opinions that suggested a strong link between autism and MMR vaccination in a paper that was published more than a decade ago in The Lancet. Recently, he lost his license to practice medicine in the UK (read here) after the UK General Medical Council decided he was guilty of serious professional misconduct.
    Another involved Duke University and Anil Potti, whose worked was touted as a game changer for cancer research. His papers were criticized, but a Duke committee determined nothing was out of line until a report that Potti had lied on his resume. The episode was covered earlier this year by 60 Minutes as an example of the rising incidence of medical fraud (see this).
    The authors “deserve tremendous credit for taking the time to identify the reasons for retractions. And what they’ve found suggests that, at least in this case, data can be the plural of anecdote,” Adam Marcus, managing editor of Anesthesiology News and co-founder of Retraction Watch. “Our own work… has offered hints that misconduct might be playing a greater role in retractions than earlier studies had indicated, but the new article really makes the case.
    “Although some people might see these findings as an indictment of science in general, I don’t think that’s fair. After all, this was simply a look at papers that failed, not the field as a whole. But what it does underscore — emphatically, we believe — is that many journals and editors need to take the retraction process more seriously. They don’t do anyone a service by publishing notices that are mute to the reason for the retraction — not their readers, not their publishers, not the public. We think a good first step here is for the science publishing community to adopt a zero-tolerance policy for obfuscation in these notices.”

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s