The benefits of talk therapy for depression have been overstated in the scientific literature, according to a study in the journal PLOS ONE.
The finding comes several years after a similar study reached the same conclusion about antidepressant drugs.
Both talk therapy and antidepressant drugs "are efficacious," says Steven Hollon, a professor of psychology at Vanderbilt University and an author of the study, which was published Wednesday. "They're just not as efficacious as we think they are."
For each treatment, researchers found that the apparent effectiveness was inflated by publication bias. This sort of bias occurs when studies finding that a treatment works are more likely to be published than those with a negative finding.
"It's like flipping a bunch of coins and only keeping the ones that come up heads," Hollon says. The result is that anyone who reviews the published literature on a particular treatment will see a distorted picture.
The study of talk therapy involved a review of 55 National Institutes of Health grants awarded between 1972 and 2008. The grants paid for clinical trials of psychotherapy for depression.
But results from nearly a quarter of these trials were never published, says Erick Turner, a psychiatrist and researcher at Oregon Health and Science University and an author of both the 2008 study on depression drugs and the new one on talk therapy.
Turner and his colleagues were able to obtain the unpublished results from the researchers who did the trials. "And when you bring in the unpublished data it brings down the apparent efficacy of psychotherapy for depression" by about 25 percent, he says.
The new finding could help reverse an unfortunate side effect of the 2008 analysis of depression drugs, Turner says. After the study came out, it was used by critics of antidepressants to suggest that people with depression should avoid drug treatment.
"There was a wave of just simple antidepressant bashing that went on and has continued," Turner says. And the results were used to suggest that people with depression should choose talk therapy over drugs.
That made no sense to Turner. "Why should we be recommending this other treatment when it might be just as fraught with publication bias as the drug literature is?"
So Turner was happy to join Hollon and other researchers interested in finding out whether the psychotherapy research had the same bias as drug research.
The result of that effort should reduce unjustified criticisms of drug treatment, Hollon says. "This article if anything kind of evens up the playing field," he says.
Publication bias may have led psychiatrists and psychologists to be too optimistic about both talk therapy and drug treatment, Hollon says. But he says that's less likely to be a problem for patients.
"When people are depressed they are usually unduly pessimistic [about treatment]," he says. "The biggest problem we have in depression is getting people to avail themselves of treatment, whatever it is."
And the act of starting treatment produces a powerful placebo effect, which can make a big difference even if the treatment itself produces only a small benefit, Hollon says.
Of course, publication bias isn't limited to depression treatments. It's a widespread problem throughout the research world, says Kay Dickersin, a professor of epidemiology at Johns Hopkins Bloomberg School of Public Health.
"We're rewarded for getting papers out, for finding results that will bring attention to our universities and to ourselves," she says. "We aren't rewarded for being honest; we're rewarded for making a splash."
And that presents a challenge both to doctors and to their patients, Dickersin says. "I think the question that's really arisen is, how much of what's out there should we really believe."
One solution, Dickersin says, is to have research grants include a requirement that all study results be made public, even if they're never published.
9(MDE1MTIxMDg0MDE0MDQ3NTY3MzkzMzY1NA001))
Transcript
ROBERT SIEGEL, HOST:
A new study finds the benefits of talk therapy for depression have been overstated. This comes several years after a similar study reached the same conclusion about antidepressant drugs. NPR's Jon Hamilton explains why both forms of depression treatment may be less effective than scientific literature suggests.
JON HAMILTON, BYLINE: In 2008, drugs for depression took a major hit. That was the year a team led by Erick Turner at Oregon Health and Science University found that research on these drugs suffered from a form of bias. Studies showing that the drugs didn't work rarely got published, so when researchers analyzed the literature on depression drugs, they got a distorted picture.
ERICK TURNER: The overall effect was to inflate the apparent benefits of the drugs that made the drugs look better than they actually were.
HAMILTON: Antidepressants did work, just not as well as the published studies had indicated. It's not surprising that this publication bias exists. Both scientists and scientific journals tend to place a higher value on research that gets positive results. Turner says his analysis of depression drug studies had an unfortunate side effect. It was used by critics of antidepressants to suggest that people with depression should avoid drug treatment.
TURNER: There was a wave of just simple antidepressant bashing that went on and has continued.
HAMILTON: Turner was also unhappy that his study was used to suggest that people with depression should choose talk therapy over drugs.
TURNER: Why should we be recommending this other treatment when it might be just as fraught with publication bias as the drug literature is?
HAMILTON: So Turner and a team of researchers decided to find out. The team reviewed 55 National Institutes of Health grants awarded between 1972 and 2008. The grants funded clinical trials of psychotherapy for depression. Turner says the results of nearly a quarter of these trials never got published.
TURNER: And when you bring in the unpublished data, it brings down the apparent efficacy of psychotherapy for depression.
HAMILTON: The same way it brought down the apparent efficacy of drugs for depression. Steven Hollon of Vanderbilt University is one of the new study's co-authors. He says the results should reduce unjustified criticisms of drug treatment.
STEVEN HOLLON: There was a bit of a negative vibe for medications when the notion of publication bias came out, and this article, if anything, kind of evens up the playing field.
HAMILTON: And Hollon says the presence of publication bias is not an indictment of either talk therapy or antidepressant drugs.
HOLLON: In both cases, there are enough good data there to tell us that those treatments work. They're efficacious. They're just not as efficacious as we think they probably are. In both cases, the true efficacy is probably about a third less than we think it is.
HAMILTON: Hollon says the published literature may have led psychiatrists and psychologists to be too optimistic about the depression treatments they offer. But he says that's less likely to be a problem for patients.
HOLLON: When people are depressed, they usually underestimate. They're usually unduly pessimistic, and the biggest problem we have in depression's getting people to avail themselves of treatment, whatever it is. And if anything, it takes people longer to get into treatment than would be good for them.
HAMILTON: Of course, publication bias isn't limited to depression treatments. Kay Dickersin of Johns Hopkins says it's a widespread problem in the research world.
KAY DICKERSIN: We're rewarded for getting papers out, for finding results that will bring attention to our universities and to ourselves, et cetera. So that doesn't help. We aren't rewarded for being honest. We're rewarded for making a splash.
HAMILTON: And Dickersin says that presents a challenge to both doctors and their patients.
DICKERSIN: I think the question that's really arisen is, how much of what's out there should we believe, which is kind of a scary thought.
HAMILTON: Dickersin says one solution is to have research grants include a requirement that all study results be made public even if they're never published. The new research appears in the journal PLOS ONE. Jon Hamilton, NPR News. Transcript provided by NPR, Copyright NPR.
300x250 Ad
300x250 Ad