iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
David Kirby

GET UPDATES FROM David Kirby
 

CDC: Vaccine Study Design "Uninformative and Potentially Misleading"

Posted: 06/20/08 07:43 PM ET

CDC Director Dr. Julie Gerberding has delivered a potentially explosive report to the powerful House Appropriations Committee, in which she admits to a startling string of errors in the design and methods used in the CDC's landmark 2003 study that found no link between mercury in vaccines and autism, ADHD, speech delay or tics.

Gerberding was responding to a 2006 report from the National Institute of Environmental Health Sciences (NIEHS), which concluded that methodology such as that used in the CDC's flagship thimerosal safety study is riddled with "several areas of weaknesses" that combine to "reduce the usefulness" of using the data in such a way.

"CDC concurs," Dr. Gerberding wrote in an undated report to Congress, (provided to me through a Capital Hill staffer) adding that her agency "does not plan to use" the database in question, the Vaccine Safety Datalink, (VSD) for any future "ecological studies" of autism (though that is exactly what they did in the 2003 study).

In fact, Gerberding's report said, use of the VSD for an ecological study now, comparing autism rates before and after the removal of most mercury from vaccines, "would be uninformative and potentially misleading."

Ecological vaccine studies are large, epidemiological analyses of risks and trends using computerized data from large populations -- in this case children enrolled at several big HMOs -- without linking results to actual individual outcomes.

CDC officials conducted at least five separate analyses of the data over a four-year period from 1999-2003. The first analysis showed that children exposed to the most thimerosal by one month of age had extremely high relative risks for a number of outcomes, compared with children who got little or no mercury: The relative risk for ADHD was 8.29 times higher; for autism, it was 7.62 times higher; ADD, 6.38 times higher; tics, 5.65 times; and speech and language delays were 2.09 more likely among kids who got the most mercury.

Over time, however, all of these risks declined into statistical insignificance, statistical inconsistency or else outright oblivion: The relative risk for autism plummeted from 7.62 in the first analysis, to 2.48 in the second version, to 1.69 in the third round, to 1.52 in the fourth, and down to nothing at all in the fifth, final, and published analysis printed in the Journal Pediatrics in November of 2003.

Vaccine officials attributed the steady drop to the elimination of "statistical noise" from the data through due diligence and the endeavor for excellence in governmental statistical analysis.

Indeed, the VSD study was the main pillar of a hugely influential 2004 report by the Institute of Medicine, which also concluded that there was no evidence of link between mercury, vaccines and autism.

To this day, public health officials routinely point to five "large epidemiological studies" representing the "highest quality science," none of which found any link to thimerosal.

In fact, the American VSD study has long been held up as the best and brightest of them all (the others were in Sweden, the UK, and two in Denmark). And this reputation has stuck in the minds of medicine and the media.

Curiously though, even the study's lead author -- Dr. Thomas Verstraeten, an employee of vaccine maker GlaxoSmithKline -- protested that the VSD study "found no evidence against an association, as a negative study would. In fact, he said that additional study was needed, which "is the conclusion to which a neutral study must come."

That's when Congress stepped in.

In 2005, a group of Senators and Representatives headed by Sen. Joe Lieberman wrote to the NIEHS (an agency of the National Institutes of Health) saying that many parents no longer trusted the CDC to conduct independent minded studies of its own vaccine program. Lieberman et al asked NIEHS to review the CDC's work on the vaccine database and report back with critiques and suggestions.

Among the official tasks given to the NIEHS panel were to "Identify the strengths and weaknesses of the VSD for evaluating the possible association between exposures to thimerosal-containing vaccines and AD/ASD." Another was to "Advise NIEHS and CDC on the feasibility of a new VSD study to compare autism rates before and after removal of thimerosal from most US childhood vaccines, using an ecologic study (an epidemiologic design where there is no linkage between individual-level data on exposure and health outcome).

The final NIEHS report was a serious and thoughtful critique of if an how the CDC improve on the design, conduct and analysis of VSD data in the future. Still, the NIEHS panel "identified several serious problems," with using VSD data for ecological studies -- including the 2003 study - something to which the agency had not responded -- until now.

In her letter to the House Appropriations Committee, the CDC Director responded directly to many -- though not all -- of the most important critiques and recommendations contained in the NIEHS panel report.

For example, the NIEHS had said the VSD data failed to account for other mercury exposures, including maternal sources from flu shots and immune globulin, as well as mercury in food and the environment.

"CDC acknowledges this concern and recognizes this limitation," the Gerberding reply says. This limitation would have applied to the 2003 Verstraeten study, as well as any future ecological analyses.

The NIEHS also questioned why CDC investigators eliminated 25% of the study population for a variety of reasons, even though this represented, "a susceptible population whose removal from the analysis might unintentionally reduce the ability to detect an effect of thimerosal." This strict entry criteria would likely lead to an "under-ascertainment" of autism cases, the NIEHS reported. Again, this would have been an issue in the Verstraeten data as well.

"CDC concurs," Gerberding wrote, again noting that its study design was "not appropriate for studying this vaccine safety topic. The data are intended for administrative purposes and may not be predictive of the outcomes studied."

Another serious problem is that the HMOs have changed the way they tracked and recorded autism diagnoses over time, including during the period when vaccine mercury levels were in decline. Such changes could "affect the observed rate of autism and could confound or distort trends in autism rates," the NIEHS warned.

"CDC concurs," Dr. Gerberding wrote again, "that conducting an ecologic analysis using VSD administrative data to address potential associations between thimerosal exposure and risk of ASD is not useful."

Read that sentence one more time. The head of the CDC is saying that its most powerful and convincing piece of exonerating evidence for thimerosal was based on anecological analysis of data whose methodology would be, in effect, "useless" for future study.

I hope everyone will read these documents, including the recommendations to make the VSD better, and the CDC's agreement with all of the suggestions. Hopefully, this data can still be used in some effective way.

As questionable as the US thimerosal methodology was, "it was an improvement on other studies, including the two in Denmark, both of which had serious weaknesses in their designs," Dr. Irva Hertz-Picciotto, Professor of Public Health at UC Davis Medical School and Chair of the NIEHS panel, told reporter Dan Olmsted at UPI.

That leaves very little for the CDC to go on in terms of proving that thimerosal and autism are not associated in any way.

Yes, there is always the study of disability services data from California -- which seem to be rising among the youngest cohorts of kids, who presumably received little or no mercury because thimerosal was largely removed from childhood shots.

But California is an "ecological study" with problems of its own.

"Although (this) information is often used by media and research entities to develop statistics and draw conclusions, some of these findings may misrepresent the quarterly figures," cautions the website of the California Department of Developmental Services (DDS). "Increases in the number of persons reported from one quarter to the next do not necessarily represent persons who are new to the DDS system."

Even the CDC admits that "there are several limitations" with linking a VSD study design with the California data, Gerberding wrote to Congress, because, among other things, California only counts "persons who were referred to and/or voluntarily entered" the disability system."

It will be interesting to see how the House Committee -- and the mainstream media -- react to this rather breathtaking confession by the CDC, which does seem to want to conduct the best vaccine-autism science possible (see Gerberding's replies to NIEHS recommendations for improving the VSD: CDC officials are currently conducting in- depth follow up studies with VSD patients).

As the waning months of the Bush administration get underway, I can't help but wonder if a little housecleaning might be going on at some of our top health agencies.

(And on that note, please see my blog about the upcoming HHS/FDA/CDC/NIH workshop on autism triggers in mitochondrial disorders (ie, Hannah Poling and her five vaccines).

 
 
 
 
 
  • Comments
  • 76
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
Page: 1 2  Next ›  Last »  (2 total)
This user has chosen to opt out of the Badges program
photo
12:20 PM on 06/23/2008
It's still the case that autism incidence rates are the same in Canada--where some provinces used vaccines which had Thimerosol, and some did not --as in the US. Similarly, of the provinces which had been using thimerosol, all stopped at different times. Again, incidence rates across the country reflect none of this.
09:51 PM on 06/23/2008
When are we all going to wise up to the fact that there is not just ONE cause of autism? Of course rates do not reflect the "removal" of thimerosal: AGAIN, it hasn't fully been removed; and further, it's not the only ingredient in vaccines we need to be talking about (think aluminum, live viruses, etc. LOOK IT UP ON THE CDC/FDA websites!).

No offense Simon.
10:45 PM on 06/21/2008
There is an interesting alternative view of the NIEHS and CDC reports mentioned by Mr. Kirby at http://epiwonk.com/?p=79. Epi Wonk -- a science blogger -- is an experienced epidemiologist who has carefully read both reports. He has also discussed the NIEHS report with one of the NIEHS Panel members who was actually at the meeting from which the report was generated. I urge everyone from both "sides" on this issue to carefully read Epi Wonk's post before coming to a conclusion about what Dr. Gerberding actually signed off on.
HUFFPOST SUPER USER
CraigWilloughby
In the immortal words of Socrates, "I drank what?"
11:11 PM on 06/21/2008
Thanks for respectfully posting that. I'll have a look at it and see what I think.
11:30 PM on 06/21/2008
I didn't need to read this. The disclaimer said it all.

http://epiwonk.com/?page_id=25

"This is a personal blog, reflecting the opinions of Epi Wonk. Statements on this blog do not represent the opinions of anyone other than the author. They do not represent the opinions or position of the author’s former universities of employment, and they most certainly do not represent the opinions or position of the Centers for Disease Control and Prevention (except on the subject of vaccines, upon which I’m almost 100% in agreement with the CDC).
*I have to admit it: the idea for and content of this disclaimer was stolen from Orac."
11:48 PM on 06/21/2008
foe2Hg,
That's what I like to see -- an open mind. Because the guy mostly agrees with CDC on vaccines, you refuse to read his learned interpretation of two reports that he's much more qualified to interpret than David Kirby. Or is it the Orac part? Or are you afraid you won't understand Epi Wonk's explanations? You don't "need to read this," but a little education wouldn't hurt, would it?
This user has chosen to opt out of the Badges program
photo
09:35 AM on 06/22/2008
In other words, don't disturb your preconceived notions with rational, science-based arguments against them.
05:28 PM on 06/21/2008
autismnewsbeat:
* You and your 'vaccine defenders' on the one hand say the 'increase' in ASD is simply due to better diagnosing, not an increase per se, not to be making such a hullabaloo about; and on the other hand, quote the figures as saying it therefore couldn't have been the thimerosal. Which way do YOU want it?
Personally, I think it's true that the figures are iffy. California eg does seem to have moved the goal posts in the definition they're using now, which is always a bummer for trying to look at statistics. And it has to be a factor that some parents, who were not getting any support previously for their child, either medically or financially, may now be considered in to the stats for kids who DO get some looking after. And what parent WOULDN'T do all they could for their child. Anyway: Just looking at stats stinks, in trying to get to causation.
* For the CDC/p.h. authorities to start talking up the elimination of thimerosal from vaccines, but at the same time adding the flu shot to the v schedule, could be looked at as being decidedly unkosher; at the least, not helpful in trying to look at stats. And of course with that addition, there is more prenatal effect for pregnant women to add to the h. metal load from 6 mos. on, when the child starts getting its own flu v dose. As for "h. metal" instead of just mercury: (cont'd)
04:43 PM on 06/21/2008
Thanks David!

I predict that they will now cling to their " thimerosal has been removed" mantra in an attempt to once again distract and mislead. However those of us who have followed this controversy for years know the truth.

We know the CDC is quickly losing all credibility and any organization or professional who blindly follows their deceptive lead will soon find themselves in a downward spiral of destruction right along with them.

Never under estimate the skill evil exercises in deceiving humanity.

Wake up!
04:24 PM on 06/21/2008
AutismNewsBeat, you say, "Thimerosal has been gone from scheduled childhood vaccines since 2002. So why haven't we seen a decline in autism among today's 3-5 year olds?"

a. Because thimerosal has not "been gone" from scheduled childhood vaccines since 2002, check the CDC webstie to verify that. Those stores of thimerosal laden shots (which you can find in doctor's offices across the country) are just now reaching their expiration dates. I believe it was Dr. Jay Gordon who said if you take the "trace amount" of thimerosal we find in today's childhood vaccines and put it in a glass of water, you render that glass of water toxic. Thimerosal is a neurotoxin. A neurotoxin. NO amount of a neurotoxin is acceptable to inject into anyone, ESPECIALLY a still developing child.

and,

b. Because it's not just the thimerosal.
01:31 PM on 06/21/2008
This is all very interesting. The problem is that they no longer use thimerosal in US vaccine stocks, and that the original study claiming a link between thimerosal and autism was so horrifically flawed that it was withdrawn by its authors. There is still no convincing evidence that there is any link. So maybe there's a problem with one piece of evidence against this link. There are still several other studies that found nothing. Thimerosal and autism remains merely a popular hysteria, like 9/11 "truth". In light of the change to other preservatives in vaccines, it's no longer even relevant. Vaccines do have some side effects and the occasional unfortunate outcome. However, these are extremely few and far between as compared to the unfortunate outcomes associated with, say, a full-blown case of polio. Vaccination still strikes me as a risk well worth taking, and I've had my daughter get all her shots. She's in perfect health, and if anything, above average developmentally.
05:00 PM on 06/21/2008
"In light of the change to other preservatives in vaccines, it's no longer even relevant."

Not relevant? Excuse me. My son was born in 1992 when the full amount of mercury was in the shots!

The fact that they are now *phasing out* mercury is great for the children rec'ing the shots today, but that will *NEVER* alter the fact that my son rec'd a boatload of mercury and was injured as a result.

You bet your ass it's relevant!!!

Kelli Ann Davis
HUFFPOST SUPER USER
CraigWilloughby
In the immortal words of Socrates, "I drank what?"
05:23 PM on 06/21/2008
Thimerosal has not been removed from vaccines. Go read your FDA Bible, where you will discover that the Vaccine Gods have allowed Thimerosal to remain in doses higher than 15 micrograms in several scheduled childhood vaccines (DTaP, Most flu shots and HepB, given at birth), and still uses thimerosal in production of nearly all of the rest of the vaccines. You may want to pressure your High Priests to give you the full gospel from the FDA before you can claim that thimerosal is not in vaccines anymore.
11:57 AM on 06/21/2008
"That leaves very little for the CDC to go on in terms of proving that thimerosal and autism are not associated in any way."

Wow. Read that sentence again. This is logic turned on its head. So far there has been no link shown between autism and mercury . Many studies indicate a lack of linkage. If there are flaws in these studies, these can (and will be) addressed in future studies. The CDC and other medical research groups aren't evil or trying to cover up anything.

If there is a link, it needs to be demonstrated scientifically. So far that hasn't been the case. Nobody knows the cause of autism (if there is a single cause, which may not be the case), but most evidence points to genetic rather than environmental origin. Be that as it may, this constant demonization of the CDC is misguided to put it politely.
12:20 PM on 06/21/2008
The original data did show the link to autism and many other health issues. Did they put a link to this blog for CDC employees beause you and mgloraine are both defending it, not very well I might add.

Also, if you are only saying genetics is the sole cause of autism, you have been living in a cave these past 5 years or a small cubicle within CDC.

Teresa
HUFFPOST SUPER USER
CraigWilloughby
In the immortal words of Socrates, "I drank what?"
12:44 PM on 06/21/2008
It goes to prove that all of this science that people like you cling to was a lie. So what else have your vaccine gods lied about?
11:45 AM on 06/21/2008
and people wonder why no one believes the government anymore...
photo
SILVANUS
Moving to Italy indefinitely. God Bless All.
10:43 AM on 06/21/2008
Think Robert Gallo.
01:12 AM on 06/21/2008
Rome fell from lead poisoned goblets.

I refuse anything with mercury in it.

I used thimerosal contact fluid at first, but I became allergic to it. So did lots of people.

Mercury=bad
We have known this for hundreds of years.

Multiple vaccines seem like a bad idea too. The difference between a vaccine reaction and getting sick can be small. That is you get just sick enough with vaccine to build up the anti bodies. Well if you take several at once, you either give up the strong reaction per vaccine and the the effectiveness, or you risk overwhelming the immunes system and getting sick.
04:14 PM on 06/21/2008
More accurately:

Some hypothesize that Rome fell, in part, from lead poisoning from improperly glazed wine containers and cooking vessels.

Mercury is a ubiquitous pollutant ( he criticizes the CDC above for not including the environmental mercury, you know that) you have apparently refused to live on Earth. May we ask from what mercury-free world you write? Earthlings friendly. Tell us about your world!

Mercury=bad. Ah, clues! You live on a black and white world,everything is very clear, good lives on one side of your planet and bad the other. Never gray. Keep giving us hints we'll guess the planet! This is fun! Mercury?

So vaccines reactions are additive. You have evidence of this or you just pulled it out of your a...Oh, don't know if your species have such a thing. You have evidence of antigens "overwhelming" the immune system! Great! No such evidence exists here. People of earth who try this argument are left saying "Yea, it could happen! Just because I don't know anything about immunology doesn't mean I can't make up stuff about it!" For humans the theoretical number of antigens that would overwhelm an infant's immune system is over 1,000. It's theoretical because we have never attempted that number. But you have on your planet! Great. Obviously you access the internet. Send this data to earth so we can benefit ! The people of earth will love you!

More hints. This solar system or another?
05:31 PM on 06/21/2008
I merely presented a Hypothesis regarding combined vaccines, with a plausible explanation. You rebuttal by ridicule, falls short of that.

As to Mercury, Yes, it's a black and white issue. If you don't believe me, go drink some mercury and get back to me. (please don't drink mercury!)
10:43 PM on 06/25/2008
You should have provided a Link, I thought you were quoting your hish school biology text.

http://www.immune.org.nz/site_resources/Professionals/Do_multiple_vaccines_overwhelm_the_infants_immune_system_.pdf

"The number of antigens a baby is exposed to via vaccines has decreased during the past century, despite the increase in the actual number of vaccines being used. In 1960, babies routinely received five vaccines containing more than 3,000 types of antigen; now they receive about 11 vaccines with up to 126 antigens. By Offit's calculation, these 11 vaccines "use up" about 0.1% of the baby's immune system."

That's from the study of multiple vaccines?

If concludes that infants can take 10000 vaccines at once. But that is not at all what the "theoretical" study shows. It shows that over your life, you can take 10000 antigens.

I blithely claims that you can take them all at once, due to the number of T-cells created per day.

No Epidemiological study has been done. That is, this is theoretical, not based on data comparing all at once to vaccine to
11:39 PM on 06/20/2008
This story is really amazing. Yet, it seems that the closer we come to getting the truth out-some folks(AAP, for example) fight even harder . Thanks David for this post.
Maurine Meleck
11:13 PM on 06/20/2008
there is no science that proves any vaccine is safe.

in fact its been known for many years that there is a link between autism and vacines as well as untold deaths resulting from not only so called medical vacines but from experimental vacines given to third world children and in this country prison inmates and our soldiers in uniform.


anyone caring to know can find the truth.

most dont.
11:09 PM on 06/20/2008
Proving that a study is flawed is a critical component of scientific research and is hardly explosive news. There is absolutely no reason, however, to assume that just because science cannot disprove a link between vaccines and autism, that a link therefore exists.

I hope research will continue to focus on the many variables that may contribute to the autism spectrum disorder.
11:21 PM on 06/20/2008
Ms Gerberding did not show this study is flawed...that is not the explosive part. This study was MADE flawed, watered down, massaged, and morphed into an impotent piece of unimportance. Originally, it showed the true and real data. Originally, it showed the link.

What is explosive is she is FINALLY verbalizing that it can no longer be looked upon as a study showing no link....there, the truth ...but years too late.

Housecleaning or hitting the Confessional? I vote the former....to try and keep her job as it is all about her, not the safety of the vaccine program.
11:49 AM on 06/21/2008
all this may sound well and good and oh so rational in scientific terms, but we're talking about people's children here, babies, lives disrupted, futures lost. They're not a bunch of rats in a lab being tested. Or, at least, they're not supposed to be.
10:33 PM on 06/20/2008
This is potentially a very significant development. I think it should be noted that Dr. Gerberding took the NIEHS findings seriously and behaved like a scientist, exhibiting what is today becoming a somewhat rare quality: professional integrity. The standard BushCo response would have been to bury the report, deride the findings, confuse the issue, anything but admit a problem with the CDC studies. Because she did NOT go that route, her succinct "CDC concurs" stands in refreshing contrast to the obfuscation and mendacity which have become the official policy of government agencies since the Cheney-Bush coup in 2000.

So while it is probably true that some housecleaning is in order at some of our top health agencies (as D. Kirby suggests), I think Dr. Gerberding is the kind of scientist we want to keep around.
HUFFPOST SUPER USER
CraigWilloughby
In the immortal words of Socrates, "I drank what?"
10:54 PM on 06/20/2008
I don't agree with you entirely, mgloraine. Gerberding knew about this YEARS ago. If she truly has integrity, she wouldn't have spent the past 10 years or so doing everything in her power to sweep it under the rug. On the other hand, I have to applaud her for having the humanity and conscience to come out with this statement; it greatly improves my opinion of her.
HUFFPOST SUPER USER
bluevalentine
11:56 AM on 06/21/2008
What I hear when reading this is that JG is making it impossible for anyone else to be allowed to utilize their data. Now we will have more studies, and no VSD? If the VSD was accurate for all other vaccine problems in the past, and only now being decided that it isn't good enough....this is fishy. Verstratten (sp?) study was only "re-worked" four times to lose the "signal"....so exactly why, again, is the VSD not useful?
This seems more like a backdoor approach to still getting their (CDC) way...no one gets thae VSD data. ANd making Congress believe this is perfect. They won't order the CDC to allow anyone to use it. Everyone is no concurring it is no good?????

Help, this makes no sense to me:(
10:18 PM on 06/20/2008
It was only a matter of time before the truth would finally come out of Gerberding's mouth. If she had told the truth sooner thousands of children's minds would have been saved. Why does this woman even still have a job?!!

Thanks to David Kirby and many dedicated parents this issue WILL be resolved.
10:26 PM on 06/20/2008
Well, you can look at it that way, or you can look at it as someone who had just discovered this and wanted it out. Just looking at the options.
10:33 PM on 06/20/2008
Just discovered it??!!! She has looked at this data for years and was in ALL the meetings about how to "make it go away. " Sha had two options years ago...tell the truth or NOT tell the truth...she made the WRONG choice from day one!
11:04 PM on 06/20/2008
She knew.....And now it's time for her and the rest of her accomplices to go to prison. I want to see these criminals frog-marched out in handcuffs and jumpsuits! They deserve the harshest of penalties because they have allow millions of children to be harmed. What a disgrace! Now the question is: Does anyone in power have the guts to indict and arrest these criminals?