POST 50
02/03/2017 04:10 pm ET Updated Feb 04, 2018

Bad Science makes Big Headlines

2017-02-03-1486155385-6216209-BadScience_HP1.png

2016-12-28-1482939150-9121250-Austad_Headshot_PhotoCredit.jpg by Steven N. Austad, Ph.D. - Scientific Director, American Federation for Aging Research (AFAR) , Distinguished Professor  and  Chair, Department of Biology, University of Alabama at Birmingham

A single 250 calorie bar of dark chocolate when eaten in combination with a low carbohydrate diet will accelerate weight loss by about ten percent.

Sounds good, yes? Maybe too good? But a study demonstrating exactly this was published last year in the International Archives of Medicine, an impressively scientific sounding journal title.

If adding calories while simultaneously accelerating weight loss, has your nonsense detector blinking furiously, then you are obviously not used to splashing around in the dismal swamp of so-called diet science--a place where you're likely to bump into a few actual scientists, but many more crooks, cranks, and con men.

It turns out that the study in question was a real scientific study-- a really bad, purposely bad -- scientific study concocted by a science journalist, John Bohannon and two German filmmakers. They wanted to expose how a dreadful piece of science with an eye-catching message could be published in a shoddy scientific journal and then turned into big headlines by shoddy journalism.

They were successful beyond their wildest dreams. The chocolate diet news made headlines worldwide.

Thank goodness, claims that chocolate can restore youth are rare. However, legitimate aging research like legitimate dietary research has a problem: good, solid scientific advances often get drowned out by what are at best unproven, or at worse frankly false, headline-grabbing claims for miracle products or diets. Everyone has seen them. Full page ads. Quotes by men (it always seems to be men) in lab coats. Photographs of men with faces like your grandfather but bodies like Olympic athletes.

This kind of media hype for dubious youth-preserving claims is not new. In the 1920's and 1930's, it was used to push radioactive water or testicular implants from goats (yes, seriously). Neither of those miracle therapies turned out so well.

But today more than ever, from advertorials to social media and beyond, we are living in a hyper-mediated world where all news is not necessarily true news. As echoed in recent articles in STAT News and The New York Times, neither academic publishing nor scientific journalism are immune to misleading headlines and invalid findings. If journalists can be fooled by bogus or simply bad science, how is a layperson supposed to sort out the hype from the help?

Here are a few guidelines to help you navigate the murky world of anti-aging claims and promises.

  • One, beware the marketing blitz. Any product with real evidence of slowing or reversing aging would fly off the shelves simply by word of mouth. Elaborate marketing is often a substitute for solid evidence.
  • Two, beware the dietary supplement. The supplement business has been virtually unregulated in the U.S. since FDA oversight was weakened in 1994. Supplement makers do not have to demonstrate their product does anything for your health. They don't even have to demonstrate that the ingredients on the label are the ingredients in the bottle. In fact, several recent studies have found that a surprising number of supplements from a wide range of manufacturers contained none of the ingredients on the label and lots of ingredients that weren't on the label.
  • Three, look for a dissenting or cautionary expert opinion. Good science journalists will check with independent experts on the quality of the science. Usually, they search until they find one who at least is cautious in interpreting what might be otherwise promising results.
  • Four, beware the authoritative product endorsement. Product endorsers get paid to extol the virtues of the product in question in the same way that used car salesmen get paid to extol the virtues of the battered second-hand cars they sell. Do you think scientists--whether from prestigious institutions or not--are immune to the enticements of a quick buck? Me neither.
  • Five, beware of assumptions based on mice-studies. Believe it or not, mice are not people. Just because something shows promise in a mouse (the medical research animal of choice) does not mean you can assume it will work the same in people. More than 300 drugs that helped treat mouse versions of Alzheimer's disease, for instance, have failed in people.
  • Finally, look beyond the headline. Don't simply troll the headlines or your Twitter-feed for health advice. I know it's a radical idea, but read the whole article with the above guidelines in mind.

These tips can help you become a more discriminating and informed consumer, and organizations like the American Federation for Aging Research can help even more.

AFAR's InfoAging Guides provide user-friendly, research-backed tips on over two dozen topics ranging from the biology of aging to age-related diseases and healthy lifestyle choices--all edited by experts working at leading research institutions who have published in prominent peer-reviewed journals.