More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
David Katz, M.D.

GET UPDATES FROM David Katz, M.D.

Illumination vs. Irradiation: Informing Medical Decisions With Help From Your Inner Statistician

Posted: 08/22/11 09:07 AM ET

My colleagues at the Huffington Post recently did a fine job characterizing the trade-offs that bedevil decisions about the use of modern medical imaging. On the one hand, sophisticated imaging with CT scanners can inform treatment choices, and save lives. On the other, rates of imaging have sky-rocketed over recent years, raising concerns about radiation exposure for patients and for doctors, that invention may be acting as the mother of necessity!

The challenge, of course, is finding the sweet spot between damned if you do, damned if you don't. Being overly cautious about medical testing -- imaging or otherwise -- could mean missing out on the very test you need to answer a critical question, or guide a crucial therapy. Being overly accepting of every application of modern medical technology might well mean it does you more harm than good -- making you glow in the dark, rather than illuminating the source of your troubles.

Up to a point, getting such decisions right requires trust in your doctor -- because they are decisions your doctor has been trained to make. Often that trust will be warranted -- and ideally it is in your case. Ideally, your doctor is not only highly educated, but equally intelligent and genuinely caring. With my many colleagues in mind, I can certainly say this is true much of the time. I can also say it isn't invariably true, and even the best of us have bad days. So I invoke my favorite Reaganism: Trust, but verify.

Verify you are getting the tests you need, and only the tests you need. Challenging such decisions is not an insult to your doctor. Simply, it is an affirmation of the fact that you, literally, have skin in the game: It's your body and your health on the line. Take nothing for granted.

In her Huffington Post column about diagnostic imaging, Emma Gray makes the following, reasonable suggestions. Before getting any type of scan, ask: How will this improve my care? Are there any alternative imaging exams that don't use radiation?

I like these tips, but I would like to go further and generalize them. Radiation is not the only hazard of medical testing -- any test can do harm of some kind. That's acceptable if, and only if, potential harm is much outweighed by potential benefit. To ensure that, always ask these questions before any test:Wwill the results of this test directly affect your decisions, or my options? Will this test provide a definitive answer, or is it preliminary to more tests? Is this test the safest way to get the information we need? Would you have this test if you were me?

If you can bring yourself to ask these questions about medical testing as a matter of routine, they should serve as a fairly good filter, letting only genuinely useful testing through. But with a little help from your inner statistician (yes, s/he's really in there!) you can do even better.
The goal of medical testing is to figure out what is going on (and then, what to do about it). That, in turn, is really dependent on establishing two things: What does this patient have and what doesn't this patient have? Testing is about confirming a diagnosis (ruling it in) and excluding all the rest (ruling them out). Ideally, it leads to ruling out everything so you can get that proverbial clean bill of health.

There are two, simple statistical concepts you should (and can!) master so that you can help guide testing toward ruling in what it is and ruling out what it isn't. The concepts are sensitivity and specificity.

In life, sensitivity is noticing and reacting to every little thing. It's not much different in medicine: It's the capacity of a test to detect a condition when it is really there. In the two-by-two table below, it is [a/(a+c)].

2011-08-19-Screenshot20110819at3.22.48PM.png

The table summarizes the universe of diagnostic possibilities into four quadrants: disease is present and the test finds it (cell a); disease is absent, but the test says it's present (false positive, cell b); disease is present and the test fails to find it (false negative, cell c); disease is absent and the test says it is absent (cell d). Sensitivity is, in essence, the percentage of the time that disease is present (cell a plus cell c) that the test finds it (cell a); thus, [a/(a + c)].

Here's the surprise: Although sensitivity is the measure of how reliably a test finds a condition that's actually there, it's the property a test needs to rule disease out! Here's why:

If a test is highly sensitive, it will almost always be positive when disease is truly there. Therefore, if a test is highly sensitive, it will almost never be negative when disease is truly there. A highly sensitive test will almost never be negative unless disease truly isn't there. And thus, a negative result on a highly sensitive test reliably rules out disease. The corollary, of course, is that a negative result from a test that is not highly sensitive -- whether or not it is highly specific -- does not reliably rule out disease!

Imagine the stunned expression on your doctor's face when s/he says: Llet's get this test just to make sure you don't have X ..." And you reply: "I trust, then, that this is a highly sensitive test for X?" I would love to be there when it happens!

On the flip side, specificity is the capacity of a test to exclude what truly isn't there. In the two-by-two table, that's [d/(b+d)]. The explanation is much as before, so I won't belabor.

Again, it is somewhat counterintuitive, but it's a test that is good at ruling out what isn't there that is needed to make a diagnosis! The logic is much as before:

A highly specific test is almost always negative when disease is truly absent. A highly specific test will almost never be positive when disease is truly absent. A highly specific test will almost only be positive when disease is actually present. And thus, a positive result on a highly specific test reliably rules a diagnosis in. Again, we have the logical corollary: A positive result from a test that is not highly sensitive does not rule a diagnosis in -- it merely suggests it. So before being treated for a particular condition, particularly if the treatment is apt to be unpleasant or dangerous, you would be well within your rights to ask: Was the testing this diagnosis is based on highly specific?

You are, I am confident, more than capable of mastering and using these simple, statistical principles. But I also recognize that some of you break into a cold sweat at the mere sight of anything that recalls high school algebra! For those in that group, here's your shortcut: SPin/SNout. Specificity to rule in, sensitivity to rule out.

There are more useful, simple statistical principles where these came from -- but they can wait for another day, and another column.

For now, we should recognize that medical testing used well should be illuminating. Used badly, it might simply be ... irradiating. Trust your doctor -- but on behalf of your skin, verify! Bring a few good questions -- and your inner statistician -- to your next doctor's visit to help ensure you stay in the sweet spot.

-fin

Dr. David L. Katz; www.davidkatzmd.com
www.turnthetidefoundation.org

 

Follow David Katz, M.D. on Twitter: www.twitter.com/DrDavidKatz

My colleagues at the Huffington Post recently did a fine job characterizing the trade-offs that bedevil decisions about the use of modern medical imaging. On the one hand, sophisticated imaging with ...
My colleagues at the Huffington Post recently did a fine job characterizing the trade-offs that bedevil decisions about the use of modern medical imaging. On the one hand, sophisticated imaging with ...
 
 
  • Comments
  • 11
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
02:10 PM on 08/22/2011
Your reasoning is good within certain bounds only. My extensive personal experience is that one must move with the greatest of caution--like being in a war zone when you deal with anyone in the medical profession. The reason is that medicine is by and large a business affair. I have seen so much skullduggery that it would fill several volumes. MD's are no longer what they used to be. I have no respect for anyone in the medical profession, no matter what they do for a variety of very very good reasons. We have to tolerate them but don't ask for respect cause you won't ever get it. Anybody out there know any good doctor jokes?
photo
thejazz
I'll burn that bridge when I come to it.
12:18 PM on 08/22/2011
"Verify you are getting the tests you need, and only the tests you need. Challenging such decisions is not an insult to your doctor. Simply, it is an affirmation of the fact that you, literally, have skin in the game: It's your body and your health on the line. Take nothing for granted."

Do you know any doctors? This is , like, totally unrealistic.

"Before getting any type of scan, ask: How will this improve my care? Are there any alternative imaging exams that don't use radiation?"

Shouldn't doctors know this already? Maybe THEY have skin in the game. We are not medical professionals, and as such, we have very little to judge. Also, if the doctor belongs to a clinic who's numbers are down, how de we know if they are sincere when they say "yes, this test is needed"

Here is an idea, how about some STANDARDS!
photo
multidoc
Re-animating the dead since 1922
05:35 PM on 08/22/2011
You won't be seeing what you want any time soon. The business of medicine fights such things tooth and nail. The idea is to increase utilization in order to increase profits, and until that correlation changes, nothing else much in the practice of American medicine will. My advice: find someone in your circle of family and friends who is at least a semi-professional in medicine (nurses and EMTs are just fine) and ask them to help you out when you need it. Failing that, at least get second opinions, and get them OUT OF YOUR NETWORK.
photo
thejazz
I'll burn that bridge when I come to it.
08:28 PM on 08/22/2011
It is sad in america where wal-mart comes up with the plan to reduce drug costs ($4 persrciptions), and you have to hit up your friends, or DIY for medical advice. And if you get sick, you are a profit center for the entire medical system and every test they can throw at you.
MommyMD
MD, Professor, Mom
09:53 PM on 08/22/2011
Most of us know which tests are necessary, which tests are being forced on us by the patients, which tests are unlikely to change our clinical impression (pre-test probability)...and which tests we order as part of defensive medicine.
But, our system is broken. We like to take care of patients and use our learned clinical judgement (in my case, helped along at Yale with Dr. Katz). Unfortunately, the threat of lawsuits often forces the doc to order millions in unneeded tests. And....before anyone criticizes....with the 11+ years of training, the 300K in debt, and a true calling to the art of medicine, most of us do not want a career-ending lawsuit. Right or wrong-- a lawsuit is devastating. Unfortunately, this where the "business" of our current system has lead us.
I do not blame patients for being angry. You didn't go to medical school, review literature on test characteristics. You are an educated consumer, trying to navigate the murky depths of the system. I don't even know what diagnostics my car really needs...I can't imagine playing the game with my body. Standards, of course. But don't expect them from insurance companies, or docs under the threat of lawsuits.
photo
thejazz
I'll burn that bridge when I come to it.
09:09 AM on 08/23/2011
We will absolutely not get any standards from insurance companies, they are here to make money not provide health care, and I do respect the years of training and debt to get there. But Medicine is not a make work project, nor should it be a ticket to pay off a student loan. If this IS a great concern for the country, then why should only the sick bear this cost? I can have a little sympathy for this position, a little.

Personally, I know that my Family doctor knows what tests are needed or not, and I can have options. Some specialists I see? Not so much. They work in a clinic, and it is all revenue. It is a HUGE fight to try to avoid unnecessary testing or followup visits.

Lawsuits I would say are a problem, and the current system is set up to do a massive amount of testing. If the threat of lawsuits went away tomorrow, and doctors started only testing for what was necessary, this would create a large number on unemployed techs that need consideration just as much as MD debt.
You are correct that they system is broken. It costs me a large amount of money each year for nothing, and about 100 hours to keep track of paperwork. No matter how hard I try and talk to the doctors I see, they will not cooridinate. The system has to be focused on providing care for people. period, everything else is secondary.
12:10 PM on 08/22/2011
Tsk, Tsk Dr. Katz, you know better. Sensitivity and specificity are import research statistics, no doubt, but they really do not provide the information that patients are looking for. My patients want to know what is the chance that a positive test means that they truly have the disease, or conversely, if it is negative are they in the clear. The classic question posed to medical students: You order a single test that is 95% sensitive and 96% specific and it come back positive. What is the chance that they actually have the disease? It is a trick because you can't answer the question without knowing how common is the disease. Leaving the arithmetic aside, your rule of thumb doesn't hold in the significant fraction of diseases that are either very rare or very common. For example, a positive result on a test with very high specificity for very rare disease, is usually still wrong. In contrast, for a common disease, a negative result on a test with poor specificity is still probably correct. As a result, there are a lot of "confusing" test results. This is why we have the following maxim, treat the patient, not the lab value. Phrased a different way, your doctor should be basing her treatment decisions on many factors since it is hard to have overwhelming confidence in any single piece of information.

Eric M. Wexler. M.D., Ph.D.
Assistant Professor
UCLA Center for Neurobehavioral Genetics
photo
HUFFPOST BLOGGER
David Katz, M.D.
Director, Yale Prevention Research Center; Editor-
01:03 PM on 08/22/2011
No tsk tsk required; next column is on predictive values. You anticipate me. Once you see that one, let me know what you think.

I have written a text book on clinical epidemiology, so I'm well versed in all the subtleties here. The challenge is dicing them to fit reasonably in posts suitable for HP. Statistics, serialized as it were.

Best,
DK
11:56 AM on 08/22/2011
A friend of mine recently had kidney stones and his doctor wanted him to have a cat scan, which he refused both because of the cost and the high radiation dose. There was a time not too long ago that doctors would diagnose kidney stones without any scans at all

After using $20.00 worth of over the counter herbs, his kidney stone pain went away in 24 hours. Over-testing is out of control in this country -- and we wonder why our healthcare costs keep going up so dramatically.
10:59 AM on 08/22/2011
Good advice---in addition---my personal campaign--never--ever--get a CT scan/MRI or plain films for that matter at your doctors one-stop shop. A qualified and trained Radiologist will more than likely NOT be reading your films, and how do you know if the machine needs to be paid for--or you need another test. This is callled self-referral--the place to cut in Medicare. Recent studies show an output of billions of dolllars--for not much benefit. .