iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Jeremy Rosner

GET UPDATES FROM Jeremy Rosner
 

A Pollster's Advice: Don't Trust the Polls on Health Reform's Demise

Posted: 08/26/09 01:00 PM ET

As Congress moves toward the decisive phase on changing America's health system, many analysts claim that declining poll numbers on health reform mean it's unlikely the effort will succeed. While support for reform did slip over the summer, here's some advice from a pollster: don't put all your trust in the polls on this one.

It's striking how many respected voices equate the middling support that health reform now gets in opinion surveys - little better than during the ill-fated Clinton health reforms in 1994 - with low probability of congressional success. The New York Times writes that with "polls showing public support on the wane, advance obituaries [for health reform] are starting to be written." Republican pollster Glen Bolger blogs that new polling numbers "illustrate why the Dem health care plan is on life support."

I'm not one to doubt the power of polls. Ever since George Gallup nailed the 1936 election using scientific sampling techniques (while the Literary Digest, using flawed sampling, predicted an Alf Landon victory), we've known that soundly-conducted polls are generally good guides to election results. But polls are much less accurate at foretelling legislative momentum and outcomes.

Consider: majorities opposed using taxpayer money to bail out US automakers, but Congress provided it anyway. Majorities favor a ban on assault rifles, but Congress recently allowed such ban to expire. There are scores of other examples.

So if polls about policy proposals don't accurately predict legislative outcomes, why do so many people focus on them?

Here's an inconvenient truth for my profession: many people rely on polls as a guide to how policy debates will come out because it's easy. It's relatively easy to conduct polls. The numerical results are easy to report and track. And numbers convey an easy sense of certainty - particularly since polling numbers on elections usually prove roughly accurate.

But this is a bit like the drunk looking for his lost keys next to the streetlamp, simply because that's where the light is better. There are lots of reasons why polls don't do well at predicting the legislative process. And in the current health reform fight, here are five reasons why middling polling numbers at this point don't mean this legislation is DOA.


1. Polls under-emphasize the heavy-weights in policy fights.
For starters, polls give equal weight to each person's opinion. That's perfectly sensible for predicting elections, where each person gets one vote. But it makes much less sense in the context of the legislative process, where inequality is the rule. In the health debate, as in other policy debates, lobbyists for major sectors (e.g., insurers), prominent community figures (e.g., physicians), and people with a wide circle of acquaintances (e.g., the local barber) all tend to have extra influence. Yet polls ignore the extra clout of these heavy-weights and influencers.

The current health reform polling numbers may be comparable to 1994, but they miss a big change in the line-up of such heavy-weights. This year, the American Medical Association, big drug-makers, and other key industry groups are either supporting reform or staying neutral. The millions some of these groups are spending on pro-reform ads, and the community-level influence of many of these professions, may make a big difference.

2. Polls don't reflect what happens in safe districts. Most of the attention over this August recess went to the screamers denouncing health reform at the town hall meetings of members of Congress. To be sure, that had some impact, hijacking the news coverage, driving down support among swing voters, and giving pause to some key Democrats in vulnerable seats (and there are many of those, after two waves of Democratic wins).

Yet the focus on aggregate poll numbers blurs what goes on in most congressional districts, where, unfortunately, most representatives have limited political incentive to care about aggregate support. As America's geography has become more politically polarized in recent decades, with well over two-thirds of all districts either safely-Blue or safely-Red, lots of members worry less about overall opinion, and more about shifts among the small fraction who reliably turn out in their own party's primaries - in off-year races, less than 20% of the voting-age population. That fact explains why many members are not so concerned about the slipping polls or the rabid screamers. Remember the woman with the picture of Obama-as-Hitler at Rep. Barney Frank's town hall? Probably not a Democratic primary voter. That's why Frank felt safe accusing her of being from another planet, and why so many members remain firm in their support for reform.

3. Polls miss the dynamics of anticipation. Polls measure how people feel today. But when politicians act on a bill, what they think about is how voters will feel at the next election. We pollsters try to measure that kind of "anticipatory" opinion - such as by testing the texts of mock attack ads. But a voter's reaction to such scripts may well be very different today than a year from now - particularly if, at that point, health reform has gone into effect without catastrophic results, and if the economy has improved to boot.

That highlights a huge change this year relative to the Clinton reform era. Most Democratic politicians took a big lesson from 1994, when failure to enact health reform contributed to the GOP's House takeover. Today, many Democrats recognize that passing controversial reforms may be less politically risky than passing no reforms - especially since voters may rally around a party that finally makes reform a reality. As President Clinton recently said: "I don't care how low [Republicans] drive support for this with misinformation; the minute the president signs the bill, his approval will go up." Many members are anticipating those dynamics in ways that the polls do not.

4. Polls don't factor in the political balance. Too many observers also read polling data about policy debates in isolation from the political context surrounding the legislative process. But identical numbers can mean very different things at different times.

Having been in the Clinton White House during that health reform effort, I'm struck by how much better the political fundamentals are now - even if the poll numbers on health care are comparable. Divided support for reform means something very different when you have 60 Senate seats than when you have 57, and when the president was elected with 53% rather than 43%. Having the votes is more important than having the polls, and the reported willingness of the Obama administration to drive health reform through the filibuster-proof "reconciliation" process suggests they understand that difference well.

5. Polls miss the role of representatives' judgment. Finally, especially on complex issues like health care, polls tend to overlook the influence that experts have on the legislative process and how representatives bring their own judgment to bear. This is not an accidental consequence of polling. George Gallup argued that experts and other elites had too much power in America, and that polls - by equally weighting everyone's opinions and thus creating a vox populi - provided a way to offset that power. This is why he originally called his technique "the sampling referendum," and called on politicians to follow the public's will more faithfully: "If it is argued that legislators understand better than the people what the people want, it is but a short step to give legislators the power to decree what the people ought to want. Few tendencies could be more dangerous."

That's a nice populist argument. But it's not an accurate way to think about the legislative process America's founders created, which intentionally inserted multiple layers between the voters and legislative outcomes.

Indeed, although it is mostly lost to dusty academic shelves, there was an important debate in the middle of the last century about how Gallup's techniques approximated direct democracy rather than our representative democracy, and whether his improved polling techniques therefore really measured anything that even deserved to be labeled "public opinion," in the context of policy debates. In 1948, University of Chicago sociologist Herbert Blumer argued that polling on policy issues did not provide an empirical measure of anything real in the political process, but instead was an effort to "[hang] on the coat-tails of a dubious proposal for social reform." That's a debate worth reviving.

None of this is meant to suggest polling results on policy issues are irrelevant. Polling is a great tool for measuring awareness, gauging underlying attitudes, testing political arguments, designing issue campaigns, and tracking changes in support among key groups.

Nor am I suggesting the Obama administration's health reform effort is on an easy glide path to success; it obviously still faces huge hurdles in Congress. But the height of those hurdles is not a function of poll numbers - which means that the chances for success when Congress returns may remain better than many obsessive poll-watchers suggest.

 
As Congress moves toward the decisive phase on changing America's health system, many analysts claim that declining poll numbers on health reform mean it's unlikely the effort will succeed. While sup...
As Congress moves toward the decisive phase on changing America's health system, many analysts claim that declining poll numbers on health reform mean it's unlikely the effort will succeed. While sup...
 
 
  • Comments
  • 31
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
Page: 1 2  Next ›  Last »  (2 total)
This user has chosen to opt out of the Badges program
photo
06:00 AM on 09/23/2009
#6. Unlike an election, these polls don't poll the decision-makers. They're asking Tom, Dick, & Harry what Mary's going to do. What do they know?
06:26 AM on 08/28/2009
This website swears by polls that favor democrats. When they dont, this website explains why they are flawed.
photo
HUFFPOST COMMUNITY MODERATOR
Emerald1943
11:41 PM on 08/26/2009
It really boils down as to which pollster is conducting the poll and what their particular political "leaning" happens to be. For instance, during the election last year, Rasmussen continually polled in primarily Republican areas of the country and had McCain/Palin winning practically up to the end. For that reason alone, I give them little if any credibility!
10:32 PM on 08/26/2009
No kidding the polls are BS! Today I read an article at Truthdig and this came up: "Newsmax is conducting an urgent national online poll about President Obama and the Democrat's plan for universal health care... will provide results of this poll to major media outlets... Newsmax reports are cited by major media outlets including CNN, ABC News, Fox News, CBS, etc." I'd never heard of Newsmax but it already felt Republican. I decided to answer just to observe their content and process. Then "Homeland Security Alert" came up -- yep, it's the land of the fear-afflicted (Repubs). Then: CB radio offer including "4 free copies of Newsmax magazine.. with hard-hitting investigative reports and special commentaries from Ben Stein, Dick Morris, Dr. Laura Schlessinger, John Stossel, Bill O'Reilly, etc." Ha! Then thanks for casting my "vote" in their poll -- results would be emailed. Then: more thanks and "results are listed below. Special note: The poll results may include data for questions that were not included on the poll that you took." What? Poll results may include data/responses to DIFFERENT questions? Results are manipulated and they try to cover themselves with that? Results: 3-to-1 against Obama on every question. What a sham. Amazing that CNN, ABC, CBS, or any major network would use Newsmax as a news resource. Then again, it's not so shocking.
09:51 PM on 08/26/2009
No kidding the polls are BS! Today I read an article at Truthdig and this came up: "Newsmax is conducting an urgent national online poll about President Obama and the Democrat's plan for universal health care... will provide results of this poll to major media outlets... Newsmax reports are cited by major media outlets including CNN, ABC News, Fox News, CBS, etc." I'd never heard of Newsmax but it already felt Republican. I decided to answer just to observe their content and process. Then "Homeland Security ALERT" came up. I knew I was in the land of the fear-afflicted. Then a CB radio offer including "4 free copies of Newsmax magazine.. with hard-hitting investigative reports and special commentaries from Ben Stein, Dick Morris, Dr. Laura Schlessinger, John Stossel, Bill O'Reilly, etc." LOL! Then an email thanking me for casting my "vote" in their poll and results would be emailed. Then "Thank you for taking the poll: Do You Support Obama's Health Care Plan?... results are listed below. Special note: The poll results may include data for questions that were not included on the poll that you took." What? Poll results may include data/responses to DIFFERENT questions? Results are manipulated and they try to cover themselves with one sentence? Results came out 3-to-1 against Obama on every question. What a sham. Amazing that CNN, ABC, CBS, or any major network would use Newsmax as a news resource. Then again, it's not so shocking.
This user has chosen to opt out of the Badges program
photo
04:11 PM on 08/26/2009
Wow! I'm a freedom loving Aussie and I find this paranoia over decent pubic health care amazing.

We've had it for almost 30 years.

I've expounded on this in many of Huffo's threads but let me simply say... America you deserve better, do not believe the Conservative lies.

NB: It took two goes in my country to get universal Medicare established. The Conservatives got rid of it when they got voted back in. The Labor Party re-established it at the next election after that. And although they have undermined it every time they got back into power the Conservatives don't dare try to get rid of it again. What I am getting at here is you have to push HARD for it- it's NOT going to happen through bi-partisanship.
photo
HUFFPOST SUPER USER
anelder
06:14 PM on 08/26/2009
The problem with so many americans is that they really don't know the english language or how government works well enough to contradict the stuff and crap thrown at them.
Item: Universal - what our government is proposing is not the change for all that universal implies.
Item: Option - so many send up the cry that government wants to limit our CHOICE. Knowing
that Option means choice would eliminate that fault in their minds.
Item: Government run system - a bad thing? Knowing that government already runs, Medicare,
Veterans health care and most of social security would/should remove that hue and cry.
Just those three issues, and thee are many more, would educate a substantial number of nay sayers.

Above all just listening to all the people around the globe who have various systems like this one proposed and are happy should have some influence. Maybe not - we are a messy bunch.
This user has chosen to opt out of the Badges program
photo
11:41 PM on 08/26/2009
I mean the Public Option, yes.
03:38 PM on 08/26/2009
Great post on polling? I would echo these points and add that political and public relations polling are often expressly designed to engineer public support/opposition for some candidate/policy. I responded to one last night (professional curiosity) that was trying to ferret out which arguments would move my support one way or another on a state-wide referendum. Few political scientists today would take seriously Gallup’s claim that polls make better democracy. First, public opinions about many issues are often quite “soft” in the minds of many voters, and thus prone to short-term manipulations by well designed PR campaigns in which small shifts make a difference. In addition, polling often glosses over many of the complexities underlying opinions. Do you support/opposed health care reform? Well, it depends on the specific reforms. Do you support the “public option”? Well, it depends on how it is designed and implemented. Would knowing “X” sway your opinion? Of course it would, if I actually believed “X” were true, but I don’t (there was no place in the response formats for me raise these points). Finally, the real concern is that over time the cumulative impact of relying on PR manufactured support/opposition makes people more cynical towards politics and poisons authentic civic discourse. Polling and social surveys can provide important insights into social issues, problems and policies, but can also be put to cynical use as a tool in the manufacture of opinion, especially when backed up by large advertising budgets.
04:21 PM on 08/26/2009
Sorry I mean to say" Great post on polling!" not "?"
HUFFPOST SUPER USER
emmasvoice
03:31 PM on 08/26/2009
I've never put much stock into polls. They mean nothing at all about the pulse of mainstream America. Polls are just media created talking points.
photo
HUFFPOST SUPER USER
anelder
06:18 PM on 08/26/2009
The difficulty is that those polls often make clear to politicians how to strategize their next primary. Those primaries are so often the way in which we get such really awful candidates. Don't know how to change it though.
03:26 PM on 08/26/2009
Thank you for this glimmer of hope on the health care bill!
03:15 PM on 08/26/2009
Socialism for wall street, banks, ceo's, agro-business, private defense contractors, corporations, in the form of subsidies and bailouts. For you and I-- the free-market, where if you fail, it is your own fault, and tough luck and tough love.
photo
HUFFPOST SUPER USER
Lark817
expat in Mexico
02:22 PM on 08/26/2009
I love Lou Dobbs' polls. Most of them start with, "How outraged are you....?"
02:14 PM on 08/26/2009
The MSM focuses on polls because it is easier (and MUCH cheaper) to quote numbers out of context than it is to do any REAL journalism.
It also makes it much easier to APPEAR to know what you are talking about to the clueless masses who are only watching out of the corner of their eye anyway.
Remember, 75% of quoted statistics are made up out of thin air...............(how many of you got that?)
photo
HUFFPOST PUNDIT
den1953
The National Inquire of Politics the GOP!
02:08 PM on 08/26/2009
It's not the polls that count it's the one controlling them some how people think there a true scope of what the American people want if your Republican it's going to reflect views from the right,when your a Democrat same thing so there bogus!
HUFFPOST SUPER USER
neve
01:19 PM on 08/26/2009
The polls also don't account for the fact that PROGRESSIVES are disapproving of the President's handling of health care because he appears to be appeasing the right too much.
01:14 PM on 08/26/2009
What's important to remember is that the polls about healthcare are responded to by a large number of ill-informed people. Why would any politician in favor of healthcare be influenced by a poll where people believe in death panels and all that junk? If we did a poll where people said the moon was made of blue cheese would we plan our next cocktail party there? I have to believe that Congress knows these polls in particular are not really a good barometer of health care reform.