WASHINGTON -- As they do on many obscure policy issues, Americans polarize sharply along partisan lines when they learn that President Barack Obama supports a repeal of the 1975 Public Affairs Act. Republicans are over 10 times more likely to disagree with the president on this issue than are Democrats.
There's one striking problem here: The 1975 Public Affairs Act does not exist.
The Huffington Post and its polling partner YouGov recently repeated a classic survey experiment that highlights both the tendency of Americans to divide along partisan lines on almost any issue and the dangers of over-interpreting the results of political poll questions.
Political scientist George Bishop and his University of Cincinnati colleagues were the first to ask about the fictional "Public Affairs Act of 1975." In a series of surveys that polled national samples about similarly fictitious or otherwise unknown legislation, they found 20 to 40 percent of Americans were willing to offer opinions on laws they have never heard of.
Their conclusion: Some survey respondents feel social pressure to answer the question asked, no matter how confusing or unfamiliar, so they may form new opinions on the spot, drawing cues from the words or concepts conveyed by the question.
The initial survey experiments were conducted by telephone or in person. While respondents could have volunteered that they "don't know," interviewers did not offer that option explicitly. Suspecting that some individuals were unwilling to admit ignorance, Bishop and his colleagues tested an alternative version that offered a third option: "haven't thought much about this issue." Giving respondents an out reduced the number of those expressing an opinion on the fictitious Public Affairs Act on one experiment from 24 to 4 percent.
The new HuffPost/YouGov survey's approach and the results obtained fall somewhere in between. YouGov's surveys are conducted online without an interviewer and typically offer "unsure" as an explicit response option on most questions.
In answer to the initial question, 15 percent offered an opinion -- 9 percent agreed that the fictitious law should be repealed and 6 percent disagreed -- while 85 percent chose "unsure."
That question, which began by informing respondents that "some people say the 1975 Public Affairs Act should be repealed," produced just a hint of partisanship. Democrats were only slightly less likely to agree than independents or Republicans that the law should be repealed, although given the sample size of 334 respondents, the differences between the subgroups were far too small to be considered statistically significant.
But the two alternative questions, each asked of separate samples of more than 600 respondents, made the partisan connection more explicit. When informed that "President Obama says" the 1975 Public Affairs Act should be repealed, 39 percent of Republicans expressed disagreement, compared to just 3 percent of Democrats. When informed that "the Republicans in Congress" want to repeal the act, 28 percent of Democrats disagreed compared to just 4 percent of Republicans.
Finally, we asked all of our respondents what they thought the Public Affairs Act was about. Far more thought it was "an attempt to reduce lavish fundraisers by elected officials" (11 percent) than believed it to be "a requirement that all members of Congress hire public affairs firms" (3 percent) or "a ban on extramarital affairs by members of Congress" (3 percent). The rest either opted for "none of the above" (20 percent) or were uncertain (64 percent).
The lesson here is straightforward: Many poll respondents will offer opinions on issues they know little or nothing about, making it difficult to distinguish pre-existing opinions from reactions formed on the basis of the words of the question. Poll respondents will find it even easier to offer an opinion when informed where well-known political leaders stand on the issue.
It is always best when interpreting survey results to consider how familiar Americans are with the issue, how many are reluctant to offer an opinion and how those who are closely following an issue differ from those who are not.
The poll was conducted March 29-30 and April 5-6 among a total of 1,664 adults using a sample selected from YouGov's opt-in online panel to match the demographics and other characteristics of the adult U.S. population. Factors considered include age, race, gender, education, employment, income, marital status, number of children, voter registration, time and location of Internet access, interest in politics, religion and church attendance.
Also on HuffPost:
Obama Holds Final Primary Night Event In St. Paul
ST. PAUL, MN - JUNE 3: Democratic presidential candidate Sen. Barack Obama (D-IL) (R) and his wife Michelle Obama bump fists at an election night rally at the Xcel Energy Center June 3, 2008 in St. Paul, Minnesota. Obama clinched the Democratic presidential nomination following today's primaries in South Dakota and Montana, although his rival Sen. Hillary Clinton (D-NY) has not yet conceded the race. (Photo by Scott Olson/Getty Images)
President Barack Obama acknowledges the crowd as he exchanges fist bumps with the audience after speaking at Hyde Park Academy, Thursday, Feb. 14, 2013, in Chicago. (AP Photo/M. Spencer Green)
Obama Fist Bump
President Barack Obama fist-bumps custodian Lawrence Lipscomb in the Eisenhower Executive Office Building following the opening session of the White House Forum on Jobs and Economic Growth, Dec. 3, 2009. (Official White House Photo by Pete Souza)
President Barack Obama does a fist bump
President Barack Obama does a fist bump with Ethan Gibbs, the son of Press Secretary Robert Gibbs, after arriving by Marine One on the South Lawn of the White House, Washington, DC, April 19, 2009. President Barack Obama returned from the Fifth Summit of the Americas held in Trinidad and Tobago. AFP PHOTO/Aude GUERRUCCI (Photo credit should read Aude GUERRUCCI/AFP/Getty Images)
Barack Obama Campaigns Across U.S. Ahead Of Primaries
SPRINGHILL, WV- MAY 12: Democratic presidential hopeful Sen. Barack Obama (D-IL) (L) bumps fists with Iraq war veteran Paul Scott after playing a game of pool during a stop at Schultzie's Bar & Hot Spot May 12, 2008 in Springhill, West Virginia. Sen. Obama and Sen. Hillary Clinton (D-NY) continue to battle for the Democratic presidential nomination. (Photo by Mark Wilson/Getty Images)
McCain And Obama Address LULAC National Convention
WASHINGTON - JULY 8: Los Angeles Mayor Antonio Villaraigosa (L) gives a 'fist bump' to presumptive Democratic presidential nominee Sen. Barack Obama (D-IL) during the national convention of the League of United Latin American Citizens (LULAC) at the Washington Hilton July 8, 2008 in Washington, DC. Obama has been recently criticized for moving to the political center after calling for a slowing of withdrawal of troops from Iraq, supporting a proposed wiretap law and government funding of faith-based programs. (Photo by Chip Somodevilla/Getty Images)
Barack Obama Campaign Weeks Away From Election Day
CHANTILLY, VA- OCTOBER 22: Democratic presidential nominee U.S. Sen. Barack Obama (D-IL) fists bumps with Ethan Gibbs the son of Robert Gibbs the campaign communication director as he arrives at Dulles International Airport October 22, 2008 in Chantilly, Virginia. Obama continues to campaign with election day less than two weeks away. (Photo by Joe Raedle/Getty Images)
U.S. Democratic presidential candidate Illinois Senator Barack Obama (right) and North Carolina Governor Mike Easley bump fists at Sen. Obama's surprise appearance at a North Carolina Democratic Party dinner October 4, 2008 at the The Grove Park Inn in Asheville, North Carolina. AFP PHOTO/Stan HONDA (Photo credit should read STAN HONDA/AFP/Getty Images)
President Barack Obama
BAGHDAD, IRAQ - APRIL 7: In this handout provide by the White House, U.S. President Barack Obama (L) receives a fist-bump from a U.S. soldier as he greets hundreds of U.S. troops during his visit to Camp Victory on April 7, 2009 in Baghdad, Iraq. Obama is serving as the 44th President of the U.S. and the first African-American to be elected to the office of President in the history of the United States. (Photo by Pete Souza/White House via Getty Images)
President Barack Obama
WASHINGTON - APRIL 8: In this handout provide by the White House, U.S. President Barack Obama (L) holding a football, offers a fist-bump, to senior staff member Pete Rouse (R), during a meeting with senior advisors in the Oval Office of the White House on April 8, 2009 in Washington, DC. Obama is serving as the 44th President of the U.S. and the first African-American to be elected to the office of President in the history of the United States. (Photo by Pete Souza/White House via Getty Images)
US President Barack Obama gives a studen
US President Barack Obama gives a student a fist bump while touring the Wind Turbine Manufacturing and Fabrication Lab at Lorain County Community College, in Elyria, Ohio, January 22, 2010. Obama is visiting Ohio to tour local businesses and hold a town hall meeting on jobs and the economy. AFP PHOTO / Saul LOEB (Photo credit should read SAUL LOEB/AFP/Getty Images)
US President Barack Obama bumps fists wi
US President Barack Obama bumps fists with a school children after reading Christams book 'The Polar Express' to an audience of elementary school children at the Richard England Clubhouse and Community Center in Washington, DC, on December 21, 2009. AFP PHOTO/Jewel SAMAD (Photo credit should read JEWEL SAMAD/AFP/Getty Images)
US President Barack Obama fist-bumps wit
US President Barack Obama fist-bumps with a supporter after speaking at a fundraiser for Senator Michael Bennet February 18, 2010 at the Fillmore Auditorium in Denver. AFP PHOTO/Mandel NGAN (Photo credit should read MANDEL NGAN/AFP/Getty Images)
US President Barack Obama (2nd-R) fist b
US President Barack Obama (2nd-R) fist bumps with Marvin Nicholson as he plays golf at Farm Neck Golf Club in Oak Bluffs on Martha's Vineyard, Massachusetts, on August 26, 2010. The US First Family is vacationing on the Island until August 29. AFP PHOTO/Jewel Samad (Photo credit should read JEWEL SAMAD/AFP/Getty Images)
President And Mrs. Obama Host Annual Easter Egg Roll
WASHINGTON, DC - APRIL 25: (AFP OUT)U.S. President Barack Obama gives a fist bump to a young boy during a 'Let's Move' tennis clinic during the White House Easter Egg Roll on the South Lawn of the White House April 25, 2011 in Washington, DC. About 30,000 people are expected to attend the 133-year-old tradition of rolling colored eggs down the White House lawn. (Photo by Chip Somodevilla/Getty Images)
US President Barack Obama gives a young
US President Barack Obama gives a young boy a fist bump as he greets guests after speaking about the economy at Shaker Heights High School in Shaker Heights, Ohio, a suburb of Cleveland, on January 4, 2012. Obama announced plans to appoint Richard Cordray as acting head of the Consumer Financial Protection Bureau in a recess appointment, bypassing Congress and setting up a bitter election-year legal showdown with Republicans. AFP PHOTO / Saul LOEB (Photo credit should read SAUL LOEB/AFP/Getty Images)
President Barack Obama fist bumps service members after he addressed troops at Bagram Air Field, Afghanistan, Wednesday, May 2, 2012. (AP Photo/Charles Dharapak)
US President Barack Obama (L) asks for a
US President Barack Obama (L) asks for a fist bump from a young girl as he speaks with patrons outside the Kozy Corner restaurant in Oak Harbor, Ohio, July 5, 2012, where he made an unannounced visit to speak with supporters while on a bus tour of Ohio and Pennslyvania. AFP PHOTO/Jim Watson (Photo credit should read JIM WATSON/AFP/GettyImages)
Obama Welcomes 2012 NCAA Women's Basketball Champions To White House
WASHINGTON, DC - JULY 18: U.S. President Barack Obama gives a fist bump to Baylor University basketball guard Terran Condrey while welcoming the 2012 NCAA Women’s Basketball champions in the East Room of the White House July 18, 2012 in Washington, DC. The Baylor Lady Bears became the first NCAA basketball team to complete a 40-0 season by defeating Notre Dame 80-61 in the NCAA women's championship. (Photo by Chip Somodevilla/Getty Images)
Barack Obama, Odyssey Sims
Point guard Odyssey Sims gets a fist bump from President Barack Obama at a ceremony honoring the 2012 NCAA Women's basketball champions Baylor University Bears in the East Room at the White House in Washington, Wednesday, July 18, 2012. (AP Photo/Charles Dharapak)
US President Barack Obama (L) fist bumps with supporters after delivering remarks during a campaign event at Truckee Meadows Community College in Reno, Nevada, August 21, 2012. AFP PHOTO/Jim WATSON (Photo credit should read JIM WATSON/AFP/GettyImages)
President Barack Obama pounds fists with a supporter after speaking at a campaign event at The Memorial Athletic and Convocation Center at Kent State University Wednesday, Sept. 26, 2012, in Kent, Ohio. (AP Photo/Tony Dejak)
US President Barack Obama fist-bumps with a woman during a lunch visit to the West Tampa Sandwich Shop and Restaurant in Tampa, Florida, September 8, 2012, during the first day of a 2-day bus tour across Florida. AFP PHOTO / Saul LOEB (Photo credit should read SAUL LOEB/AFP/GettyImages)
US President Barack Obama (L) fist bumps a supporter after speaking at a campaign rally in Nashua, New Hampshire, on October 27, 2012. AFP PHOTO/Jim WATSON (Photo credit should read JIM WATSON/AFP/Getty Images)