iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
GET UPDATES FROM Stacie Nevadomski Berdan
GET UPDATES FROM Rebecca Weiner
 

Why the PISA Debates Are Misleading -- and Useful

Posted: 12/13/10 02:02 PM ET

Sam Dillon's front-page New York Times story on December 7 about students in Shanghai trouncing U.S. student scores on the global PISA exam has stirred quite a debate, as it was clearly intended to. Dillon quoted Reagen-era U.S. Department of Education official Chester Finn comparing the score gap to "Sputnik," the Russian satellite that launched the "space race" a generation ago. ABC News called the PISA results a "wake-up call." The Times online closed comments on Dillon's article after receiving 712 of them.

Much debate centers on China: why China leads PISA scores, China's focus on rote testing, China's challenges in promoting creativity, and critical thinking. China's "high test scores aren't everything," one Times online commenter writes plaintively. Other debaters question PISA test results. Dillon quotes Bush-era DOE researcher Mark Schneider demurring "there was no evidence of cheating" in Shanghai scores. A National Review blog derides "bogus" comparisons between Shanghai municipal scores and U.S. national scores (a point Dillon also raised); National Review comments rage against Chinese cheating and censorship. Even the excellent James Fallows, while reminding us to take PISA scores seriously, spends most of his blog on possible statistical flaws.

Methinks the bloggers doth protest too much. China is not the issue. Chinese statistics are not the issue. The statistical issues Dillon and Fallows discuss may explain why Shanghai significantly topped scores from ALL non-Chinese nations tested. They don't explain why the United States ranked 25th in math, 17th in science, and 14th in reading out of 34 countries surveyed. Or why students across Europe excel in two languages (three in Finland, which also tops the science ratings) while ours score in English below countries for which English is not a native language.

The truth, the real news, is that there is no news here. These results should be no surprise. The long slide in American student performance relative to global peers has been a constant drumbeat, paralleling the domestic failures of our schools shown in Waiting for 'Superman'. The DOE's National Center for Education Statistics (NCES), tracking math and science scores since 1995, has long found us in 15th place globally or worse. A 2005 panel on "Creating a World-Class Education System in Ohio" concluded that given poor U.S. scores, "high ranking within the United States is no longer enough" to count as global excellence.

There is plenty of blame to go around for the perennially sad comparisons between United States' and global scores. The left tends to focus on poor teacher salaries and budgets that favor the military over education. The right tends to focus on poor parenting, teacher's unions, and an overgrowth of educational bureaucracy. Many also blame our students themselves. "PhD scientist," commenting on the Times online, fumed "Most of the people who work around me did not grow up in the U.S... There is a complete lack of interest [among U.S. students] in learning anything of economic value." Those criticisms may well ALL be right -- none of those factors are mutually exclusive.

The real question is how to get past the politics, and the blame games, and work together to better our educational results. While China is not the real issue, if a Sputnik-style push to do better based on being trounced by Shanghai helps spur a real answer, that's fine by me. Together with my frequent co-author Rebecca Weiner, I have long focused in my writing on the need for stronger global awareness, more foreign languages, and greater overall excellence in our educational systems. If the PISA test results give us the impetus we need to truly prioritize academic education -- in our families, communities, governments, and schools -- then all the hype will be more than worthwhile.

What do you think will help the United States improve its test scores and better prepare our students for global competition?

 

Follow Stacie Nevadomski Berdan on Twitter: www.twitter.com/stacieberdan

 
 
  • Comments
  • 36
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
Page: 1 2  Next ›  Last »  (2 total)
03:00 PM on 12/20/2010
POVERTY...deal with poverty. Provide work and a living wage. According to UNICEF, Report Card No. 6, "Child Poverty Rates in Rich Countries," among 26 developed countries, the United States is second to the bottom with 21.9% of children living in poverty. Given that this study was conducted in 2005, I am sure the child poverty rates have risen. Costs more to incarcerate than to educate.

What is wrong with this picture? Answer: Greed.

Follow the money and ask, "Cui bono?"
10:46 AM on 12/19/2010
I am someone who has both worked in and been a post-secondary teacher in a science heavy field. In my experience with several hundred of the highest performing highschool graduates in this nation, I found the following. Most students who do exceptionally well on standardized tests (in the 95th percentile or better) are utterly incapable of thinking about or discussing the ideas and theories behind those facts conceptually, much less applying them to a conceptual or real world problem. Standardized testing leads to rote memorization, not understanding, and certainly not critical thinking (the most important skill of all). The more we focus on standardized testing, the more we become like the rest of the world; easy to substitute, easy to replace, and just another similar resource in the global marketplace. If the US wants to regain its status as a world leader in technology, we need to teach our children how to question tha status quo, and then develop the solutions to those questions.
02:46 PM on 12/18/2010
We should name this piece (like most published pieces on education in the media) "Why This Article Is Misleading—And Useless":

• Waiting for Superman as a basis of argument discounts the credibility of the entire piece.

• Making sweeping claims about the role of MEASURED student achievement in the economy of any country compared to the rest of the world is evidence of falling prey to Urban legend while ignoring the evidence (See Bracey's Setting the Record Straight).

• Seeing education as a tool in global competition misreads the value of education and ignores the corrosive influence of all competition.

• Examining international comparisons without identifying differing populations among nations and the powerful impact of poverty on all test scores (80-90% of scores connected to out-of-school factors, not teacher or school quality) is misleading and careless.
11:15 AM on 12/16/2010
When comparing the US to China or Finland, we continue to omit the relevant factor that those countries mandate student education through grade 9 and 10 respectively. In the US, we mandate 12 years. Furthermore, in China, there is an exam after 6 years' education. If a student fails, he is retained. If he passes, the test data (scores) determines which school the child will then attend; in other words, they track and educate students according to their ability. So, while here in the US we seem noble and forward by mandating every single child has the exact same education for 12 years regardless of ability, regardless of varying types of IQs, regardless of a student's interests, we actually hinder each student. When we compare our test results to countries like these, we are comparing every single student to their highest echelon. Not accurate data at all. And certainly not on what we should base American education reforms.
06:37 AM on 12/17/2010
You make some very good points. Tracking by ability does happen in many countries, and used to be used more here. Sometimes that policy was abused, and the Americans with Disabilities Act corrected a lot of extremes. But in some cases the baby was thrown out with the bathwater. I actually agree that part of better preparing our college-bound students for college may be to recognize those students who may be better suited for vocational education, and offer them robust and effective vocational training options that are treated as important, as crucial for our economy (we NEED good fire-fighters and med-techs and plumbers and auto mechanics, jobs that often now go to recent immigrants because US-born people aren't trained for them and see such jobs as "beneath" them). Tracking shouldn't be too hard-and-fast, though; I know people who were "late bloomers" in other countries and got (side)-tracked into voc-tech programs, then discovered their passions and abilities in the freer educational climate here - some becoming well-known scientists, writers, etc. Hmmmm....perhaps a topic for another blog.....
photo
HUFFPOST SUPER USER
talilah33
09:26 AM on 12/16/2010
"Or why students across Europe excel in two languages (three in Finland, which also tops the science ratings) while ours score in English below countries for which English is not a native language."
Really?! That's why Americans always compliment me on my English..I was getting suspicious.^^
photo
HUFFPOST SUPER USER
Shelley Gordon
12:01 AM on 12/15/2010
I have news for all of you. The people of the United States do not value education. Oh, they may say they do, they might even delude themselves into believing they do. When push comes to shove however, when asked to pass a referendum for example or accept an increase in income tax or other similar action, to put their money where their mouth is, the answer is an unequivocal no way.

Like it or not, we will not get a "world class" education system unless all the elements that make that possible come together. It is not happening. If anything, what exists is unraveling at lightening speed. Americans are aiding and abetting the war on public education with their wilfull ignorance of the issues and their silence as teachers and teacher unions are tarred and feathered by self-proclaimed arrogant education reformers with large and unjustified egos.

In a decade, there will be little left. America will be further behind then it is today. The preteens of today will be facing a future without meaningful opportunity and American democracy will be gasping its last breath. When that happens, I will remind you all that you reap what you sow.
05:47 PM on 12/14/2010
I'm not a teacher and do not consider myself grounded deeply enough in to comment, but...here's something interesting. I sent an email to one of my child's teachers, one whom I've had conversations with about education, etc. and asked her for her take on this. She answered that 1. her email is monitored, so she can't talk about it, and 2. as she's reminded, she works for the school board and can't talk about it. Fair enough. I don't want anyone in trouble.
But where does a parent go to begin a dialogue, if not to a teacher on the ground in their own community.
09:51 PM on 12/14/2010
Sadly, teachers and principlas are handcuffed at best and, at worst, they've drunk the kool-aid. There is power in numbers and so, I recommend you try to build a small but effective group for change. But you need to know what you want to achieve. Rebecca and I advocate for change in our communities and would like to build a groundswell of support to better prepare our students for a global economy -- not to take tests well. Write us at stacie@stacieberdan.com.
10:05 AM on 12/14/2010
I tutor high school kids for a living. EVERY one of my foreign students AGREE that honors classes are somewhat as tough as their regular classes. But, if you really want a class equal to those in Canada, the middle east, etc., you must take AP classes. In other words, regular classes here are a joke and these kids earn 95% or better WITHOUT trying that hard until they find themselves in more advanced classes.
09:55 PM on 12/14/2010
You make a good point: These scores are averages and so some schools/classes exceed these scores and some fall far below. The problem is it's the average we're worreid about. Elite have always found ways to better educate and better prepare with $. We need to make a dfference for ALL American students. .
09:45 AM on 12/14/2010
Why are so few of us questioning the validity of these, and similar, tests? Why is a progressive blog site embracing an agenda that is the brain child of the corporatocracy?

The current educational reform movement is not about real reform. Instead it is a particular set of ideas that originated in the corporate boardroom being spun to the American people as educational reform. The very community that has brought us the current economic catastrophe is taking control public education and they are doing a skillful job, thanks to the state of the media today in this nation.
When the very people who work day in and day out in classrooms with school children suggest these reforms are not solutions, they are called obstructionist and their very power to organize is challenged, by both the conservatives and the progressives; thanks to our media.

This faux reform being forced upon us, withot discussion, amounts to the 21st century incarnation of the factory school, whose mission is to educate compliant workers who don't challenge or question orders.

Authoritarian leaders, oligarchs and the like, know a truly educated, informed, thinking and reasoning citizenry with the power to question the status quo and to ORGANIZE themselves is always the enemy.

To identify successful, longterm reform, Americans should look to nations that have pulled themselves up through carefully building an empowering public educational system over a period of years. Fear tactics and short term quick fixes are largely a waste of time and money.
09:58 PM on 12/14/2010
Our piece does not push any particular reform agenda froward. We simply want everyone -- parents, teachers, administrators, students -- to recognize that something must be done and to ACT! We must put education first otherwsie we will not be able to compete on a global scale in the next few decades.
09:58 PM on 12/15/2010
Oh yes indeed you are another one of the folks pushing the corporate agenda of global competition and glorifying Superman propoganda. I am a lefty, a progressive. Most schools are good in US. Poverty is the problem. Go teach in a poor school for a year then come back with your fine ideas.
09:58 AM on 12/16/2010
As usual, the situation in which we find ourselves is many shaded and complex. There is not a single factor (i.e. education) that is causing our so-called lessened ability to compete. Certainly the corporate culture that has evolved in recent decades which places steadily increasing profits each quarter above all else is a contributing factor.

Look around, it is in vogue in corporate circles to always be making more money. While I acknowledge that businesses must make money, the trend toward disregard for human capital in the interest of ever larger profits was not always the m.o. here in the U.S. There was a time when many (never all) employers considered their workforce to be their greatest asset. Loyalty to your workforce (and it worked both directions) was an important variable.

Today we watch as corporations off shore jobs to pay lower wages, and engage in wage and benefit cutting in the U.S. It is disturbing to watch a company that has just produced increased profits the quarter employ these practices to further boost profits in the current quarter.

I do not fault our educational system entirely for the decline of the American worker and for the business practices we are seeing today. The American corporate mentality is doing its part to wreak havoc on our nation and now we have all but turned our public schools over to that regime. Time will tell.
09:39 PM on 12/15/2010
Excuse me, I am a lefty and the education "reformers" are the most anti democratic, anti equal education, anti union, anti child, and deceitful group of people I have ever seen in my thirty years in education. Yes, as a progressive I know that poverty is the major factor in education. No punitive measures based on ignorant and elitist folks glorifying corporate propoganda will do anything but destroy public education in America.
07:33 AM on 12/14/2010
You need to teach children to read,spell and write K-3 honoring your own conclusions on process.The NICHD research study,half a billion dollars worth of research and the National Reading Panel concluded hands down that explicit systematic synthetic phonics,phonemic awareness,(a brain process that teaches kids the separation of speech sounds),then we show them what the speech sounds look like(graphemes),then we practice the in and out brain work of reading and spelling which is the synthetic part(blending and segmenting through linguistic gymnastics),then we get them to practice practice practice to build fluency,we tell stories orally every day to build oral vocabulary and critical thinking and comprehension-all of it needs to be connected to print.
If you teach them to read their math and science will go up-when you struggle to read you struggle to comprehend everything.
Stop letting your billion dollar publishers kill your education system with their edutoys.
10:02 PM on 12/14/2010
Yes, I agree that reading is key and so is foreign language learning. Research on the latter illustrates that cognitive abilities go up but so many people don't see value in learning a foreignlanguage! "Everyone speaks English in the world" is something I hear often. Yes, so what? Who has the upper hand, the American who speaks English or the Brazilian or speaks Portugese AND English? It's a no brainer and could be one of the reasons so many other countries did better than the US.
08:51 AM on 12/15/2010
speaking and reading are two different matters-
03:32 AM on 12/14/2010
Really, it's not that difficult. We need to "start with the end in mind." If we decide that international tests like the PISA are worthwhile, then teachers will prepare students for these tests, which most teachers have never heard of. For the last several years, each state has created its own assessments. Now 40 states have joined the Common Core Standards bandwagon, and teachers will prepare their students for the assessment that goes with it. It will take a few years to get this new test right. The standards for the CCS may not be as rigorous as we would like, but we can raise them over time. The answer to your question is this: what is the real question? It is: what part should testing play? As long as schools are labeled because of test scores, principals will insist that teachers prepare only for what is tested -- right now that's NOT science, social studies, art, music, etc. The entire K-8 system is out of whack because of the emphasis on these tests. Students are showing up in high school who have not been taught science or social studies for years because they've been preparing for these tests. It's a train wreck about to happen.
theschoolprincipal@inthetrencheswithschoolreform.com
www.inthetrencheswithschoolreform.com
10:03 PM on 12/14/2010
Agreed and the "end in mind" is young adults prepared to work in a global economy who will be competting with others from around the world.
12:59 AM on 12/14/2010
The point of the article was to sidestep the criticisms of the test itself and focus on what we do know: the United States IS falling behind internationally and we DO need to have a discussion about the current and future state of education. This is a discussion that needs to be had at the federal, state, county, and district level, and it needs to include more than just educational experts. Further, those discussions need to lead to tangible change in federal, state, and local policy. This country's future as an international superpower rests on its ability to prepare future generations for lives as critical thinkers, capable workers, and involved citizens.

We need to ask critical questions: how do we improve our teaching workforce? what is the purpose of public education? what should be the relationship between school and community? how do we decide what to teach? how do we close the achievement gap? how can we measure teacher and student success effectively? what do students need to know in order to succeed in their communities, in the larger society, and on an international scale?

Enabling and encouraging this kind of critical dialogue will be the second step towards improvement. The first step, simply put, is to make education a higher priority. We have to value the process and commit to improving it before conversations about 'how' can really have power behind them.
10:05 PM on 12/14/2010
Agreed - Education must be the priority and, hopefully, with such tests combined with parents ADVOCATING for change, we might be able to begin to move the needle.
08:53 AM on 12/15/2010
agree-process,not just broad stroke discussions.
been2there
Facts have a liberal bias.
11:56 PM on 12/13/2010
What does the US need to do? It must value education for itself, not merely as a means to an end. I must respect knowledge--as Palin and Tea Partiers do not--and it must respect teaching as the time and resource intensive enterprise it is.
That would be a start.
photo
StinkyBush
Meet the new boss Same as the old boss
08:28 PM on 12/13/2010
These rankings are like comparing apples and oranges. In these other coutries, students who take the test are tracked. Those not on an academic track are excluded. In the USA however, since we do not track students.

I would like to see what the results are by comparing our top 5% vs. theirs. We still might be behind but not on the scale suggested in this article.

Also, when have the Chinese ever had an original idea? Never! There is a lack of creativity in that country which will soon sweep over the USA now that we are putting such a heavy emphasis on testing under NCLB and Race to the Top.
photo
StinkyBush
Meet the new boss Same as the old boss
08:23 PM on 12/13/2010
These rankings are like comparing apples and oranges. In these other coutries, students who take the test are tracked. Those not on an academic track are excluded. In the USA however, since we do not track students.

I would like to see what the results are by comparing our top 5% vs. theirs. We still might be behind but not on the scale suggested in this article.

Also, when have the Chinese ever had an original idea? Never! There is a lack of creativity in that country which will soon swoon over the USA now that we are putting such a heavy emphasis on testing under NCLB and Race to the Top.
10:09 PM on 12/14/2010
How do you know every student in every other country tested is tracked? Based on what I've read, past testing has had its faults, but everyone agreed that this year's were on an even playing field. And even if Shanghai is not a good representative, why are #31? Why are Singapore, New Zealand and Finland ahead of us? Agreed testing is not ideal but we must measure progress and this test is a strong indicator that the US education system -- still based on the old agrarian system - needs to be adjusted to teach toward the 21st century and the global marketplace.
09:49 AM on 12/17/2010
Stacie, there is much folks who look in the window at education do not have any experience with. A major issue is the massive child poverty rate we have in this country. Small, somewhat more homogeneous nations like Finland have child poverty rates below 5%, while ours exceeds 20%. Our top students do as well as theirs. Singapore, is tiny, and it has made education and innovation a priority and has been willing to implement incremental changes have paid off over 20 plus years.

We do not ever to that here. We shout and stomp our feet, dig in our heels and blame our teachers.

Incidently, China has a system where every family has a legal place of residence (a city, town or province). The many poor who leave their provincial homes and travel to Bejing or Shanghai, etc. in search of work do not have legal status in those cities, so their children do NOT have the right to a free, public education (except in their place of legal residence). This is a pernicious way of keeping some of the most needy out of the public school system and these, perhaps millions, of students never need be tested. They are typically, and obviously, the children of the poorest people in the cities (the "migrant" worker).

Many factors are not considered. We must intimately know a country, its practices and culture to know whether we are comparing apples to apples, or not. Usually it is not.
photo
HUFFPOST SUPER USER
talilah33
09:23 AM on 12/16/2010
That's not true. All other 33 countries? lol