iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Glen Lineberry

GET UPDATES FROM Glen Lineberry
 

What's Wrong With Teaching to the Test? (Part 1)

Posted: 08/17/2012 11:37 am

This is not a defense of standardized testing.

Really.

Any teacher who teaches only to the test, or any district that tries limiting its teachers to doing so, is surely misguided. But the occasional misguided or lazy teacher doesn't mean the tests are themselves the problem.

That also doesn't mean the tests are unimpeachable. As a classroom teacher, I am all too aware of how the current NCLB-engendered reliance on standardized tests can pervert a solid, well-designed curriculum. (I'm somewhat immune, because I teach government and economics in Arizona, where we don't have a state exam in social studies, but raising scores drives everything we are doing in our school improvement process, and the folks teaching English and Math to sophomores are directly in the firing line.)

But the fact that an almost exclusive reliance on standardized testing can skew what happens in classrooms, doesn't mean it necessarily skews what's going on.

It's kinda like hearing people quote the Bible as saying "money is the root of all evil," when Saint Paul really wrote, "For the love of money is the root of all kinds of evil." Close, sure, but not really the same thing, is it?

Now I don't claim to be smart enough to understand the whole testing debate, but from a classroom teacher's perspective, it seems like everyone ought to relax and start with the things reasonable people can agree on:

Standardized tests stink as a way to evaluate students. Very little we do in life is going to involve filling in bubble sheets. Many students who can give a great oral presentation, make pertinent observations in class and write insightfully given adequate time, just don't do well on tests focused on recall and recitation. And by definition, "standardization" means the test cannot be adjusted to reflect geographic, socioeconomic or other differences.

The tests are getting better, and the shift to common core standards should move us up Bloom's ladder in ways that open up performance possibilities for those students mentioned above. We use the TAP system for evaluating teachers in my school -- most schools will soon use TAP or something similar -- and the shift to common core is starting to make sense to our faculty. To the extent that the state exams (AIMS in Arizona) assess basic academic skills, skills that apply across the curriculum, they're not so bad.

Standardized tests also stink as a way to evaluate teachers. Not everything teachers do is measurable right away, and teacher quality is not necessarily causally related to improved student learning. Without going all Kumbaya on you, we are forming minds and bodies, and some of the seeds a good teacher plants may not germinate for years. Besides, a teacher can teach the hell out of something, and a particular student still not get it on test day.

Anybody got a better idea than tests? You know, a workable one? It'd be great to have a corps of trained evaluators fan out across the country to conduct one-on-one interviews with every student and teacher, providing inter-rater reliability on a grand scale. But who's going to pay for it? And whom are you going to hire? We already lose too many teachers to administration and non-education careers; are we also going to pull out thousands more to staff our evaluation corps?

We need a little Solutionism around here. We're educators, which means we're at least a little smart, and a little educated, so we ought to try finding a solution accepting the level of standardization that's unavoidable because we're a big country with a lot of students, while still preserving the kind of human-scale assessment that any decent teacher applies to her students. (I'm stealing the idea of solutionism -- "the belief that, together, science and humanity can solve anything" -- so go to http://www.draftfcb.com/work-detail.aspx?work=453 for details on the original idea.)

See, I'm not defending standardized testing, I'm just not sure there's much in the way of an alternative.

 
FOLLOW EDUCATION
This is not a defense of standardized testing. Really. Any teacher who teaches only to the test, or any district that tries limiting its teachers to doing so, is surely misguided. But the occasional...
This is not a defense of standardized testing. Really. Any teacher who teaches only to the test, or any district that tries limiting its teachers to doing so, is surely misguided. But the occasional...
 
 
  • Comments
  • 16
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Recency  | 
Popularity
10:16 AM on 08/21/2012
For a solution to Glen's challenge, see http://www.fairtest.org/fact-sheet-better-way-evaluate-schools-pdf. Folks in MA (including FairTest) proposed this more than a decade ago. Yes, it will take some more money, but it need not be a huge expense and it is feasible - all of its components have been implemented in practice in some locales. This proposal includes limited standardized no/low-stakes testing (which actually could be sampling, as NAEP does); use of school quality review teams and processes; and assembling evidence from ongoing student work that can be independently reviewed (e.g., Learning Record, portfolios with strong guidelines and rubrics). Glen, I'd be interested in your response to this idea. Last point, yes Finland does virtually no testing, for which I commend them. Seems too huge a stretch for this country, and it is reasonable for communities to be able to know how well schools are doing and if they are improving where they need to, esp schools in low-income communities (in which case adequately funding the schools is the first educational step, and improvement needs to address the consequences of poverty). But if we are going to report on schools, we need to do it in ways that help, not damage - hihg-stakes standardized testing damages more than helps.
12:35 PM on 08/20/2012
I don't mind testing as a form of evaluation. I do mind that we have changed what we are teaching. Math curriculums like Everyday Math have thrown out the standard algorithms and replaced them with formulas that seem to help the child guess and get close to the right answer. You can watch a video on these curriculums here: http://www.youtube.com/watch?v=Tr1qee-bTZI These same math curriculums say children should no longer spend time committing multiplication tables to memory. However, in my experience, kids who don't have their tables memorized have a much harder time moving on to long division, simplifying fractions, etc. Then there is science. The Georgia state science tests for elementary school students are almost entirely on process. How boring! Reading the questions made me think that if the state had an exam on art, kids would no longer be allowed to paint. They'd simply sit at a desk and learn colors and applicators so they could pass a multiple choice test. If funding weren't tied to testing, perhaps schools would not teach "to the test". Perhaps they would teach to keep children interested in learning. When I went to school the teachers that were the most creative tended to get the best results, because the kids were engaged. Today, teachers are no longer allowed to be creative. I also think mixed age classrooms would help tremendously. Kids need to be with their academic peers in each subject, not simply kids their same age.
07:27 PM on 08/19/2012
Tests aren't that bad of a way to evaluate students. They're a rough estimate, but especially as an initial screener, they're useful... so long as they're not also used to evaluate teachers. If they are, teachers will spend time teaching to the test, which in fact IS always a bad thing. The point of the test is to evaluate a small subset of a much larger body of knowledge that students are supposed to know, and to use their knowledge of that subset to draw conclusions about their broader knowledge. This works reasonably well... unless teachers try to teach ONLY that subset, while also prepping kids on test-taking strategies that help them guess right answers, indicating that they know things they don't even in that limited subset of knowledge. And given that teachers are human, they're going to do that if their jobs depend on it. So the way that they're currently misused in an attempt to evaluate teachers is the main thing that makes the tests less accurate in evaluating students (and therefore pretty much useless, since evaluating students is, in practice, the only purpose for which they'd actually be useful).

So, short answer: testing students is an okay, if limited, way to evaluate students. It's not useful for evaluating teachers, and trying to use it that way makes it less accurate in evaluating students.
photo
HUFFPOST SUPER USER
Chris Close
Wisdom never goes out of style
01:37 AM on 08/19/2012
We live in a global economy and our students are going to compete with/in a global workforce. Standardized testing is the only way to measure our real time progress (or lack thereof.) 2+2 is 4 in Japan, India, Germany, China and yes... even here in the U.S. We should have standardized testing nationwide and the results should be made available to parents so then can decide where to have their children educated. Teacher's unions are the biggest obstacle to implementing this.
07:29 PM on 08/19/2012
Teachers' unions are one of the few positive forces in education today. Standardized test scores mostly depend on student ability and parent factors. Choosing schools based on students' test scores will make little difference, since the kid is still the same kid, living with the same parents. Teachers' unions, since they're comprised of teachers, generally know this.
01:43 PM on 08/20/2012
Standardized testing is the only way to measure our real time progress (or lack thereof.)?? Really?

Wow, how did we get all the way to the moon and into the information age without all of the standardized testing in place today? I guess you didn't know that Finland, which the Fordham Institute has rated as having the best ed system in the world, uses almost NO standardized tests. Too bad we never seem to want to follow the example of other successful nations. (But there is a lot of money to be made creating tests, hardware and software to keep track of all that test data, test prep materials, remedial materials to be used when the students don't pass, etc., etc. and those corporations make a lot of political contributions directly and indirectly...)
This user has chosen to opt out of the Badges program
12:50 AM on 08/19/2012
Good tests are too expensive. They require humans to read and grade open-ended and performance based questions. California used to have the Golden State Exam which had a multiple choice part and in science an actual lab test complete with materials. It was a great test, but too expensive considering the supplies and human graders.

If accountability was shifted to the local level, meaningful assessment would replace standardized assessment. Schools serve the communities they are in - why not make them accountable at that level, not at the state and federal levels?
10:24 PM on 08/17/2012
As Todd Farley, a long-time insider to the testing industry said in his book:

“However, if you knew what I knew about the [testing] industry, you would be aghast at the idea of a standardized test as the deciding factor in the future of even one student, teacher, district, or state. I, personally, am utterly dumbstruck by the possibility. The idea that education policy makers want to ignore the assessments of the classroom teachers who spend every day with this country’s students to instead hear the opinion of some testing company (often “for-profit”) enterprises in a distant state is, in my opinion, asinine. It is ludicrous.” (Farley, 2009, p. ix-x).
photo
HUFFPOST BLOGGER
Glen Lineberry
02:29 PM on 08/18/2012
All true [part 2 coming soon] but what do we put out there as the alternative? The folks who want education on the cheap, who want to find someone [read, teachers] to hold responsible, have the whip hand and they like testing. We need our own horse in the race.
This user has chosen to opt out of the Badges program
12:57 AM on 08/19/2012
Not to mention that, regardless of the merits of the test itself, the data is often used for purposes that it was never intended, such as for value-added metrics.

In California, despite the clear statement on the testing website not to, I see school after school using testing data for cohort analysis and value-added purposes.

I agree with Farley, place the accountability and assessment in the hand of the teacher, school and district. Standards can be state or national, but keep the accountability as local as possible.
10:23 PM on 08/17/2012
Continuing the below...

3) There is no massive crisis for which endless tests are the answer. US kids were #1 in the world in number of top level performers on the last PISA reading test and last PISA math test. Also, adjusting for poverty, US average scores were #1 in the world on the last PISA reading test. American education has real improvements to make, but high stakes testing has failed everywhere it has been tried. It is a central obstacle to quality education, and we are wasting billions of dollars and billions of classroom hours on test that are simply unnecessary. High school graduation tests have no proven benefits--get rid of them--use the money to get high school teachers more planning time so they can better individualize education for the crazy number of students you folks teach.

Teachers, kids and families were all better off before the testing craze started, and that's why China is trying to escape the grips of test-driven education while we, oddly, embrace it. Go back to relying on teacher evaluations of kids and principal and teacher leader supervision and feedback to teachers. With the time saved from testing and test prep, make better information available to families about what kids are doing. Do matrix sampling of kids from a school, and have them do a standardized test battery each year--so there's some external tool that could potentially spot (I'm being generous) problems.
10:23 PM on 08/17/2012
Glen,

I'm a little confused about your post, because you never established a legitimate purpose that high-stakes standardized tests are serving.

1) Teachers don't need a standardized test to tell them what students are learning: Teachers of young children are just as good at identifying who will have reading problems as the tests are, and high school grades have been found to be better predictors of long-term college success than are college entrance exams. Much of what matters most is not on the test, much of what is on the tests doesn't matter much in the long run, most causes of rising and falling scores are factors other than the teacher, and faster test score gains often signal poorer teaching, not better teaching.

2) Teaching to tests (even supposedly good tests) corrupts the whole idea of real education. The right reasons for learning are personal (curiosity, mastery) and social (to learn enough to help cure cancer, because Uncle Joe died of cancer). Putting testing at the heart of education undermines healthy motivation, and makes kids harder and harder to educate every year--it's just not an authentic reason to learn, and they know it. Kids forget material faster when they learn it just to learn it, and focusing on performance and correct answers (instead of learning itself) changes kids' motivation in three unhealthy ways.
photo
HUFFPOST BLOGGER
Glen Lineberry
02:37 PM on 08/18/2012
Karl, thanks for your extensive comments; they're greatly appreciated. The point of this blog, for me as a classroom teacher, is to share/gain perspective from the point of view of teachers. From our place in the education hierarchy, tests are a fact around which we have to organize our curricula, our lessons and our careers. The questions you raise are important and fascinating, but above my paygrade.

What we teachers desperately need is help designing curricula that equips students to pass mandated exams while still teaching them what Paul Harvey would call "the rest of the story", AND giving us the emotional and institutional support to do so.
05:08 PM on 08/17/2012
There is nothing wrong with teaching to the test as long as the test is measuring what you are trying to optimize. But that is the problem. When I was a Physics major I finally realized that more than Physics facts, procedures, and approaches; what they really really wanted to do with the students was to teach them to think like a physicist (there are both theoretical and experimental varieties). I don't really know how you test for that - they did a fiendishly tough oral exam.
been2there
Facts have a liberal bias.
03:29 PM on 08/17/2012
Teaching to a good test is good teaching; unfortunately the bubble-answer tests lead to bubble-headed teaching and a truly appalling lack of understanding of critical thinking skills As long as we have such lousy tests, we will have lousy teaching to the test.
NCLB is an utter failure and an absolute disaster.
photo
HUFFPOST BLOGGER
Glen Lineberry
10:42 PM on 08/17/2012
Thanks for commenting.

How can we move away from "standardized" and still test the tens of millions of students in the country? If we could find a way to move toward (all the way to individuation is probably impossible) a good test, we'd be doing a good thing.