iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
John Merrow

GET UPDATES FROM John Merrow

The Intersection of Technology and Test Scores

Posted: 09/13/11 08:00 AM ET

Two quick notes before we blog: I'll be appearing live in conversation with Dave Levin of KIPP and Eva Moskowitz of Harlem Success Academy. This event, a discussion about the charter movement, will take place on Wednesday, Sept. 21 in NYC. If you can make it, we'd love to see you there. Tickets are going fast -- so get yours here.


And as always, remember that my February 2011 book The Influence of Teachers is for sale at Amazon.

--------------------------------------

"In Classroom of the Future, Stagnant Scores" blared the headline in New York Times on September 4th. The paper's editors decided that the top-of-the-fold story on Page 1 also warranted two full pages inside, plus four color photos and a graph. That's a huge part of the news hole on any day, but particularly on Sunday, when circulation is at its highest.

The long piece is worth reading, but at the end of the day what stood out for me was what the article failed to take note of: the unimaginative uses of the technology, essentially digital versions of routine stuff: One teacher gave a true-false quiz but handed out wireless clickers for students to record their answers. In other classes, kids were playing a math game ("Alien Addition") and an interactive spelling game, while other students were videotaping a skit that they could as easily have simply performed for the class.

In none of the examples presented were teachers using the technology to burst the boundaries of their classroom to connect with students in other cities, or even elsewhere in their district. None were using the Internet to do original research. I've written about this before, and Learning Matters producer John Tulenko helped craft a great piece related to the topic:

It seemed to be all about entertainment or delivering more efficiently what the adults had decided the kids need to know, rather than allowing and encouraging students to follow their own interests -- at least occasionally. I fault the reporter for not drawing that distinction and for not pressing the adults who are spending all this money on the paucity of imagination.

But my real point is that the Times reporter could -- and should -- have written a very different story:

"Schools spend billions on technology but use it to do the same old stuff in more entertaining ways!"

Why is this happening, the reporter could have asked? Is it because teachers don't understand the technology's power, or because they want to make sure the kids learn what the adults have decided they must learn -- or because they are ruled by fear of low test scores?

Running throughout the article is a constant refrain about the limitations of test scores. Adult after adult complained that "Test scores were not an adequate measure of the value of technology" but then went on to say, in effect, "Well, that's what we have to live by."

That really gets my dander up. They are endorsing spending billions on technology -- it's not their money -- and they complain about the tyranny of bubble tests, even while their pedagogy is focused on test scores.

If they understood what today's technology can do, and if they were enabling their teachers to go there, and if scores were still stagnant, that would be a story. (But the story might now be about how inappropriate bubble tests are to measure this new learning.)

Something must be done. The Times reports that school systems spent $1.89 billion on software in 2010 and perhaps five times that amount on hardware. That's real money, especially at a time when school districts are going to four-day weeks, cutting art and music, eliminating Advanced Placement classes, and making other draconian cuts.

And then this expensive technology is used in woefully unimaginative ways!

Establishing a ratio of dollars for training to dollars for software and hardware is not the answer, because there aren't sufficient incentives for teachers to try new approaches -- at least not as long as their main job is to get those test scores up.

To find the solution, go back to the whining mentioned above, the constant complaints about the lack of adequate measures.

That brings me to a conversation I had last week with a leader in the reform movement. I asked his thoughts about the erasure scandals in Atlanta, Washington D.C., Philadelphia and elsewhere. He said it was a wake-up call and a clear message that we need better security. "Since those scores count for so much," he said, "systems have to do a better job of protecting the tests."

He's not alone. A few days ago a panel of experts in New York recommended tighter security, including giving all tests on the same day and requiring proctors to certify that they have been trained in 'security procedures.'

Wrong, guys! That barn door is off the hinges and the the horse is long gone. As long as adults' jobs and students' promotions and graduations are determined by test scores, there will be cheating. Students can use wireless devices to share answers, for example, while 'fully certified' proctors can still nudge nudge wink wink their way around the room, helping students pass.

We ought to be searching for multiple measures of academic progress, measures that are valid, reliable and reasonably affordable.

Who should be doing the searching? Wonderful as the U. S. Department of Education's i3 'innovation' grant program sounded, it was never set up to support risky investments of the sort I think will be required. It bet on such 'innovations' as Teach for America and KIPP, and that's fine, but what's needed here is some real risk-taking.

I have three candidates:

1. The companies now making megabucks on testing, Pearson and McGraw-Hill, ought to be protecting their revenue stream by finding better ways.

2. Apple, Microsoft, Dell and others hawking their products have a strong interest in public evidence of the power of technology.

But the best candidate might be the New Schools Venture Fund, who I think are the brightest folks on the block. That organization has never been shy about taking chances, probably because it exemplifies the spirit of its founder, John Doerr. In the Venture Capitalist world, only a small percentage of investments hit a home run, and the NSVF gets that. It's putting dollars behind a number of new approaches to teacher training, for example, in the expectation that some of them will be a distinct improvement on the current approach -- while others will fall short.

(I don't know how NSVF finances work, but maybe Apple, McGraw-Hill, et alia should be making large donations to that organization?)

We need that venture capitalist mentality and approach to the world of measurement. So what if most of the schemes don't pan out, as long as we emerge with a few that actually work?

This matters because right now school systems have almost no incentive to trust technology -- because they don't know how it will affect those test scores.

Look, educators are excessively literal and overly reactive. They haven't gotten where they are by taking chances, so don't expect them to take the lead now. Society has been telling them that we want good reading scores (we haven't said, "we want kids who love to read," just good reading scores). So why are we surprised when they drill kids on reading tests?

Bottom line: schools will never realize the power of technology until they get out from under our current way of holding them accountable. We need accountability, but what we are now doing is stifling learning and teaching. It's making public education worse, not better.

 

Follow John Merrow on Twitter: www.twitter.com/john_merrow

 
 
  • Comments
  • 12
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Favorites
Bloggers
Recency  | 
Popularity
10:56 AM on 09/15/2011
"Look, educators are excessively literal and overly reactive. They haven't gotten where they are by taking chances, so don't expect them to take the lead now. Society has been telling them that we want good reading scores (we haven't said, "we want kids who love to read," just good reading scores). So why are we surprised when they drill kids on reading tests?"

This statement is dismissive towards educators. As a teacher, I am insulted. What exactly does John Merrow mean by "overly literal" and "reactive?" And why does he, a journalist, act like he knows more about education and what is good for students, than the professionals?
photo
HUFFPOST SUPER USER
TINA ANDRES
How did this happen?
09:54 AM on 09/14/2011
We have no wireless internet at my school. We have no computers for students except 10 year old Macs that barely work, aside from a set of laptops used only for the technology electives. The district came out and installed Smartboards and left, no training whatsoever. Thirteen of our new teacher computers were stolen and they are being replaced by older computers that don't support even our system for taking attendance. While other people may have issues with learning to use technology in innovative and interactive ways, we are still stuck in the dark ages, so forgive me if I can't really even begin to wrap my head around how to do these things.
11:19 PM on 09/13/2011
"Schools spend billions on technology but use it to do the same old stuff in more entertaining ways!"

You have this exactly right. It is not about creating a better PowerPoint. It is about real-world application. Where is the Skype conversation with the book author? Where is the joint media project with the Japanese high school?

There are so many things that could have happened. Where was all that?

Tom Nixon
http://BestOnlineHighSchools.com
photo
HUFFPOST SUPER USER
Ganapati Edu
From negative to positive.
08:57 PM on 09/13/2011
"Mind Storms" by Seymour Papert. This argument has been around for a bit. Throwing technology into the classroom changes nothing, as pointed out in the article. Having said that, some of us are really trying to push creativity with technology, perhaps at the cost of test scores. Thus, we feel really guilty, for our job as educators is to teach, and help our students secure a positive future. When everything depends on test scores what can we do? Consultants and politicians say, "If you teach well, kids will do well on the tests". We say, "the tests don't accurately capture what a student knows". They put their fingers in their ears and chant, "Charters good, Unions Bad". We are left wondering how that even relates to the conversation. Our education system, and its tests, are the product of our societal values. Change in the education system won't happen until we are willing to admit that an even bigger change needs to happen. Otherwise, we will just continue to have this argument for the next 40 years.
DavidBCohen
http://snipurl.com/24q1orf
06:00 PM on 09/13/2011
Glad to see a post that recognizes failure is part of innovation - I tried to call the same idea to the attention of Arne Duncan when he visited us here in Silicon Valley last year. See http://wp.me/pPltP-7f

I would also point out some key differences though. If a startup business fails, the most serious consequences are generally confined to the investors; the employees and clients can generally find an alternative and life goes on. In fact, it seems here in Silicon Valley that in many cases, the failure is a useful learning experience for the employees. But if a "startup school" or school reform effort truly fails, the students, families, and even the community must deal with the fallout. So, by all means, we should attempt innovations with the knowledge that some of them won't work out as well as we'd hoped, but let's make sure those venture capital types are working as partners with schools and teachers, to reduce the odds or the severity of failures. Does that sound like I'm arguing for... bold incrementalism!? Perhaps. Having these conversations in the abstract has its limitations.
12:19 PM on 09/13/2011
To continue my thoughts on my previous comment:

Our school leaders need to refrain from going on shopping sprees for the newest gadgets until or unless they also have:

1) Strong understanding of the "why" -- what is the purpose and what are the learning goals for adopting the specific technology in the classroom

and

2) A solid plan for professional development and ongoing professional learning that results in transforming the teachers as well as the classroom.
12:18 PM on 09/13/2011
From the article above:

"Schools spend billions on technology but use it to do the same old stuff in more entertaining ways!"

-----

Exactly -- what little training does occur for teachers tends to focus more on the technical "how to" of the tools rather than on pedagogy. And quite honestly, in my experience with coaching teachers, the key issue is whether or not the teacher has strong skills in crafting and facilitating student-centered learning experiences.

If we put technology into the classroom of a teacher who relies on teacher-centered modes of instruction (lecturing, worksheets, whole class instruction/discussion, etc.), then that teacher will integrate technology using the only pedagogy that he or she knows.

Examples:

document cameras used in place of overhead projectors for lecturing or demonstrating
Smartboards used as expensive whiteboards for whole class instruction
quiz software or quiz websites used instead of worksheets for individual work

If we focus on transforming the classroom into a more student-centered environment where the teacher employs much more student-centered instruction, that teacher will be more likely to use new technology in transformative ways -- ways that allow students to interact with information, content, each other, and the global community in new, engaging, and (hopefully) more constructive ways.

Our classrooms -- with the help of technology -- can and should become globally-connected communication and learning centers... But many of our teachers need support and help in learning how to create such an environment in their classroom.
05:33 PM on 09/13/2011
As with technology, student centered teaching can be good or not so good. I have seen plenty of examples of student centered instruction consisting of low level activities with very little rigor. Too many people are putting their faith in technology, "student centered learning", etc. to solve the education problem. I think the implementation of whatever pedagogy is used is much more important than the pedogogy itself. I want my kids to have hard working, caring, and intelligent teachers - don't really care about anything else.
photo
HUFFPOST BLOGGER
Robert Schwartz
Parent, educator, edtech enthusiast/skeptic
09:51 AM on 09/13/2011
The same exact study could have been done and subbed in the word "textbook" for "technology". It does depend on how well the tool is used and not the fact that it is used. Schools spend billions of dollars on textbooks - some teachers use them as one teaching tool amongst many and some use it as their only teaching tool - test results would obviously vary. I'm worried that even if organizations like NSVF or Apple and Dell for that matter invest in innovative approaches for technology (which they are) that the structures in place in schools, districts, and teacher credentialing programs will not change to adopt their use effectively and will even work to stifle them for the preservation of the status quo. A friend of mine and I were talking about schools and technology. He is not in education, but worked for a large tech company. What he said was compelling: "Our schools bought SmartBoards last year and say they are integrating technology. I had a SmartBoard in my office 15 years ago." Maybe 15 years from now schools will widely adopt tablets (and porrly) - just as they are on their way out. This greater difficulty seems to be the systemic school/district issues which are stifling adoption of tech and innovative practices as opposed to the generations of ideas and products.
photo
HUFFPOST BLOGGER
Brian Crosby
11:53 PM on 09/14/2011
The "Status Quo" comment is such garbage. What does that mean? It's a mindless talking point throw off. Please explain? The Neo-Reformers spread that around while they are for a pedagogy of sitting in rows and sitting up straight and nodding your head ... like 150 years ago and that is said to be "innovative". What nonsense. You are correct that technology integration has been beyond poor. But you jump right to blaming schools which unfortunately are being bound by what the neo-reformers spout (almost none of whom have actual education experience, just money). Let's actually have a national discussion (and a local one too) on what COULD be tried instead of JUST the talking point nonsense that Rhee, Gates, Broad, et al spout. Just using the "status quo" verbiage makes your comment less meaningful. Let's break from the talking point stuff.
photo
HUFFPOST BLOGGER
Robert Schwartz
Parent, educator, edtech enthusiast/skeptic
09:27 AM on 09/15/2011
First of all, I agree with you about the "neo-reformers" and their own lack of innovation. I don't see a better word to encapsulate the fact that classrooms are structured the exact same way they have been for centuries than status quo. I taught for 13 years and the only changes I saw in instruction and pedagogy were based on things that were already tried 50 years ago and were being rehashed again. We need to look at the schools and systems who are doing better with technology or whatever learning innovation whether they are traditional public, public charter, and private and learn from them.