More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Sabrina Stevens Shupe

Sabrina Stevens Shupe

Posted: October 12, 2010 12:33 PM

The Ultimate Measure of a Teacher?


Last week, The Huffington Post readers were invited to share their stories of inspirational teachers. I had many great teachers throughout my public school career -- and when I tried to pick just one, or even a couple, I realized it would be faster to list those who didn't make a difference for me, than to list those who did.

As I think about what made my teachers great, and listen to others' reflections, I notice that for almost all of us, what resonates with us are how those teachers made us feel -- more confident, more capable, inspired or loved -- and the life lessons and values they taught us.

The one thing I don't hear people saying is, "I loved Miss Such-and-Such because she helped me get better test scores!" It seems that what matters most to us can't be easily measured.

And yet, one of the big trends in education right now is value-added measurement (VAM), where a teacher's effectiveness is calculated by measuring the growth in their test scores. On its face, the idea makes sense. If standardized tests measure what students know and can do, and teachers are solely responsible for increasing what students know and can do, then we should keep track of how much students' scores rise while in their teachers' classrooms. That way, we can reward the best teachers and disseminate their practices, and identify the worst teachers for extra help or dismissal. Simple as Simon, easy as pie, right?

Not really. First, standardized tests offer only partial information about what students know and can do, and only in a limited range of subjects. Second, teachers aren't the only ones who teach students. Family members, friends, other teachers, librarians, tutors, counselors, friends, and the student him -- or herself (imagine that!) all influence what is learned over time. Trying to devise a way to calculate the influence of one particular teacher amidst all those others? Remember, each teacher's relative influence will be different for each learner. Good luck!

Other problems known to plague value-added measures (VAM) for individual teachers include:

  • High error rates. While potentially useful when assessing schools or districts, there is a one in five chance that an individual teacher's effectiveness will be mischaracterized when only three years worth of student data are used. That rate rises to 35 percent (over one in three) when just one year of data are used.
  • Instability. Teachers' scores can change considerably when different tests are used.
  • Difficulty separating student characteristics from teacher influence. For example, factors like race and giftedness have been shown to have an effect on teachers' value-added scores.

With a large enough sample size and random assignment of students, some of these issues could be minimized. But that would require school leaders to randomly assign students to teachers, and wait several years for teachers to accumulate enough data points (formerly known as children) to be sure that any inferences drawn from the calculations are reasonably accurate.

And of course, those problems are stacked on top of the other problems already associated with high-stakes standardized testing. These include, but aren't limited to: bias toward certain kinds of learners, pressure on schools to narrow the curriculum, the temptation to game the system and/or cheat, and so on. That is why groups like the National Academy of Sciences and the Economic Policy Institute agree that VAM should not be used to make high-stakes decisions about teachers.

If we truly respect teachers, and are serious about ensuring that all children are taught by high-quality teachers, why redesign teacher evaluation systems around measures that most researchers agree are unstable and misleading? (So much for being data-driven...) Why would any school district use a tool they don't actually understand to inform high-stakes decisions? Under these circumstances, it is irresponsible to use VAM for any significant proportion of an individual teacher's evaluation -- especially if the other components include a "drive-by" principal observation and little else.

Why not tap into those human connections we all understand and value, and build a better evaluation system from there? It could include examples of student work along with evidence (lesson plans, videotaped lessons) of how the teacher responded to students' needs; student and parent input (which could take the form of surveys and other testimonials on how a given teacher "worked" -- or didn't work -- for them); or an ongoing observation by instructional leaders and peers. Such a system could actually support teacher improvement by giving meaningful and timely feedback. That's a stark contrast to a value-added score that only offers an opaque, relative measurement of a teacher's performance, and isn't available until well after a particular school year has ended. (It's also less expensive than spending money on the tests, data-tracking systems, and specialists VAM requires.)

If that sounds pie-in-the-sky, it shouldn't. Some schools and districts already have such a system in place (or at least the beginnings of one). The trick is making sure that school personnel actually have the time and support to implement it consistently and well. Many school leaders don't, because of the numerous and often competing demands of district, state and federal mandates. Likewise, onerous reporting requirements consume time and energy that teachers and principals could otherwise spend building working relationships with parents.

If you have questions about the quality of your child's teachers, get involved! Visit the school, observe in your child's classroom, and get to know the teachers -- don't assume that a number or ranking published in the paper will tell you what you need to know. Teachers, prioritize your work, and consider ignoring some of the less important stuff you're asked to do so you can spend that time reaching out to parents and students instead.

Here's hoping the current generation of students can look back on their schooling and remember caring, creative teachers, instead of stressed-out test-prep technicians!

 

Follow Sabrina Stevens Shupe on Twitter: www.twitter.com/TeacherSabrina

 
 
  • Comments
  • 4
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Bloggers
Recency  | 
Popularity
12:02 AM on 10/18/2010
Thoughtful post, Sabrina. Schools are not factories where widgets are made.
photo
HUFFPOST BLOGGER
Christopher Scott
03:38 PM on 10/13/2010
Great article, Sabrina. The concept of value added measures in education is is dizzying, largely because, long ago, "value" gurus recognized that value is frequently not measurable. I will argue that growth is probably not measurable, either, in any meaningful fashion. Thus, the concept of total value management (TVM) seems more applicable to education.

TVM comes out of the Deming movement and total quality management -- "Total Value Management implies that an organization must look to the long-term implication of its actions. It means that its focus must be on sustainable growth not short-term stock price pressures. It means that it must allow strategic partners and employees to prosper, it means that customers must be provided a superior experience with each interaction and transaction."

Education suffers too greatly from "short-term stock price pressures." We measure kids quarter by quarter, year by year, never recognizing the long-term value of the developmental process. For each student, that process proceeds at its own pace, no matter what any specific teacher does. If educators could define the metrics associated with public education TVM, it would be an exceptional step in the right direction for understanding how our schools function. It would also help teachers address the needs of each child outside the narrowly defined results of standardized testing.
This user has chosen to opt out of the Badges program
photo
09:02 AM on 10/13/2010
There's a brief cartoon segment in "Waiting for Superman" which shows a student's head opening up and knowledge being poured in. To many people, that's the operative model: teachers pour information into students' heads. Then tests measure how much of that information is still there, at some point in time. The "best" teachers pour the most information, and repeat those deliveries of testable knowledge more frequently. At regular intervals, VAM identifies how much additional information has accrued, since the last test.

Here's what's left out: prior acquired and integrated knowledge, student interest in the material, application of material to personal circumstances. And--as Sabrina so aptly notes, the personal relationships--trust, respect--that make it possible for students to experience agency and attention in the learning process.

Value-added Methodology has been oversold. Yesterday, I listened to a gubernatorial candidate say that it we could just use "growth" measures, we'd know which teachers were effective. I believe that's where the general public is on this issue--still believing that the "right" methods of analysis will tell us which teachers have done the job of pouring knowledge into kids' heads.
This user has chosen to opt out of the Badges program
photo
01:24 AM on 10/13/2010
after a mutuality in identification is established there are really only two criteria to measure teacher performance: a mastery of knowledge and the efficacy of conveying that same knowledge. but the hard part is the identification without that you may find it hard to establish a value system for the institution of accreditation that is inherent in the education system. in other words, if you do not create an avenue to self-investment through reciprocation of esteem bridled by the affect of the teachers experiences in enrichment then you will likely find many students with lack of cogintive intention as it relates to an educational (or other) consistency of consequence. In a sentence, cultural transmission requires, first, interpersonal acknowledgement, and second, incorporation into a ordinace of accomplishment.