More

School Board Member Who Took State High School Exam: Tests Lack Accountability

Exams

First Posted: 12/08/11 02:01 PM ET Updated: 12/08/11 03:15 PM ET

To take state standardized exams to the test, a Florida school board member sat down to take a version of the state's high-stakes 10th grade math and reading exams. What he discovered horrified him.

His scores: 62 percent on the reading exam and about 17 percent on math. The reading score equates to a "D" letter grade, and would have placed him in mandatory remedial reading courses. He said the correct answers on the math exams were all lucky guesses.

An initial post by veteran teacher and curriculum writer Marion Brady on The Washington Post's "The Answer Sheet" blog left the board member anonymous, but The Post's Valerie Strauss revealed this week through an interview that the board representative is Rick Roach, in his fourth four-year term in Orange County, Fla. Roach writes:

"It seems to me something is seriously wrong. I have a bachelor of science degree, two masters degrees, and 15 credit hours toward a doctorate. I help oversee an organization with 22,000 employees and a $3 billion operations and capital budget, and am able to make sense of complex data related to those responsibilities....

"It might be argued that I've been out of school too long, that if I'd actually been in the 10th grade prior to taking the test, the material would have been fresh. But doesn't that miss the point? A test that can determine a student's future life chances should surely relate in some practical way to the requirements of life. I can't see how that could possibly be true of the test I took."

Roach tells Strauss that thousands of students across the state are denied diplomas every year -- despite high GPAs -- because they fail some portion of the standardized exam.

"There's a concept called reverse design that is critical. We are violating that with our test," Roach says. "Instead of connecting what we learn in school with being successful in the real world, we are doing it in reverse. We are testing first and then kids go into the real world. Whether the information they have learned is important or not becomes secondary. If you really did a study on what math most kids need, I guarantee you could probably dump about 80 percent of math scores and leave high-level math for the kids who want it and will need it.... They are defending a test that has no accountability."

Click through to "The Answer Sheet" to read more of Roach's experience with the exam, and what he tells Strauss are the reasons behind a broken standardized testing system.

To add to what Roach argues is a test with no accountability, Florida's teachers, like many across the country, are evaluated in large part based on student performance on state exams. The evaluation formula used is called a "value-added" analysis, which determines a teacher's effectiveness in improving student performance on standardized tests -- based on past test scores. The forecasted figure is compared to the student's actual scores, and the difference is considered the "value added," or subtracted, by the teachers.

And if the Florida's state exams fail to accurately measure student learning and knowledge, the state's teachers face consequences as well. Top-performing teachers can receive permanent salary increases, whereas those who receive scores on the low end for two consecutive years could be shown the door.

As more of the nation's school districts are designing and implementing more institutional methods of teacher evaluations -- and as some states and districts seek to publicly name teachers tied to the performance of their students -- the need for accurate student assessment is increasingly critical.

But a report released in August by the Education Department's National Center for Education Statistics found that "proficiency" on standardized exams is defined differently across states.

"There's just no clear relationship between the rigor of the standards and the outcome," Jack Buckley, commissioner of the government organization that produced the report, told reporters in August.

The federal No Child Left Behind law seeks proficiency among all American students by 2014, but some states set significantly higher standards for proficiency in particular subjects. With such a goal that has largely been considered impossible to attain, 11 states have formally submitted requests for waivers from the law's key provisions.

The National Research Council in May published the results of a decade-long study on the effects of standardized testing on student learning. From their findings, the researchers concluded that education policies that emphasize testing haven't necessarily led to greater or improved learning.

But in a rebuttal last month, Stanford University economist Eric Hanushek wrote in Harvard University's journal Education Next, pointed out that the NRC's report actually shows that "accountability has provided significant positive impacts." Hanushek argued that the mere 0.08 standard deviation increase in student learning that the NRC researchers found from standardized testing is actually much more significant than the decimal point seems, contributing to large returns on investment for students.

Test-based accountability by itself won't raise student achievement, Paul Hill, a research professor and director of the University of Washington's Center on Reinventing Public Education told The Huffington Post last month. He also sat on the NRC committee.

"Inside the education profession, there's a lot of resentment against he use of tests," Hill said.

FOLLOW HUFFPOST EDUCATION

To take state standardized exams to the test, a Florida school board member sat down to take a version of the state's high-stakes 10th grade math and reading exams. What he discovered horrified him. ...
To take state standardized exams to the test, a Florida school board member sat down to take a version of the state's high-stakes 10th grade math and reading exams. What he discovered horrified him. ...
Filed by Emmeline Zhao  | 
 
 
  • Comments
  • 394
  • Pending Comments
  • 0
  • View FAQ
Post Comment Preview Comment
To reply to a Comment: Click "Reply" at the bottom of the comment; after being approved your comment will appear directly underneath the comment you replied to.
View All
Favorites
Recency  | 
Popularity
Page: 1 2 3 4 5  Next ›  Last »  (7 total)
06:28 PM on 12/16/2011
...continuing from my earlier post
I want my students to remember not the facts of a particular story, but the ideas that an author wanted to explore. I want them to take these ideas and apply them to new situations they encounter in their lives. I want them to have the confidence and the skills to work out how to take what they learned in school and transform it to meet situations that I can't even begin to predict.

And as for tests like the FCAT (Florida's graduation test) or the GHSGT (Georgia's version), the results simply say whether the student has met the minimum skills for the courses they've taken. Scores have nothing to do with measuring actual learning, whether a student is ready for the "real world," or whether they will experience success in life. Take them for what they are and then use other methods of observation to determine the rest. And no, these other methods are not easy to quantify into statistical data or into "objective" statistics. And yes, they are expensive and time consuming. The question is whether we as a country are willing to invest the monetary and emotional capital into our future.
06:26 PM on 12/16/2011
I don't want to engage in name calling or finger pointing. Education in this country is facing serious problems--starting with what we think the purpose of school is. Some say it's to be prepared for the real world, others say to go to college, others say the ability to learn independently in new situations, others say the skills to get a job, and on and on. Until we know this and can quantify what that means to us, we'll be spinning our wheels. The debate on testing is a product of this confusion.

Good standardized tests assess skills (interpretation, comprehension, deduction, induction, analysis, synthesis, etc) not content (noun, ribosome, the war of 1812). Not all standardized tests are good ones; I would even go so far as to say that very few of the standardized tests I've seen as a high school teacher are good. But whether they're the best or the worst of them, tests can only capture a portion of what education is supposed to do. Tests should only be one measure of a student's success--not the only measurement.

For myself, I teach with the philosophy that high school is meant to be broad based with classes in the arts, the humanities, and the sciences. It is meant to be a survey of different ways of looking at and interacting with the world--different ways of knowing if you will. I want my students to remember not the facts of a particular story, but the ideas
photo
averagezoe
Don't breed or buy while homeless animals die!
06:33 PM on 12/14/2011
I taught in the US school system and I couldn't help but compare it to my own education. As the child of a UN diplomat, I went to school in Europe and there is a vast difference that people here couldn't begin to fathom. We went to school 6 days a week, 4 years of elementary school and 9 years of high school. There were no cheerleaders, no football games, no dances, no extracurricular activities of any sort - we attended classes, we studied, we learned. After 13 years, we had to take the written and oral exams comparable to obtaining a college degree to get our "Abitur" - the equivalent of a high school diploma. When I came back to the states and went to undergrad school, I felt as if I was in preschool and I didn't feel challenged until grad school. The focus in the European school system is solely on academics - it is believed that schools are to provide an education and if children want to play ball, go to dances or whatever else they desire, they need to do it on their own time. Here, this is called "well-rounded" and schools are expected to provide all sorts of activities. It is not surprising that American students are lagging behind.
This user has chosen to opt out of the Badges program
photo
04:22 PM on 12/14/2011
Here.. This is apparently the test, for anyone who wants to see:

https://docs.google.com/viewer?url=http%3A%2F%2Ffcat.fldoe.org%2Fpdf%2Fsample%2F1011%2Fmath%2FFL522267_Gr10_Mth_TB_WT_r3g.pdf
This user has chosen to opt out of the Badges program
photo
CSNC
Living on the edge -- not taking too much space
04:09 PM on 12/14/2011
"School Board Member Who Took State High School Exam: Tests Lack Accountability"

All that means is that you learned very little and got this far because of your connections.

Instead of blaming others, show some leadership and accept responsibility for your own ignorance.

H
This user has chosen to opt out of the Badges program
photo
11:50 PM on 12/13/2011
Roach sounds like a classic under-educated american to me...

all my advanced placement friends would have gotten near perfect scores on these tests - as they do all tests.
01:38 PM on 12/12/2011
As usual there are those who use this opportunity to blame teachers. What does it say if an educated adult cannot pass the test? I would really challenge you to view some of the sample questions on these tests. Many of them are really too hard and are not valid indicators what what is being taught. Many times what we are being taught to teach has no real application in the real world. Many of the math questions are multi-step and test numerous skills at once. If a kid gets the question wrong, then there is no real way to tell which skill was lacking. In Florida, we just teach to the test which changes every year. However, our kids do well on the national standarized tests. The problem is really the state-made tests because it lacks test-retest validity.
photo
poeticjustice4all
Past = Prologue
10:36 PM on 12/13/2011
I wish America's teachers were as creative with their teaching as they are at making up excuses.
This user has chosen to opt out of the Badges program
photo
01:50 PM on 12/14/2011
I wish people who make such claims had some actual knowledge to counter.
This user has chosen to opt out of the Badges program
photo
03:51 PM on 12/14/2011
Do you understand how causality works? You are ideologically limiting the causal chain to the classroom, instead of tracing it to the effects of greed-driven capitalism, and all the way to the upstream source of all dysfunction resulting from developmental arrest in the minds of those who endorse it. Shall we discuss the effects of commercialization and brand loyalty campaigns designed for children? Shall we discuss the results of poverty on learning? How about cognitive literacy?
photo
mlaiuppa
Pres. Sarcasm Society. Like we need your approval.
04:04 AM on 12/11/2011
Educations don't create these tests. They are designed by the for profit private educorporations that sell them to the schools because they lobbyed the state to mandate exit exams. They are given in the 10th grade so that students can be put in remedial programs, with materials purchased from these self same for profit private educorporations, to that they can pass.

In other words. the tests are rigged for a high failure rate so the company can make money on remedial materials for remedial programs.

Duh.

Welcome to No Dollar Left Behind.
03:14 PM on 12/11/2011
well said for profit create the need sell the product get business out of education
Tara Hunkoff
I could have been Sheila Noyeau
09:34 PM on 12/09/2011
I can see why Roach did so poorly. "Accountability"? The term he should have used was "predictive validity". At least I think that's the idea he was trying to invoke.

I don't know because Roach could not be bothered to learn the basic statistical terms that inform the design and administration of the test he was attacking, thus he cannot make a cogent argument. This is not pedantry: technical topics demand technical attention. He is lazy.

However, the best part is how he thinks his three degrees prove that the test is wrong. Even if we give him a pass on the math, how does a guy with three degrees make a 62 on a READING exam? Is he rusty on vowels? Does subjunctive mood throw him for a loop? Is subject-verb agreement a bit much these days?

The answer is simple: he's an Education Major.

That's right, his B.S. (actually they're all BS if you ask me) and his two Master's degrees are the result of years spent in an Education Department.

My little high school diploma from 1966 is looking better all the time.
10:16 PM on 12/09/2011
"Is he rusty on vowels? Does subjunctiv­e mood throw him for a loop? Is subject-ve­rb agreement a bit much these days? "

Perhaps you need to take a look at the tenth grade FCAT. These are not the concepts covered. The test is one of reading comprehension as determined by "correct" analysis and interpretation. The problem is that analysis and interpretation are subjective and heavily influenced by one's own experiences, values, and world view. Even tenth graders can have different but equally legitimate interpretations of a text. The test, however, does not allow for this, as it is a multiple choice test that directs the students to choose the *best* answer. Very often, more than one of the answer choices are defensibly valid answers, but the test doesn't allow for that. Students must, therefore, correctly determine which answer choice the test writer believes is the best answer. That kind of test does not accurately assess how well a tenth grader can read for meaning, form an interpretation and/or argument, and support it with evidence from the text. The test assesses nothing more than how well the student understands and can play the game as designed by Pearson, McGraw-Hill, ETS, et al.
Tara Hunkoff
I could have been Sheila Noyeau
12:02 PM on 12/10/2011
Grammar, structure, rhetoric, usage, etc. may not be the specific subjects of such tests, but I assure you anyone with a command of them will have no problem comprehending and interpreting a 10th Grade Reading Comprehension test.

The argument from subjectivity might be valid if the questions posed were things like "Do YOU support the death penalty?". They aren't.

That question on a test would be "Does the author support the death penalty?" or "How does the author's first argument contradict his or her second argument?".

As for understanding how McGraw-Hill plays the game, you have effectively asserted that every 10th Grader with a better reading score understands that game better than Roach, a man with three education degrees. The test was designed by Education Majors, for heaven's sake. Can Roach at least keep up with his own pack?

Then there's the problem of Roach's math score. I presume we can agree there's little room for subjectivity in a multiple-choice math test. Some staffer is obviously doing Roach's number-crunching for him...probably a woman with an AA in Accounting. Would you like to bet if she could beat Roach on both parts of the test?

My son says Las Vegas would probably make it Roach +24.
08:59 AM on 12/10/2011
I wonder if you have ever seen a state test. Every state DOE has samples of their test. Why don't you go on and try one of the tests and then pass judgement. These tests are not what people think. Here, I'll even do the work for you.

http://ritter.tea.state.tx.us/student.assessment/resources/online/2003/grade11/read.htm
Tara Hunkoff
I could have been Sheila Noyeau
12:11 PM on 12/10/2011
I have not seen a Florida test. Thank you for the link. I have to run to the grocery store right now, but I'll run through the sample test when I get back. I hope I do well.

It's refreshing to be treated so reasonably. Thanks again!
This user has chosen to opt out of the Badges program
photo
GlennWatson
Two million fans
08:47 PM on 12/09/2011
"His scores: 62 percent on the reading exam and about 17 percent on math. The reading score equates to a "D" letter grade,"

Then he must be stupid.
07:01 AM on 12/10/2011
He must be the result of "pass the problem on" mentality. Cannot do the work, but is passed to the next grade anyway. I see this very often in school today. 5th grade kids with the reading skills of a 2nd grader. Why? The kid should be held back to the level the kid masters. Once the kid masters that grade the child moves to the next grade. This is repeated until all 12 grades are completed. Its not a difficult concept.
This user has chosen to opt out of the Badges program
photo
GlennWatson
Two million fans
08:57 AM on 12/10/2011
The problem is you can't have 16 year olds in 6th grade.
This user has chosen to opt out of the Badges program
photo
04:12 PM on 12/14/2011
that is a recipe for ruining lives.

we need to do what we basically do - help each kid as much as we can.
03:10 PM on 12/09/2011
Welcome to the world of testing! So much of what is tested, is absolutely irrelevant to what is needed to succeed in life.
Tara Hunkoff
I could have been Sheila Noyeau
10:10 PM on 12/12/2011
This is absolutely true, and it misses the point by a mile.

These tests do not claim to measure one's chances of success in life. Everyone with walking-around sense knows that "success" is the product of a zilion factors.
foresure
Brash and Harsh
02:21 PM on 12/09/2011
You want a way to get an immediate, personal increase in text scores. At very little cost.

Feed the children, fresh nutitious food Free at breakfast and lunch. And a snack after school.

Google: EdNews Colorado Adams City high school breakfast.

I can't give you a link, because for reasons unknown to me, the link that I copied from the site takes you to a Colorado real estate company.

I was so impressed that I e-mailed an offer of a donation to the plan. Since they are not set up for that I sent a check for $15.00 to the physical address on the site.

If you are at all interested in improving education, find the site, and e-mail to every school board and state legislature in your state.

The school is Adams City High School in Colorado.
photo
poeticjustice4all
Past = Prologue
01:12 PM on 12/14/2011
Article: "Want fries with that? Not at these schools"

http://www.usatoday.com/news/opinion/editorials/2011-04-12-editorial12_ST_N.htm
This user has chosen to opt out of the Badges program
photo
01:52 PM on 12/14/2011
Tells us what organizations and politics are behind putting junk food in schools.
foresure
Brash and Harsh
03:20 PM on 12/14/2011
peoeticjustice:

Thank you very much for for that citation. I have saved it to re-post.

Two days ago (12/12/11) there was an Op-Ed in the New York times, arguing that part of the success of the schools in Finland, which has the best educational results in the world, was that their educational system was truly "comprehensive".

The title of the Op-Ed is "Class Matters. Why Won't We Admit it?:

www.nytimes.com./2011/12/12/ opinion/the-unadressed-link-between poverty and edu.

They make two important points.

a) The "No Child Left Behind Act" has been a failure.

b) Unless you address All the needs of the children, including food and health, you will not get good results.

It was written by Helen F. Ladd and Edward D. Fiske.

It had two main argument

See the work of Daniel Patrick Moynihan the sociologist who became a United States Senator.

He talked about the "Culture of Poverty" When you have a family living in the "culture of poverty", you are likely to have a family that is FUBAR (Google the word).
I

Comprehensive, volunatary, free boarding schools, paid for out of saving, over two decades, in a reduction in social service expenses, and "law and order services", are the answer.

The first, and easiest step is to do what has been done in Adams City High School. (Google Adams school free breakfast)

Used restaurant equipment is cheap.
foresure
Brash and Harsh
02:11 PM on 12/09/2011
Something to comtemplate:

A little noted "homily" that the President of the United States delivered about a year ago.

His eldest daughter came home with a C+ on one of her exams. He did not call the Secretary of Education, the Principal, or even the teacher.

He told his daughter that was unacceptable and asked her why. She answered because she didn't study enough.

OMG, that little homily would cost tens of millions dollars if it had to be discovered by the education industries.

For those "educators" who missed the point of that homily please contact me, I will give you my home phone, so I can expain it.
tazmodious
Left Hand of Darkness
07:34 PM on 12/09/2011
We "educators" already know that. You should be telling that to parents and politicians.
foresure
Brash and Harsh
07:44 PM on 12/09/2011
tazmodious:

I absuultely agree with your first sentence. Please explain, however, why the only thing parents and politicians hear from teachers is:

a) Give us more money
b) Give us less work
c) Give us no accountability,

And everything will be perfect.

WHY?

Please Google: "Adams City School Colorado Free Breakfast" and explain why teachers are not rallying to this innovation. I am serious I would love to hear your response.
photo
poeticjustice4all
Past = Prologue
11:57 AM on 12/09/2011
Yeah, the tests are too hard! Let's make the tests easy enough so that teachers and school administrators can pass them.
photo
HUFFPOST COMMUNITY MODERATOR
broui
No d#%& cat. No d#%& cradle.
01:31 PM on 12/09/2011
It is not about hard or not hard.

It is about what they measure.

Any good reading test (for example) should have context clues. The English language has 10s of thousands of words. It is impossible to prepare students for all of them. But, a well designed test can provide students adequate clues such that the student can figure out the word in context. Most standardized tests don't do this but teachers teach students to look for it because it is what educated people do.

Math works similarly. The thinking skills involved in computing and processing math tends not to get properly represented in these standardized test and students are left floudering - even the really strong ones. With math it becomes compounded because basic math facts are no longer taught to the degree that they were 30 or 40 years ago. And before we blame the teacher, this is district and state ordered curicullar changes. The responsibility is left to the parent to teach the student the math facts (ie. multiplication tables) or the student is less grounded in math. In high poverty/low education areas this is a huge problem for which districts are not compensating and teachers are literally ordered not to.

But please, keep harping on the individual teacher so you can sound like you know something.
foresure
Brash and Harsh
01:44 PM on 12/09/2011
broui:

As the English would say, "rubbish and nonsense". What I would say is "a perfect example of educbabble".
Allthosewhowander
My micro-bio is a microclimate
03:38 PM on 12/09/2011
Could you pass them?
06:26 AM on 12/09/2011
Sorry for the second post, but who DIDN'T know that MOST of school content is worthless?

WHY do you think that TV shows like "Are You Smarter Than a Fifth Grader" work? It's because we forget the nonsense.
photo
HUFFPOST COMMUNITY MODERATOR
broui
No d#%& cat. No d#%& cradle.
08:52 AM on 12/09/2011
You miss the point of this article entirely.

This is about Standardized tests. We're told that they measure student growth and learning. They don't.
Tara Hunkoff
I could have been Sheila Noyeau
11:14 PM on 12/12/2011
We are told no such thing. We are told they measure the students' grasp of the subjects presented to them in class.

"Growth" and "learning" are perfect examples of Glittering Generalities, a term every high school sophomore learns.