As the head of the honors program at my college for a number of years I had to determine how much validity I would put into the SAT scores in weighing the admissions criteria for a candidate. In making my decision I also included such criteria as gpa, course choice--some students would choose "easy A" courses in their senior year to beef up their average--and the personal essay the student would write. All of the students selected had among the highest SAT scores and gpa's of that freshman class. Not more than half graduated with an honors degree four or five years later.
Of course, there were rigorous standards that included a minimum "B" in any honors course and a "Senior Thesis" supervised by a faculty member in the candidate's area of study (This was one of the factors that discouraged many of the students from completing their honors requirements.). But from what I experienced, there was little correlation between SAT scores and student success in the program. Some of those with the highest SAT scores, in fact, not only dropped out of the program after the first semester but actually flunked out of the college.
In a recent (8/6/10) episode of "The Brian Lehrer Show" on WNYC, Laurence Bunin, senior vice president of the SAT tests and the College Board, defended the charges of a recent study that found the test "racially biased." He was rebutted by several callers and other discussants questioning the validity of the tests and their objectivity. I found the discussions more than vaguely familiar; it seems as if they have been going on for decades and each side has the "data" to support its view. But the issue of the SAT controversy as to whether or not the test is "racially biased" or "culturally biased" is, to me, beside the point. I don't believe that any standardized test should be a significant factor in determining how well a student is learning. I just don't think the instrument of testing which is, of necessity, a generic one, can accurately account for the many factors that go into measuring what, how and why students learn.
One of my colleagues, a German psychologist with whom I regularly correspond and who is very well acquainted with the "metrics mania" of Americans, describes the use of statistical data to determine social and educational policy "KISS"--"Keep It Simple. . . and Stupid." That's what I believe the SAT's and any of the other knowledge or intelligence tests consists of: reducing human complexity into the simplicity of numbers.
Since I began my career as an educator forty-five years ago, I have heard innumerable controversies over the SAT's, the Stanford-Binet "intelligence tests," and my favorite: the "high-stakes testing" that is doing to the educational system in this country what wild kudzu does to gardens. I have heard from many sources that the SAT's are only accurate in predicting the performance of students in their first semester of college. After that, they are no longer valid. To use a sports metaphor, that would be like determining the quality of a starting pitcher solely on the basis of his performance in the first inning.
My own explanation for the unreliability in predicting college student performance on the basis of standardized tests is that once students become acclimated to the environment of an academic setting, their own personalities and basic work ethic will determine how much they will study, how many classes they will actually attend, and how much they will learn. That is why I believe that if colleges really want to know how well students are likely to do they will rely more heavily on interviews, submitted projects and essays (hopefully written by the student and not "edited" by someone else) than tests. Some schools do this. I believe that all should. But that takes a lot of time and money and effort and in a mass society in which privilege and wealth seem to be more and more the determining factors in having a successful life--however that's defined--it is much easier to give out a standardized test and claim that the "objective" scores prove students' intellectual value and, more significantly, provide a likely estimate of the future of their academic and occupational careers.
That about half of college freshmen never receive a degree and that many who do need to be retrained when they get a job (or, in the present economic climate IF they get a job) should point out that there is something profoundly wrong with our educational system that test scores, whether "fair" or "biased," will not be able to address. That is the failure of an economic system that can no longer generate the good-paying jobs that used to be the expectation of a high school graduate let alone a college graduate. Unless people begin to look outside the narrow way in which education is conventionally viewed and see it as becoming the product of a rapidly developing elitist society, no tests will find an answer to our problems of improving education which can only be done by addressing many factors: economically, culturally, socially and intellectually.
John Medina, Ph.D.: How A Pair Of Cookies Can Help Predict Your Child's SAT Scores (VIDEO)
I graduated college manga cum laude with a high G.P.A. and departmental honors. I was a dual major and I never received anything below a B in any of my courses, yet those facts were no where near enough to prove anything. I, like many others, had to take the GRE to prove...who knows what... to graduate schools.
I am completely against standardized tests and hope that one day there will be less reliance on them and administrators will look beyond a score when determining how a student is learning.
Thank you for writing this article!
It seems to me that best (and original use) of these types of test is to quickly sort large numbers of persons into a few very broad catagories of narrow definition. In other words these test are good for thinning the number of applicants. But is it a fair use of the test? Maybe we should look for some means to measure work ethic, commitment, determination and self dicipline?
In my own life I have seen that good SAT scores have not always lead to success (or even simple completion) of college. I've seen people who did well on test flunk out and have poor quality lives. I've also seen people who didn't test so well manage to have very successful lives due to hard work.
"All of the students selected had among the highest SAT scores and gpa's of that freshman class." How could you determine that those with high SAT were likely to drop out... if ALL had high SAT scores? The range of GPA and of SAT would have been curtailed. Since the students with high SAT who dropped out also had high (high school) GPA, perhaps the measure of academic ability contributed by the SAT was mostly accounted for by the high GPA, in other words, for that preselected group, SAT was not an independent predictor.
Where students do well freshman year, but not so well after, maybe the cause in not in the student's scholastic ability but in something going on in the school. There are factors beyond just scholastic ability that contribute to a student's college achievement, like financial resources, values, social compatibility, family support, and others.
Bernard Schuster
Arrive2.net
Bernard Schuster
Arrive2.net
Bernard Schuster
Arrive2.net
"That about half of college freshmen never receive a degree and that many who do need to be retrained when they get a job (or, in the present economic climate IF they get a job) should point out that there is something profoundly wrong with our educational system that test scores, whether 'fair' or 'biased,' will not be able to address."
So what are the SAT scores of these freshman you've described? If their SAT scores are low then your argument would be crippled. If their SAT scores vary greatly then your argument would be strengthened. Since you didn't mention their SAT scores, this paragraph is irrelevant and should be disregarded.
I see what you're getting at, but I just wanted to say that, within the above paragraph you sort of unwittingly made a statement against the policy you're advocating. In the above paragraph you observed that submitted projects and essays can be "edited" by someone else. Such editing could compromise a pool of prospective students in ways that an SAT prevents (since students take the SAT alone and must submit it without being allowed to show it to an adult for "editing" purposes).
That was enough for me. Hard to disprove that one. You really think GWB would have been accepted to Yale without being a a multi-millionare and a legacy acceptance? Education in America can be summed up as "It is way more important where you learned it than what you know."
Its this simple, you will never decrease college cost or level the field until you test 10% of every class of every college after they Graduate in a really, really hard comprehensive test. Then provide Federal and State funds accordingly. -AJB