iPhone app iPad app Android phone app Android tablet app More

Featuring fresh takes and real-time analysis from HuffPost's signature lineup of contributors
Eloy Ortiz Oakley

GET UPDATES FROM Eloy Ortiz Oakley
 

The Test-Score Myth

Posted: 07/13/2012 6:01 pm

Leaders in higher education throughout the nation are quick to lament that too many high school graduates are not college-ready. On the surface, this appears to be true, especially if you use English and math placement test results for newly enrolled community college students as your primary gauge. In Long Beach, Calif., however, what appears to be likely on the surface may not be reality for many students.

At Long Beach City College (LBCC) nearly 90 percent of students who take placement exams for math and English score below college level and are directed to remedial level courses. For the entire state of California, roughly 70 percent of students who take placement exams receive scores that indicate a need for remedial education. These numbers alarm me.

Success rates of students who begin in remedial courses are very low. Less than half of students placed one level below ever pass college level English. Completion rates in math are even lower. Worse still, the chances for completing college-level courses in both subjects decline for students required to take multiple levels of remedial courses. Even students who have done well in high school are less likely to obtain a college certificate or degree when they are asked to repeat similar courses in community college. Remediation has become one of the greatest barriers to student success and disproportionately impacts students of color.

This overwhelming demand for remediation caught my serious attention. Having worked closely with Long Beach Unified School District (LBUSD) Superintendent Chris Steinhauser, I have seen improvements in the way teachers are preparing students for college. I found our remediation rate surprisingly high and inconsistent with my knowledge of what was taking place in our local schools.

In search of a solution, a research team from LBCC studied five years of data about incoming freshmen from LBUSD high schools. This in-depth study determined that my college was placing a disproportionate emphasis on placement test scores and not enough emphasis on student's academic records. A closer look at individual transcripts revealed that many students who did very well in their high school math and English courses, including a surprising number of high-achieving Advanced Placement and Honors students, scored poorly on our standardized placement tests. These data demonstrated that high school grades were far better predictors of success in college level courses than were standardized test scores in isolation.

Our research team projects that if LBUSD students who enter LBCC right out of high school are placed in math and English based on their high school grades instead of relying solely on their college placement test scores, the demand for remediation would significantly be reduced. Furthermore, enrollments in college level courses would increase by nearly 350 percent in math, and by more than 400 percent in English.

More importantly, students who enter college level courses are much more likely to earn degrees and transfer. These college-level courses are considered the gateway to a certificate or degree and completing either one of them in a student's first year is a powerful predictor of completing a certificate or degree.

Our findings are not occurring in a vacuum. Judith Scott-Clayton of the Community College Research Center (CCRC), at Teachers College, Columbia University recently published a working paper on the use of college placement exams. Scott-Clayton concluded using multiple measures of college readiness would be a more effective way for placing students. Similarly, Clive R. Belfield and Peter M. Crosta of the same center completed a separate report specifically looking at the use of high school transcripts for college level placements. Belfield and Crosta determined high school transcripts are better predictors of a student's college preparedness than standardized placement tests.

When students return to LBCC this fall, we will have launched a pilot placement program using high school transcripts as an alternative to relying solely on standardized test scores. The pilot is part of the Long Beach College Promise and was recently featured in the Los Angeles Times. Developed with the close cooperation of our educational partners, this pilot placement program will consist of a cohort of more than 900 incoming freshmen from LBUSD high schools who will be placed in English and math courses based on their high school transcripts in addition to their placement test results. Under this pilot, researchers will track student progress to confirm our findings and may offer insights on whether the need for remediation of California high school students is in fact as high as people perceive it to be.

Critics may attempt to argue this pilot program constitutes a dumbing down of LBCC's standards by placing underprepared students in college-level classes. I disagree. I am optimistic that this pilot will improve student success at LBCC and help close the achievement gap. In addition, as a result of this pilot the average student will save more than a semester and a half of remedial coursework. At a time when our college is facing major budget cuts that have severely limited course capacity, placing students at the highest level in which they are prepared to achieve and helping more students reach their educational goals in less time is more vital than it has ever been.

 

Follow Eloy Ortiz Oakley on Twitter: www.twitter.com/eloyoakley

FOLLOW COLLEGE
Leaders in higher education throughout the nation are quick to lament that too many high school graduates are not college-ready. On the surface, this appears to be true, especially if you use English ...
Leaders in higher education throughout the nation are quick to lament that too many high school graduates are not college-ready. On the surface, this appears to be true, especially if you use English ...
 
 
  • Comments
  • 11
  • Pending Comments
  • 0
  • View FAQ
Comments are closed for this entry
View All
Recency  | 
Popularity
03:04 AM on 07/16/2012
I take it that the test is problematic. But the approach of a full remedial course may be inappropriate in that they may only have a few holes in their knowledge while they know most of the material they are reviewing. In which case rather than a full remedial course, they need a test that identifies their knowledge gaps and some assistance to master them. A tutoring center might be enough.

My 14 year old daughter was planning on doing Running Start, so they made her take the English Placement exam. She found it ridiculously easy and walked out in 30 or 40 minutes having rechecked her answers and earning a perfect score. She didn't have to take the math exam as she was earning college credit with her Calculus course.

If the kids do OK on AP exams, you don't need to give the placement exam either. What you are looking for is some assurance that they learned the basic material.
02:57 PM on 07/15/2012
I'm interested to find out if this works, but dubious. Just because a high school calls a class "algebra" doesn't mean algebra is actually taught in that class, and with K-12 schools increasingly held responsible for their students' failings, more and more are effectively forced to give the kids passing grades they haven't earned. This sounds like the same bad policy, extended to the college level.

But I'd like to be proven wrong.
photo
HUFFPOST SUPER USER
LeftRight
TANSTAAFL
10:26 AM on 07/15/2012
Throughout Elementary school and half of Middle school I was considered slow... The reason are many, but it basically boiled down to the fact that in 1st grade we covered addition and subtraction, and then in 2nd grade we covered addition and subtraction for 6 months out of a 9 month school year. And similar situations occurred in other subjects.

So by the time we started covering new subjects, I was long since not paying attention...
09:22 PM on 07/14/2012
So, lets say a student has good grades in high school but does poorly on the english placement test. Under the old system, they must pass a remedial class before taking regular english classes. Under the new system, maybe they don't have to take the remedial class and go straight to regular classes. How would they possibly be better off, academically, under the new system? I don't doubt that placement tests are not very accurate, but how does a remedial class harm a student academically?

That said, I do have an issue with requiring a high percentage of students to take remedial classes. If they are not ready for your institution, don't admit them. You are just setting them up for a lot of debt and either a degree that isn't worth much, or much more likely, no degree.
10:55 PM on 07/14/2012
Community colleges have to accept all students who apply. Thus, the lowest classes they offer are at the arithmetic (math) and ESL 1 (English) levels; primarily for adult students who never obtained an education. The college must educate all comers, but at least this is done for about $50/unit...pretty much the best deal imaginable.

When I speak to professors at nearby Cal State Universities they lament the high number of students who also need remediation. And they (four year university faculty) ask the same questions that you pose, happytobeteaching. The reality is that a high percentage of students (40-60%) drop out within a year or two.

I'm still incredulous regarding Oakely's suggestion.
photo
HUFFPOST SUPER USER
LeftRight
TANSTAAFL
10:27 AM on 07/15/2012
Well they're going to run a program to see, but often people do quite well on a subject but do poorly on a test.
08:12 PM on 07/14/2012
The reality is that most graduating seniors, and particularly those of low SES, really haven't achieved requisite proficiency in math, english, science and social studies. Their placement exam scores really do indicate their levels of proficiency, and Mr. Oakley is falling into the same pattern of "let's ignore the problem" that most of our nation's school districts have been doing.

Kids are being passed along in high school, Mr. Oakley, and that student who received an "A" in Algebra 2 really is working at the Algebra 1 level...his teacher simply moved him along because he's a nice kid and is willing to persevere. The "A" grade is showing you the student's level of patience and persistence, not his final level of competence. This maturity carries over to Long Beach Community College and the student does disproportionately well because his peers at your college are so completely lost that they should be back in 8th grade.
photo
HUFFPOST SUPER USER
LeftRight
TANSTAAFL
10:29 AM on 07/15/2012
Not necessarily. It's possible, but we don't know. That's why they're running a test program where they go based upon their grades instead of their placement tests, to see how well they perform.
01:14 AM on 07/14/2012
One point to consider is the income colleges make from remedial courses. Requiring students to take multiple remedial courses that carry no college credit is a great income producer for the colleges. Even though my daughter had high ACT scores, she was required to take two math remedial scores because her ACT was "too old.'' She was only about three years out of high school when she decided to return to college. Even though she made a high score in her college remedial math course, she was required to take another remedial math class and was not allowed to re-test. What a waste of her time and money! Great for the college though!
09:58 PM on 07/13/2012
I read Mr. Oakley's article and skim through two papers he referred.

I do not presume that I posses the sufficient expertise to make a conclusion on the subject. Yet, I have two simple questions. I have not peruse the two papers, so do not yell at me if any of the answers are implicit in the papers.

1) Isn't this an indication that the design of the placement exams is flawed and they do not test what they are supposed to test. The current placement exams' failure to predict the college-readiness of a student does not mean that there is no test that can do it.

2) How are the grades in collage-level courses assigned? Are they curved? If so, no wonder skipping remediation would increase the number of students getting higher grades. I am sure this simple point is considered by researches but I probably missed where they discussed this.
03:01 PM on 07/15/2012
As for question #1, it's not yet determined whether the current exams are failing. They're experimenting to find out. If, as I suspect will happen, the kids who fail the placement exam and are placed into college-level classes any way then go on to do poorly in the classes, that will vindicate the exam.