RECALCULATION OF SCORES FROM "FAIL" TO "PASS" AFFECTS 5,625 CHILDREN
The state department has notified local school divisions that 5,625 children's scores on fifth, eighth, and high school SOL writing tests were not "fail" as the children were originally told. With the application of a different computer program for equating, one less item was needed for the child to pass the test.
According to information from the Department of Education, several local school divisions asked DOE to look at the Grade 5 and Grade 8 writing scores at some individual schools.
DOE then asked Harcourt to analyze the data for all the writing tests. Harcourt's analysis concluded it would be
technically appropriate to re-calculate the scores for the writing tests using an earlier computer program for equating, which resulted in a "cut score" that required one less item correct for a student to pass the test. There were no errors or mistakes in scoring individual test items or in calculating the number of items any student answered correctly.Of the students who took the writing test this spring, 5,625 students moved from "fail" to "pass." This breaks down to 1775 for fifth grade, 3073 for eighth grade, and 777 for end-of-course writing tests.
The affected local school divisions were notified of the re-calculation and sent the names of the children affected in July.
This technical glitch with equating has also occurred in other Harcourt testing states. Georgia and Nevada each had similar errors.
Test scoring glitch throws schools into tizzy (Atlanta Journal Constitution) Thousands of test results on hold (CNN) Scoring mistake affects 736 students (Las Vegas Review Journal)
Our thoughts
Some of the SOL test scores had to be re-calculated this year. They were the 5th grade, 8th grade, and high school writing tests. Five thousand six hundred twenty five (5,625) children were first told they failed the writing tests and then told they passed. The state says, quite defensively, that out of approximately 2 million SOL tests given this spring, only 5,625 test scores were recalculated. Only 5,625 children. Our children. Their names are currently in the hands of folks in local school divisions, awaiting the official letter from Harcourt, explaining the problem away.
Apparently local divisions questioned the state who questioned the testing company who questioned their calculations. Once re-calculated, voila! 5,625 failing scores became passing scores. One less question, it seems, was needed to make a 400, the passing score. The line between failing and passing was one question.
Only 5,625 children were affected out of 2 million test scores. I assume the state wants me to think that this is hardly a drop in the bucket. I assume they mean for me to be pleased that the scoring went this well. I hope the families of the 5,625 kids are glad it was so few of them. I hope the kids who were affected can appreciate the big picture. I hope none of the kids actually took the "fail" message from the state to heart. I hope this sort of thing doesn’t happen when graduation is at stake.
The state says the test company decided it was technically appropriate to re-calculate the scores for the writing tests using an earlier computer program for equating, which resulted in a "cut score" that required one less item correct for a student to pass the test. Equating is one of the areas that the state’s technical advisors have expressed concerns about. Concerns that were, apparently, right on target.
It’s not the first time our testing company has had difficulty with equating. Equating also seemed to be the problem in Georgia this year when the same testing company, our testing company, had equating difficulties for scores in the entire state. The same for over 700 kids in Nevada.
It’s not an error in scoring assures the state. It’s a problem with equating.
Maybe the state doesn’t consider sending 5,625 kids a failing score that changes several weeks later to a passing score, an error - but I sure do. And I’ll bet the kids and their families think it’s an error as well.
The state and the testing company can easily answer the technical problem by applying a different formula. But I think the state has a lot to answer for in the test mania that surrounds our children and their education. Maybe they could start answering to the 5,625 children.