You get word that your third-grade student is proficient in math and reading. Congratulations!
Does that mean that Johnny or Suzie will be successful in middle school? You’d like to think so, but of course, that’s not guaranteed. You may find out that when your child gets to eighth grade, the test scores aren’t so good.
The reason may have nothing to do with your child. It may simply be that there’s something askew with the tests.
The Thomas B. Fordham Institute, with financial backing (in part) from the Joyce Foundation and a few other groups, has looked at state proficiency scores across the country. One of the most troubling findings: states tend to have high standards for elementary school students but laxer standards for middle school students.
From the press release:
Washington–The tests states use to measure academic progress and student proficiency under the No Child Left Behind Act are creating a false impression of success, especially in reading and especially in the early grades, concludes a major new study by the Thomas B. Fordham Institute and the Northwest Evaluation Association. Analysts found that states are aiming particularly low when it comes to their expectations for younger children, setting elementary students up to fail as they progress through their academic careers.
In simplest terms, the percentage of a test that a student must answer correctly to be labeled proficient (the “cut rate”) isn’t consistent in any of three dimensions.
- Across states: Massachusetts may demand that a student get 60 percent of the answers right, while Colorado may demand only 40 percent.
- Across subjects within a state: Further, many states count subjects differently: a 50 percent is good enough to pass reading, for example, while 75 percent is required for math.
- Across grade levels within a subject within a state: Finally, the percentage within a subject may vary from grade to grade: a 60 percent may good enough for Missouri’s 3rd grade math test, but 80 percent is required for the 8th grade math test.
(These numbers are for illustration purposes only.)
So what did the researchers find about Kansas?
“We found that Kansas’s definition of ‘proficiency’ in reading and mathematics are relatively consistent with the standards set by the other 25 states in this study. in other words, Kansas’s tests are about average in difficulty.
Like many states, however, Kansas’s math proficiency cut scores are easier in the earlier grades than in the later grades (taking into account the obvious differences in subject content and children’s development). Therefore, the reported proficiency rates may overestimate the proportion of third-grade students who are actually on track to be proficient in eighth-grade mathematics.
Moreover, Kansas’s reading cut scores are generally easier than the state’s corresponding math cut scores for a given grade.
State policymakers might consider adjusting their math cut scores to ensure equivalent difficulty at all grades so that parents and schools can be assured that elementary school students are scoring at proficient level are truly prepared for success later in their educational careers.
Further, state leaders need to be aware of the disparity between math and reading standards when evaluating differences in teacher and student performance across these domains.”
The report also observes:
“Kansas’s cut reading cut scores are generally easier than the corresponding math cut score for a given grade. Thus, reported differences in achievement between the two subjects may be more a product of differences in cut scores than in actual student achievement.
In other words, Kansas students might be performing worse in reading and better in mathematics than is apparent just by looking at the percentage of students passing state tests in those subjects.”
Getting to the particulars, the proficiency cut scores ranged from the 29th to the 40th percentile (in reading) and from the 30th to the 45th percentile (in mathematics). That’s a variation of 50 percent across grades in terms of how rigorous the tests are.
For reading, here are the cut rates for the reading test:
- Grade 3 – 35
- Grade 4 – 29
- Grade 5 – 40
- Grade 6 – 32
- Grade 7 – 32
- Grade 8 – 33
As far as consistency goes, not the worst though the passing score is fairly low. (Notice that none of the numbers go above 40).
Here are the cut scores for the math test:
- Grade 3 – 30
- Grade 4 – 34
- Grade 5 – 35
- Grade 6 -33
- Grade 7 – 45
- Grade 8 – 38
You can find the entire report (over 200+ pages, since it contains 3-4 pages for each state, plus a discussion and various appendices) the the Proficiency Illusion page of the web site.