What Do the Latest NAEP Results Tell Us About Education “Reform” in Washington, DC?

The usual gang of supporters of bipartisan education “reform” never tire of telling the world how wonderful education ‘reform’ has been in Washington, DC, what with the proliferation of charter schools, Congressional support for vouchers, a seriously handicapped teachers’ union, tremendous churn of teaching and administrative staff, tons of consultants, and direct mayoral control.

I’ve been among those saying that the results are NOT so wonderful. I have documented how virtually none of the promises came true that Chancellors Michelle Rhee and Kaya Henderson made about 8 years ago. They promised that the improvements in test scores, graduation rates and much more would go through the roof, but in fact, almost none of that came to pass. The recent scandals about truancy, absenteeism, phoney grades and illegitimate graduation rates have shown that much of their supposed successes have been purely fraudulent.

In addition, I showed recently that in fact, progress for a number of DC’s subgroups (blacks, whites, and Hispanics) on the NAEP 4th and 8th grade reading and math tests are further evidence of failure, since improvement rates per year BEFORE mayoral control cemented the rule of our ‘reformista’ Chancellors wee BETTER THAN they were AFTERWARDS.

I was asked by one of the members of DC’s now-powerless board of education to analyze changes over time for ALL of DC’s students as a group (not subdivided in any way) to compare pre- and post-‘reform’.

I made my own graphs using the data on the NAEP Data Explorer page, being careful to use the same vertical scale in each case, and starting at the lowest point, or nadir, of DC’s NAEP scores back in the 1990s. I asked Excel to calculate and draw the line of best fit for the data points. In each case, that ‘trend-line’ of linear correlation fit the data extraordinarily well. In fact, the R-values of linear correlation went from a low of 94% to a high of 99%. I didn’t use the graphs that the NAEP Data Explorer page provided, because they changed the vertical scale from situation to situation – so a rise of, say, 10 points over 20 years would look just about the same as a rise of, say, 60 points over 20 years. And they aren’t! So my vertical (y-axis scale) is 200 points in each case.

I also marked on the graphs where the dividing line was between the time when we had an elected school board (abolished in 2007) and the present, when we have direct mayoral control with essentially no checks or balances on his or her power.

So here are the graphs:

So do you see any miracles?

Me neither.

So what does all of this that mean?

1. You need a good magnifying glass to see any significant differences in progress on the NAEP test scores for ‘all students’ in Washington, DC when comparing the two eras. The slopes of the dashed lines of best fit are essentially identical on the two sides of the purple line.
2. Since the proportion of white inhabitants of DC and of students in DC’s publicly-funded schools have both increased markedly in the past 10 years, and the proportion of black residents and black students have decreased markedly, and this has skewed the graph in a positive direction after 2007.* That means that this data, and these graphs, are actually making the overall situation look more favorable to the reformistas.
3. Anybody pretending that there are huge increases in national test scores after the reformistas took over education in DC, is blowing smoke in your eyes.

===========================

*Why? When you remove low-scorers and add high-scorers (on anything) to a group, the overall average score will go up.

Here is a sports example: A football coach has been given a roster consisting of these players:

• twenty big, strong, and bulky linesmen and backs and so on. Let’s pretend their average weight is 280 pounds.
• twenty relatively small, but very fit, place-kickers (actually, they are soccer players looking for a fall sport) who weigh an average of 180 pounds each.

The team’s average weight is exactly 230 pounds (That’s (20*280 + 20*180) / 40) .

At noon,  the coach realizes there is no need for so many place-kickers, and she cuts 15 of the placekickers, leaving five of them. Their papers say that each one in fact weighs 180 pounds.

NOTHING ELSE CHANGES. In particular, none of the players gain or lose any weight during these fifteen minutes that the coach is making these changes.

At a quarter past noon, the average weight of the team has now increased markedly. It is now (20*280 + 5*180) / 25, or 260 pounds – it has gone up by 30 pounds simply by cutting 17 of its least-heavy players.

Is that coach a genius, or what, at bulking up her team?

Actually, although it’s not the direct result of what any Chancellor has done, this situation is somewhat similar to what’s happening in DC. Remember that white students in DC are the highest-scoring group of white students anywhere in the nation, because their parents overwhelmingly have graduate or professional degrees; DC’s white working class left town decades ago. So when relatively low-scoring African-American students (from working-class families) move to PG County, and white students and their relatively-highly-educated families move into DC from wherever, the averages will increase much as they did in my example with the imaginary football team.