More on Michelle Rhee’s promises concerning DCPS

I continue with a further look at one of the promises that Michelle Rhee and her acolytes and funders made, namely,

NAEP TUDA DCPS michelle rhee goal

To repeat: DCPS’ goal is to be in the top half of districts by the 2012-13 NAEP-TUDA administration.

Let’s look now at 8th grade math scores for 2013:

dcps vs all naep tuda math 8th grade 2013


No, not even close. DCPS is firmly in the middle of the bottom half of all NAEP TUDA school districts for 8th grade math in 2013.

So, Rhee and company are now ZERO for TWO.

What do you think the final score will be, when we go through the entire list?

And do you think anybody was held accountable since, so far, they missed both of these goals?

Did ANY of Michelle Rhee’s promises actually work in DC?

You may recall that Michelle Rhee promised that she would produce miracles in Washington DC’s public schools if she got the money from various foundations and the freedom to fire teachers as she pleased.

She and her hand-picked acolyte and successor, Kaya Henderson, certainly received all the money they asked for, and they stripped DCPS teachers of almost all protections from random firing.

But did those achievement gains actually work?

I’ll let you decide, by first letting you see the spreadsheet where Rhee et al. promised, in writing, what they would accomplish. Here is the link to the original, so you can see I’m not making this up. It’s on page 22.

what rhee et al promised

That’s a lot of promises!!

Notice the very last goal: for DCPS to be in the top half of all urban districts whose scores are included in something called the NAEP TUDA by 2012-13. (National Assessment of Educational Progress, Trial Urban District Assessment).

For now, I’ll just give you the result for part of that last one — math, fourth grade, in graphic form, cut and pasted and put in order and labels added by me, direct from the NAEP TUDA web page.

dcps vs all naep tuda math 4th grade 2013

I highlighted the average large city score, right in the middle, and also the District of Columbia. Anybody can see that no, DCPS is NOT in the top half. Atlanta scored at the median (in the middle of all of the cities’ scores), and DC was two cities below that.

We also need to look at math scores at the 8th grade as well as reading for both 4th and 8th grades to finish evaluating this one goal or promise.

What do you think: will Rhee/Henderson/Gray be shown to be successful in other parts of this long list of promises?

More posts will follow. Many thanks to my colleague Erich Martel for pointing all of this out and compiling it in some very dense spreadsheets.

Cheating in Atlanta and DC — by adults

Brooklanders and other DC residents, have you ever wondered how and why adults at Noyes EC and elsewhere in DC ended up cheating on the high states standardized tests? 


Read this article in the latest New Yorker that gives the exact details of how and why otherwise-admirable and hard-working teachers ended up sneaking into the room that held the tests, so that they could erase and fix enough answers to keep their jobs and make AYP.


Rachel Aviv: A Middle-School Cheating Scandal Raises Questions About No Child Left Behind

Seems to me that when Michelle Rhee demanded that all DC principals commit to particular improvements in test scores, she was in fact demanding that the principals all cheat. Read the article and you will see that what the Atlanta superintendent (Beverly Hall) did was just about the same thing. And Hall is probably headed to prison.

Why not Rhee?

Details on how and why adults cheated in Atlanta Public Schools

A must-read article in the New Yorker on exactly how teachers and administrators cheated on the NCLB tests in Atlanta, Georgia.


The BBA and DCPS also take on predicting what to expect on this year’s DC test scores

It’s nice when people you don’t even know back up what you’ve claimed.

This morning, a group I don’t actually recall hearing of before issued a press release saying about what I recently wrote. They agreed that there was little or no agreement between the test results on the NAEP for the public schools in Washington DC — on the one hand — and what DC’s officials claim the DC-CAS standardized tests show.

This group, Better Bolder Approach to Education (BBA), had way more facts and figures than I did, and their preliminary report is about 15 pages long. Here is the meat of their conclusions:

“Within the next few weeks…DCPS … will release selected data from the 2014 DC Comprehensive Assessment System (DC-CAS) that they will likely assert demonstrate an increase in student proficiency. They may also likely claim substantial gains for low-income and minority students and, possibly, progress in closing race- and income-based test score gaps, as they did last year based on 2013 DC-CAS results.

[We, BBA, are ] … producing a report explaining why these gains are exaggerated and, in some cases, non-existent, and how lack of data transparency, combined with cherry-picking specific numbers, has enabled DCPS and OSSE to paint a false picture of progress. Moreover, our report will show clearly that low-income and minority DCPS students (and other groups of disadvantaged students) have, in fact, lost ground to their more advantaged peers in the past few years under Chancellors Michelle Rhee and Kaya Henderson.

“The report will also explain how excessive pressure has contributed to this gaming of scores… [and ]… explain … why these gains are exaggerated and, in some cases, non-existent, and how lack of data transparency, combined with cherry-picking specific numbers, has enabled DCPS and OSSE to paint a false picture of progress. Moreover, our report will show clearly that low-income and minority DCPS , as well as the multiple negative consequences on students, teachers, and the system as a whole.”

They go on to say,

” DCPS claims of “historic” gains in students who are “proficient” and “advanced” should be reflected in large increases in scale scores, which are the basis for the cut scores. They are not. Mean scale scores range from a low of 45.81 (2010 3rd grade reading among African American students) to highs of over 70 among white students in math). As per the data that are illustrated in Figure A, 2009-2013 gains in reading scale scores are minimal (they range from 0=-0.25 in 6th grade to 2.77 points in 4th grade, for an average of 1.6 points). Math gains are slightly larger, with an outsized 6.25-point gain among 6th graders raising the average to 2.99. 

“Given the 99-point scale for tests, these are far too small to support large proficiency gains.

And then they display this graph, which shows that gains in average scale scores have in fact been very, very small:

BBA graph on scale scores


Keep in mind that these scale scores go from 0 to 99! If after 3 or 4 years of hard work, I found that average scores on my students’ final exams had only risen from a 51 to a 54, I don’t think I would be talking about ‘historic gains’!

Naturally, the DCPS spokesperson belittled the BBA report as follows:

Melissa Salmanowitz, a D.C. schools spokeswoman, said the school system is confident in the accuracy of D.C. CAS results that showed widespread gains.

“It’s incredibly disappointing that this group refuses to believe what is clear in the D.C. CAS data, that our students are making historic progress,” she said. “They’re using fuzzy math and distortions to create a narrative that simply is not true. Every indicator, from test scores to attendance to student satisfaction, shows how DCPS is moving in the right direction.”


From my own experience, I believe the BBA way more than I do anybody from DCPS bureaucracy, since they are making it harder and harder to find any information at all.

I will conclude by linking to the three blog posts that I recently wrote urging folks NOT to believe the self-serving rhetoric that is sure to emerge from the spokespeople at DC’s Office of the State Superintendent of Education (OSSE), DCPS, or the DC mayor’s office.


Part one

Part two

Part three

Even more on the DC-CAS and the NAEP

In this installment, I’ll look at the reading scores for the District of Columbia as reported on the National Assessment of Educational Progress (NAEP) and by DC’s Office of the State Superintendent of Education (OSSE) by way of the DC-CAS (Comprehensive Assessment Program), written and published by CTB-McGraw Hill.

You may have noticed that I’ve been reporting ‘Average Scale Scores’ on both tests, rather than achievement levels — proficient, advanced, below basic and basic. It was suggested to me that this would allow us to compare the two tests (national and ‘state’) more directly, since the decision of what score falls in which category is so obviously open to negotiation and ‘fudging’ by powers-that-be.

In any case, I will continue giving Average Scale Scores, first for 4th graders in reading:

naep + dccas for 4th grade reading compared

As before, the blue scale is the average scale score for DC’s fourth-graders in reading, divided by five so that it would fit on the same grid as the DC-CAS scores for the same subject, same grade level. As before, the DC-CAS scale scores for the fourth grade go from 400 to 499, which I treat as going from 0 to 100, and the NAEP scores go from 0 to 500. As before, I had to find these scores in a variety of places; I gave the URLs in the previous post. Also, for a couple of years, I found two different scores for the same year, so I plotted and reported both of them.

You will notice that since about 1996, which is almost two decades, the scores on the NAEP for successive cohorts of Washington DC fourth-graders have been more or less slowly increasing, and there does not seem to be much difference between that progress before mayoral control of DC schools (labeled “Pre-Rhee”) and after the imposition of mayoral control of the schools (which I labeled “Post-Rhee”).

That’s the blue line.

However, the red line, representing the locally-funded DC-CAS tests for the same grade level, show much more volatility and overall growth, with the jump from 2007 to 2008 being most suspicious of all, knowing what we now know about the degree to which Michelle Rhee instructed each and every principal in DCPS to magically raise test scores or get fired.

Once again, I would much prefer to rely on the federal National Center for Educational Statistics than I would rely on CTB-McGraw Hill or the very-political appointees to DC’s OSSE.

Lastly, I present an image with the same pair of graphs, but  for 8th grade reading:

naep + dccas for 8th grade reading compared

The same comments apply here as with every one of the other three tests. NAEP scores show a little bit of steady growth since 1998 (16 years ago), whereas the DC-CAS seems to show less even but much more impressive growth since 2006.

As usual, I would very much discount what Mayor Gray, Chancellor Henderson, OSSE or CTB-McGraw-Hill have to say. I would recommend that you put much more trust in the federal civil servants at NCES and NAEP.

What about you?


Links to my other articles on this:

Part One

Part Two

Part Three (all reading) — this one right here

Past Performance (on DC’s NAEP and its own CAS tests) Can Give Insight Into Future Performance

Sometimes, looking at the past gives you lots of clues about the future.

From looking at past evidence about the scores of Washington, DC students on both the National Assessment of Educational Progress (NAEP) and on its locally-mandated test (currently known as DC-CAS, or Comprehensive Assessment System), we can make some predictions about the importance (or lack of it) of the results for the 2014 CAS, which were administered about three months ago.

My prediction: the CAS results don’t really matter, one way or the other, because they are so volatile and do not correlate very well with much-more-reliable NAEP. Besides the fact that there have been many documented cases of cheating by adults on the DC-CAS for their own personal gain, it almost seems like the DC-CAS is designed to be manipulated for political and ideological gain, for two main reasons:

(1) In some subjects the DC-CAS has displayed enormous year-to-year score increases that are not at all reflected in the cheat-proof NAEP.

(2) This is despite the fact that between 34% and 42% of all questions are non-scored “anchor” questions designed simply to see if the test gives consistent results from year to year, according to testimony of Emily Durso last September before David Catania’s DC-Council subcommittee on education. Those question’s aren’t scored!

Think about that: something like a third to three-sevenths of all the questions a student is forced to answer isn’t even used to grade the students or teachers. It’s used to help out the testing company.

Which produces unreliable results anyway.

(And even though CTB-McGraw Hill has quite a variety of ways of using statistics to detect cheating by kids or adults, DCPS won’t pay for them to use those methods, I was told by CTB’s head econometrician.)

As promised, here is some of the evidence.

First, we have the DC-CAS (red) and NAEP (blue) scores over the past quarter-century in DC, for 8th grade math students:

naep + dccas 8th grade math scores compared

Once again, the NAEP scores (in blue) for DC’s 8th graders since 1990 seem to show more-or-less steady growth, especially since the year 2000.

(Keep in mind that in order to plot the NAEP and DC-CAS scores on the same grid, and since the NAEP scores go from 0 to 500 while the DC-CAS scores go from 0 to 100, I divided the NAEP scores by 5.)

The DC-CAS was first administered in 2006, so there are no records from before that year. Note that there are two scores given for the year 2009 (46.0 and 49.8), which are pretty far apart; I can only guess as to why they contradict each other. The two sources are here and here. For the NAEP, the reason for the slightly different scores is quite straightforward: one version of the test allowed accommodations for disabilities, and the other did not.

In any case, up until 2011, the gains by successive cohorts of 8th graders on the DC-CAS math test — whom I often taught when I was a teacher in DCPS — was fairly spectacular, but not at all mirrored by the slow, steady progress shown on the NAEP. And since then, those scores have been fairly flat, especially when we remember that the CAS is scored from 0 to 100 (or, to be technical, from 800 to 899; the fourth-grade test scores go from 400 to 499, and the 10th grade tests are scored from 900 to 999 (probably because they didn’t want to add a fourth digit).


Here are the links to the other parts of this article:

Part One  (fourth grade math)

Part Two (8th grade math) — this one right here

Part Three (all reading)

My Predictions for the 2014 DC-CAS Scores

Sometime this month, the Mayor of DC and the Chancellor of the DC Public Schools will make some sort of announcement on how DC public and charter school students did on the DC-CAS (Comprehensive Assessment System) – the test required by Federal law to be given to every single kid in grades 3 through 8 and in grade 10.

I don’t have a crystal ball, and I haven’t developed any sources willing to risk their jobs by leaking the results to me in advance, but I can make a few predictions:

1. If the results look bad, they will be released right before a holiday or a weekend (a basic public-relations tactic that all public officials learn).

2. If the scores as a whole look good, or if there is some part of the trends that look good, that will be highlighted heavily.

3. There won’t be much of a correlation between the trends on the DC-CAS scores and the National Assessment of Ednucational Progress, which has been measuring student achievement in grades 4 and 8 in reading and math since the 1970s by giving a carefully-selected sample of students in DC and across the nation a variety of different test items in math, reading, and a number of other areas.

4. Even though the DC-CAS results won’t be released to the public for a couple more weeks, clearly DCPS officials and Mathematica staff already have them; they have been firing teachers and principals and “adjusting” – with the benefit of hindsight – the rest of their evaluations to fit the DC-CAS scores and the magic secret formula called “Value Added Magic Measurement”.

You may ask, how can GFBrandenburg predict not much of a match between the DC-CAS and the NAEP?

By looking at the track record, which I will share with you.

I present the average scores of all DC students on both the DC-CAS and on the NAEP over the past quarter-century. The NAEP scores for the District of Columbia have either been pretty steady or have been rising slightly.

As far as I can tell, the statisticians at the National Center for Educational Statistics (NCES) who design, administer, and score the NAEP do a fine job of

A. making sure that there is no cheating by either students or adults,

B.  making up good questions that measure important topics, and

C. gathering, collating, and reporting the data in an honest manner.

On the DC -CAS, however, we have had many documented cases of cheating (see point A), I have shown that many of the questions are ridiculous and don’t measure what we teachers were supposed to be teaching (see point B), and I hope to show you that whatever they are doing with the scores does not seem to be trustworthy.

Exhibit number one is a graph where I plot the average scale scores of the students in Washington DC on both the NAEP and on the DC-CAS for fourth grade math:

naep + dccas 4th grade math comparison

Allow me to explain.

The bottom blue curve is what DC’s fourth-graders average scale scores were on the NAEP starting in 1992 and going on through 2013. As you can see, since 1996, there has been what appears like more-or-less steady improvement.

(It is very hard, in fact, to see much of a difference in trends before mayoral control over the DC schools and after that time. I drew a vertical black line to separate the ‘Pre-Rhee” era from the “Post-Rhee” era, since Michelle Rhee was the very first Chancellor installed in the DC schools, after the annual tests were given in 2007.)

(As noted,  the NAEP scale scores go from 0 to 500, but the DC-CAS scores go from 0 to 100. I decided that the easiest way to have them both fit on the same graph would simply be to divide the NAEP scores by 5. The actual reported NAEP scores are in the little table, if you want to examine them for yourself. You can double-check my numbers by looking around at the NAEP and DC OSSE websites — which are unfortunately not easy to navigate, so good luck, and be persistent! You will also find that some years have two different scores reported, which is why I put those double asterisks at a couple of places on those curves.)

But here’s what’s really suspicious: the DC-CAS scores, shown in red, seem to jump around wildly and appear to show tremendous progress overall but also utterly un-heralded drops.

Which is it?

Slow, steady progress since 1996, or an amazing jump as soon as Wonder Woman Rhee comes on the scene?

In my opinion, I’d much rather trust the feds on this. We know that there has been all sorts of hanky-panky with the DC-CAS, as repeatedly documented in many places. I know for a fact that we math teachers have been changing the ways that we teach, to be more in line with the 1989 NCTM standards and the ways that math is tested on the NAEP. It’s also the case that there has been significant gentrification in DC, with the proportion of white kids with highly educated parents rising fairly steadily.

Slow improvement in math scores, going back a quarter of a century, makes sense.

Wild jumps don’t seem reasonable to me at all.

On the contrary, besides the known mass cheating episodes, it almost seems like DC education officials get together with McGraw-Hill CTB, which manufactures the DC-CAS, and decide how they want to get the scores to come out. THEN they decide which questions to count and which ones NOT to count, and what the cut-off scores will be for ‘advanced’, ‘proficient’ and so on.

Next time: 8th grade math; and 4th and 8th grade reading.


Links to my other articles on this:

Part One  (fourth grade math)— this one right here

Part Two (8th grade math)

Part Three (all reading)

Excellence in EduReporting & Entertainment from Edushyster and Bob Braun

EduShyster does an excellent job at stripping away the myths that are cloaking the elite-led war on public education and school teachers in particular.

Bob Braun does an excellent job at showing how completely racist and undemocratic it is that Chris Christie can re-appoint a superintendent of schools who pointedly thwarts the expressed will of all of the citizens in the city that she oversees:

Weekly Roundup of Testing Resistance and Reform News from FairTest


National Center for Fair & Open Testing

TO: Journalists Who Cover Education
FROM: Bob Schaeffer, Public Education Director
RE: Testing Resistance & Reform News
DATE: June 24, 2014

What a week!

The impacts of “Testing Resistance & Reform Spring” protests reverberate across the nation with more states suspending testing requirements or pulling out of testing consortia. Bill Gates’ call for a moratorium on some consequences from Common Core exams, quickly implemented by some political allies, reflects another way grassroots power is forcing policy elites to backpedal. To take advantage of this opportunity, parents, educators, students, and community activists need to step up advocacy campaigns to end standardized testing misuse and press for implementation of higher quality performance assessments.

Remember that back issues of these weekly updates are archived at: — let me know if you want to be added to the regular distribution list

What the Gates Foundation’s Embrace of a High-Stakes Testing Moratorium Really Means

Plan for Common Core Testing “Fractures” As States Withdraw

Common Core National Field Tests Had Major, Known Data Security Flaw

Bid-Rigging Lawsuit Throws $240Million/Year Common Core Testing Contract Into Limbo

Colorado Parent’s Letter: Fixation on Testing Hurts Local Education

DC Public Schools Take “Hiatus” From Test-Based Teacher Evaluation

Supers Question Florida Writing Test Scores

Florida Teacher Who Decried “Toxic Culture of Education” Now Running for School Board–school-board-,0,

Turmoil Over Indiana School Testing Continues

Indiana Parents Protest Testing Frequency

Louisiana Governor Seeks to Block Common Core Test

Common Core Fight in Louisiana Needs Common Sense

Massachusetts Super: Adding New Tests Fits the Definition of “Insanity”

Debate Over Massachusetts Testing System Ignores Larger Educational Questions

New Jersey Assembly Votes to Put Brakes on Common Core Testing

New York Educator Union Head Seeks Overhaul of Exam-Score-Based Ratings

Common Core Testing Concerns Spur Teacher Evaluation Change

New York Parents Outraged That Testing “Pause” Does Not Include Students

Ohio Legislature Delays Common Core Testing Impact

Rhode Island Legislature Passes Grad Test Suspension Bill

Happy Rhode Island Teenager Was Prime Example for Exit Exam Repeal

South Carolina Retroactively Gives Diplomas to Adults Who Failed High School Grad Test

Tennessee Quits PARCC Testing Consortium

Legislators Seek Tennessee Ed. Head’s Resignation Over Test-Score Manipulation

Texas District Super: Test Does Not Define Your Child

Education “Reform” — A National Delusion

New Analysis Rebuts Claims About Accuracy of “Value-Added” Teacher Evaluation

Cartoon: Transforming Teachers Into Mere Test Proctors

What Real Learning Looks Like (Hint: It’s Not Test-Driven Classrooms)

How Standardized Testing Keeps Us Stuck in the 20th Century

Why Education in Finland Works

“Good Morning Mission Hill” — A Model for a U.S. School Promoting Real Learning

Why Machines Should Never Be Allowed to Grade Student Writing

College to Applicants: We Won’t Look at Your SATs (or ACTs)

Bob Schaeffer, Public Education Director
FairTest: National Center for Fair & Open Testing
office- (239) 395-6773 fax- (239) 395-6779
mobile- (239) 696-0468


Get every new post delivered to your Inbox.

Join 397 other followers