Some debate in Chevy Chase (DC) on significance of latest NAEP scores …

On a local DC list-serve for the region where I last taught (and also went to Junior High School), I posted this:

==========================================================

Those of us with kids in Chevy Chase – DC, either now, in the future, or in the past, have seen many changes in education here in DC, especially since 2007, when the elected board of education was stripped of all powers under PERAA and Chancellor Rhee was appointed by Mayor Fenty.
[I personally went to Junior High School here at Deal back in the early 1960s, taught math in DCPS from 1978 to 2009, including 15 years at Deal (much to my surprise) and my own kids went K-12 in DCPS, graduating from Walls and Banneker, respectively]
Was mayoral control of schools in DC a success? Is the hype we have all heard about rising test scores for real?
We now have statistics from  NAEP* for about two decades, and we can compare scores for various subgroups before and after that 2007 milestone.
Did Black students make faster improvements after PERAA than beforehand? Nope. To contrary: their scores were inching up faster *before* 2007 than they have been doing since that time.
Did Hispanic students make faster improvements under the reformers? Nope, again.
How about students whose parent(s) didn’t graduate high school, and/or those who finished grade 12 but either never went to college or else didn’t earn a degree – surely they did better after Rhee, Henderson et al. took over? Again, no.
Then what group of students in Washington DC *did* make more progress on the NAEP after the Reformers took over?
You guessed it, I bet:
White students, and students with parents who earned a college degree.
Amazing.
Guy Brandenburg
*National Assessment of Educational Progress
======================================================================
Another person contested my assessment and wrote the following:
=======================================================================
The NAEP is cross-sectional data, i.e. it does nothing to adjust for changes in composition of test-takers over time, which is why Steve Glazerman refers to comparisons of NAEP scores over time as “misNAEPery” [https://ggwash.org/view/ 31061/bad-advocacy-research- abounds-on-school-reform] and I have referred to the same thing as “jackaNAEPery” [https://www.urban.org/urban- wire/how-good-are-dcs-schools] .
There has been a dramatic, even shocking, compositional change since 2000 in births across the city, entering cohorts of students, and exit rates from DC schools and the city.
Most noticeably in NW, better educated parents are substantially more likely to have kids in DC, enroll them in DC public schools, and stay past 3rd grade.
Any analysis of test score change needs to grapple with that compositional change.
But more importantly, the compositional change itself is a policy outcome of note, which the DC Council and Mayor have an interest in promoting.
The only evidence one should accept must *at minimum* use longitudinal data on students to compute *learning* as opposed to static achievement, e.g. this analysis of 2008 school closures:
A lot of other things happened 1996-2008 of course, including a rapid expansion of charters, a shrinking proportion of DC residents attending private schools, etc.In 2008 alone, a lot of Catholic schools closed, and some converted to public charter schools.
During this time, we also had a voucher program that produced some gains early on, and then began to lower test scores relative to public options:
All of this is not to say DCPS and charter schools shouldn’t serve less advantaged students better than they do–obviously they should! But the evidence is nuanced, and DC has made huge gains across the board since the 1990’s that make attributing any changes to policy rather than shifting population composition problematic at best.
Interestingly, the NAEP data explorer [https://www. nationsreportcard.gov/ndecore/ xplore/nde]does not report scores for white 8th graders in 1990, 1992, and 1996, presumably because too few were tested. I.e. the means by race show a lot of  “‡ Reporting standards not met.
[I personally attended DCPS (Hyde, Hardy, and School Without Walls) 1976-1989, have 2 children currently in Deal and SWW.]
Austin Nichols
========================================================================
I wrote a response to Nichols, but it hasn’t been posted yet, and might never be:
========================================================================
My previous reply got lost somewhere in cyberspace.
If looking at long-term trends in the NAEP and TUDA is ‘misnaepery’ or ‘jacknaepery’, as Mr Austin would have us believe, then the entire NAEP bureaucracy has been doing just that. (In fact, an entire branch of the National Center for Education Statistics is devoted to, yes, Long Term Trends: https://nces.ed.gov/nationsreportcard/ltt/ )
It’s a laughable idea that we could just use the tests chosen by DCPS and later by OSSE and administered every year, to tell how good DC public or charter schools are, over time. First of all, the tests administered here have changed dramatically. Back in the 1990s it was the CTBS. Then it was the SAT-9, developed by a different company. Then it was the DC-CAS, again, a different vendor. Now we have the PARCC produced by yet another vendor. We also know that in the past there has been major fraud with these tests, committed by adults, in order to gain bonuses and keep their jobs. We also have no way of comparing DC with any other city or state using those tests, since only a handful of states even use the PARCC and for all I know, their cut scores and questions might be different from what we use here in DC.
The idea of measuring median student improvement from year to year might appear to have some merit, until you talk to students and teachers involved. You discover that many of the older students see no reason to take the tests seriously; they bubble in, or click on, answers as fast as possible, without reading the questions, in order to be free to leave the room and go do something else. Any results from that test are simply unreliable, and it is simply not possible to tell whether DC education policies have improved over time based on the PARCC, DC-CAS, SAT-9, or CTBS, no matter what sort of fancy statistical procedures are employed.
With the NAEP, on the other hand, there has never been any suggestion of impropriety, and the same agency has been devising, administering, and scoring these tests for decades. We have no other nation-wide test that has been systematically given to a random sample of students for any length of time.
Obviously the 4th or 8th graders who took the NAEP in 2017 were not the same ones who took it in 2015. (Duh!) However, we do in fact have a record of NAEP scores in every state and DC since the 1990s, and they are also broken down by lots of subgroups. Obviously DC is gentrifying rapidly, and there are more white students in DCPS than there were 10 or 20 years ago. If we trace the various subgroups (say, African-American students, or Hispanics, or students whose parents didn’t finish high school, or whatever group you like), you can watch the trends over time in each subgroup. However, Mr Austin does inadvertently raise one valid point: since the proportion of black students in DC is decreasing, and the proportion of white students with college-educated parents is rising, then the natural conclusion would be that this gentrification has *inflated* overall scores for 4th and 8th grade students in DC (and DCPS), especially since 2007. Which is more evidence that ‘reform’ is not working. Not evidence that we should throw the scores out and ignore them completely.
Those trends show something quite different from what Mayor Bowser keeps proclaiming. For one thing, if you look at the simple graphs that I made (and you can examine the numbers yourselves) you can see that any improvements overall in DC, or for any subgroups, began a decade before the ‘reformers’ took over DC schools. ( see https://bit.ly/2K3UyZ1 to begin poking around.) Secondly, for most of the subgroups, those improvements over time were greater before Rhee was anointed Chancellor. Only two groups had better rates of change AFTER Rhee: white students, and those with parents with college degrees – the ones that are inflating overall scores for DC and DCPS during the last decade.
I would note also that the previous writer’s salary is paid by one of the Reform organizations supported by billionaires Gates and Arnold. You can look at the funding page yourself ( page 3 at https://urbn.is/2II1YQQ ). I suspect that when ‘reform’ advocates say not to look at our one consistent source of educational data, it’s because they don’t like what the data is saying.
Guy Brandenburg
Advertisements

Mayoral Control of Schools in Washington DC Appears to have Benefitted Children of College Grads, But Nobody Else

The reason given for having the office of the Mayor (originally Adrian Fenty) take over the school system in Washington DC, and abolishing all the powers of the elected school board, was to help the poorest kids.

But that’s not how it worked out, according to official test results from the National Assessment of Educational Progress.

Using those stats, harvested for me by the parent of a former student of mine from the NAEP database, we see that children in DC whose parents did NOT finish college made lower gains after 2007 (the date of the changeover) than they did before that date. However, children of college graduates in DC made higher gains after 2007.

Amazing.

And yet another sign that the education ‘reform’ movement is a complete failure.

Here are my graphs and raw data. (Right-click to see them enlarged, if you have a PC – not sure what to do if you have an Apple product.)

annualized gains pre and post mayoral control, DC, 8th grade math, by parental education

The vertical orange line shows the date (June of 2007) when Michelle Rhee was appointed as the first Chancellor of DC Public Schools. The black, dashed line represents average scale scores on the 8th grade math NAEP for students who reported that their parent(s) graduated from college, and the other lines shows scores for kids whose parent(s) did or did not graduate high school, had some college courses. The thin, double blue line represents those students who were unsure of their parental education.

I asked Excel to calculate the annual rate of change pre- and post-mayoral control, and you can see the results in the last two columns. The boxes filled in with yellow are the ‘winners’, so to speak. Note that for the period 2000-2007, the annualized change in NAEP scale scores on the 8th grade NAEP math test in DC is 2.63, which means that on the average, that group of students (yeah, it’s a different group of students for each testing event) saw their scores rise by 2.63 points per year, or 5.26 points every two years. However, for the period 2007-2017, after mayoral control, that same group of students saw their gains cut nearly in half – it tumbled to 1.41 points per year. Kids whose parents did graduate from high school (but went no further) and those whose parents had some education after high school, also saw their rates of increase tumble drastically. Kids who were unsure of their parental education levels or who didn’t report it also saw a drop, but not so large: dropping from 2.08 down to 1.88 points per year.

The only group which saw their annualized scores increase after mayoral control were the children of college graduates: their rate went from 1.16 points/year to 2.60 points per year, which to me looks rather significant.

Ironic, huh?

And here are the results for reading:

annualized gains pre and post mayoral control, dc, 8th grade reading, by parental education

Once again, the results for students whose parents did NOT graduate from college (the first three lines of the table) tumbled dramatically after mayoral control. However, students whose parents did graduate from college (the fourth line) saw a dramatic increase. The last line, representing kids who didn’t know or didn’t report their parental education, saw a little uptick after mayoral control.

Remind me again why  we got rid of the elected school board and put the mayor in charge? Was it really to make sure that the ‘haves’ would get more and that the ‘have-nots’ would have less?

Let me point out the obvious: white parents in DC are overwhelmingly college-educated. Those in DC who did not graduate from high school, or who graduated from 12th grade and went no further, are overwhelmingly African-American or Hispanic. So our ‘reforms’ have had a disproportionately negative impact on black and hispanic students, and a positive one on white kids.

Was that really the intent all along?

NATIONAL TEST SCORES IN DC WERE RISING FASTER UNDER THE ELECTED SCHOOL BOARD THAN THEY HAVE BEEN DOING UNDER THE APPOINTED CHANCELLORS

 

Add one more to the long list of recent DC public education scandals* in the era of education ‘reform’:

DC’s NAEP** test scores are increasing at a lower rate now (after the elected school board was abolished in 2007) than they were in the decade before that.

This is true in every single subgroup I looked at: Blacks, Hispanics, Whites, 4th graders, 8th graders, in reading, and in math.

Forget what you’ve heard about DC being the fastest-growing school district. Our NAEP scores were going up faster before our first Chancellor, Michelle Rhee, was appointed than they have been doing since that date.

Last week, the 2017 NAEP results were announced at the National Press Club building here on 14th Street NW, and I went in person to see and compare the results of 10 years of education ‘reform’ after 2007 with the previous decade. When I and others used the NAEP database and separated out average scale scores for black, Hispanic, and white students in DC, at the 4th and 8th grade levels, in both reading and math, even I was shocked:

In every single one of these twelve sub-groups, the rate of change in scores was WORSE (i.e., lower) after 2007 (when the chancellors took over) than it was before that date (when we still had an elected school board).

I published the raw data, taken from the NAEP database, as well as graphs and short analyses, on my blog, (gfbrandenburg.wordpress.com) which you can inspect if you like. I will give you two examples:

  • Black 4th grade students in DC in math (see https://bit.ly/2JbORad ):
    • In the year 2000, the first year for which I had comparable data, that group got an average scale score of 188 (on a scale of 0 – 500). In the year 2007, the last year under the elected school board, their average scale score was 209, which is an increase of 21 points in 7 years, for an average increase of 3.0 points per year, pre-‘reform’.
    • After a decade of ‘reform’ DC’s black fourth grade students ended up earning an average scale score of 224, which is an increase of 15 points over 10 years. That works out to an average growth of 1.5 points per year, under direct mayoral control.
    • So, in other words, Hispanic fourth graders in DC made twice the rate of progress on the math NAEP under the elected school board than they did under Chancellors Rhee, Henderson, and Wilson.

 

  • Hispanic 8th grade students in DC in reading (see: https://bit.ly/2HhSP0z )
    • In 1998, the first year for which I had data, Hispanic 8th graders in DC got an average scale score of 246 (again on a scale of 0-500). In 2007, which is the last year under the elected board of education, they earned an average scale score of 249, which is an increase of only 3 points.
    • However, in 2017, their counterparts received an average scale score of 242. Yes, the score went DOWN by 7 points.
    • So, under the elected board of education, the scores for 8th grade Latinx students went up a little bit. But under direct mayoral control and education ‘reform’, their scores actually dropped.

 

That’s only two examples. There are actually twelve such subgroups (3 ethnicities, times 2 grade levels, times 2 subjects), and in every single case progress was worse after 2007 than it was beforehand.

 

Not a single exception.

 

You can see my last blog post on this, with links to other ones, here: https://gfbrandenburg.wordpress.com/2018/04/20/progress-or-not-for-dcs-8th-graders-on-the-math-naep/ or https://bit.ly/2K3UyZ1 .

 

Amazing.

 

Why isn’t there more outrage?

=======================================================================

*For many years, DC officials and the editorial board of the Washington Post have been bragging that the educational ‘reforms’ enacted under Chancellor Michelle Rhee and her successors have made DCPS the fastest-improving school district in the entire nation. (See https://wapo.st/2qPRSGw or https://wapo.st/2qJn7Dh for just two examples.)

It didn’t matter how many lies Chancellor Rhee told about her own mythical successes in a privately run school in Baltimore (see https://wapo.st/2K28Vgy ).  She also got away with falsehoods about the necessity of firing hundreds of teachers mid-year for allegedly being sexual predators or abusers of children (see https://wapo.st/2qNGxqB ); there were always acolytes like Richard Whitmire willing to cheer her on publicly (see https://wapo.st/2HC0zOj ), even though the charges were false.

A lot of stories about widespread fraud in the District of Columbia public school system have hit the front pages recently. Examples:

  • Teachers and administrators were pressured to give passing grades and diplomas to students who missed so much school (and did so little work) that they were ineligible to pass – roughly one-third of last year’s graduating class. (see https://bit.ly/2ngmemi ) You may recall that the rising official (but fake) high school graduation rate in Washington was a used as a sign that the reforms under direct mayoral control of education had led to dramatic improvements in education here.
  • Schools pretended that their out-of-school suspension rates had been dropping, when in actual fact, they simply were suspending students without recording those actions in the system. (see https://wapo.st/2HhbARS )
  • Less than half of the 2018 senior class is on track to graduate because of truancy, failed classes, and the like. ( see https://bit.ly/2K5DFx9 )
  • High-ranking city officials, up to and including the Chancellor himself, cheated the system by having their own children bypass long waiting lists and get admitted to favored schools. (see https://wapo.st/2Hk3HLi )
  • A major scandal in 2011 about adults erasing and changing student answer sheets on the DC-CAS test at many schools in DC in order to earn bonuses and promotions was unfortunately swept under the rug. (see https://bit.ly/2HR4c0q )
  • About those “public” charter schools that were going to do such a miraculous job in educating low-income black or brown children that DCPS teachers supposedly refused to teach? Well, at least forty-six of those charter schools (yes, 46!) have been closed down so far, either for theft, poor performance on tests, low enrollment, or other problems. (see https://bit.ly/2JcxIx9 ).

 

=========================================================================

**Data notes:

  1. NAEP, or the National Assessment of Educational Progress, is given about every two years to a carefully chosen representative sample of students all over the USA. It has a searchable database that anybody with a little bit of persistence can learn to use: https://bit.ly/2F5LHlS .
  2. I did not do any comparable measurements for Asian-Americans or Native Americans or other such ethnic/racial groups because their populations in DC are so small that in most years, NAEP doesn’t report any data at all for them.
  3. In the past, I did not find big differences between the scores of boys and girls, so I didn’t bother looking this time.
  4. Other categories I could have looked at, but didn’t, include: special education students; students whose first language isn’t English; economically disadvantaged students; the various percentiles; and those just in DCPS versus all students in DC versus charter school students. Feel free to do so, and report what you find!
  5. My reason for not including figures separated out for only DCPS, and only DC Charter Schools, is that NAEP didn’t provide that data before about 2011. I also figured that the charter schools and the regular public schools, together, are in fact the de-facto public education system that has grown under both the formerly elected school board and the current mayoral system, so it was best to combine the two together.
  6. I would like to thank Mary Levy for compiling lots of data about education in DC, and Matthew Frumin for pointing out these trends. I would also like to thank many DC students, parents, and teachers (current or otherwise) who have told me their stories.

 

Progress (or Not) for DC’s 8th Graders on the Math NAEP?

8th grade naep math, DC, w + H + B

Here we have the average scale scores on the math NAEP for 8th grade students in Washington, DC.* You will notice that we don’t have data for 8th grade white students in DC in math for the years 2003, 2007, and 2009, because there weren’t enough white students taking the test in those years for the statisticians at NCES to be confident in their data.

The vertical, dashed, red line near the middle of the graph represents the date when the old, elected, DC school board was replaced by Chancellors Rhee, Henderson, and Wilson, directly appointed by the various mayors. That year (2007) was also when Rhee and her underlings instituted brand-new teacher evaluation systems like IMPACT and VAM and new curricula and testing regimes known as Common Core, PARCC, and so on. Hundreds, if not thousands, of teachers were either fired or resigned or took early retirement. If these reforms had been as successful as Rhee promised in writing, then the lines representing scores for white, black, and hispanic students in DC would go slanting strongly up and to the right after that 2007 change.

I don’t see it.

Do you?

In fact, let’s look carefully at the slopes of the lines pre-Rheeform and post-Rheeform.

For black 8th grade students, scores went from 231 to 245 in the years 2000 to 2007, or 14 points in 7 years, which is a  rise of 2.0 points per year. After mayoral control, the scores for black students went from 245 to 257, or 12 points in 10 years. That’s rise of 1.2 points per year.

Worse, not better.

For Hispanic students, scores went from 236 in the year 2000 to 251 in 2007, a rise of 15 points in 7 years, or a rise of about 2.1 points per year. After mayoral control, their scores went from 251 to 263 in 10 years, which is a rise of 1.2 points per year.

Again: Worse, not better.

With the white students, a lot of data is missing, but I’ll compare what we have. Their scores went from 300 in year 2000 to 317 in the year 2005, which is an increase of 3.4 points per year. After mayoral control, their scores went from 319 in 2011 to 323, in 2017 or a rise of four (4!) points in 6 years, which works out to about 0.6 points per year.

Once again, Worse, not better.

Voters, you have the power to stop this nonsense, if you get organized!

—————————————————-

* Note that I’m using the numbers for Washington DC as a whole – which includes the regular DC Public School system, all the charter schools, as well as private (aka ‘independent’) and parochial schools. At one point, NAEP divided the DC scores into those for DCPS only (on the one hand) and for everybody else. In addition, they began to make it possible to separate out charter schools. However, since the regular public schools and the charter schools together educate the vast majority of students in DC, and the DCPS-only score-keeping started well after 2007, I decided to use the scores for all of DC because there was a much longer baseline of data, going back about twenty years.

=================================================

Here are my previous posts on this matter:

  1. https://gfbrandenburg.wordpress.com/2018/04/16/just-how-much-success-has-there-been-with-the-reformista-drive-to-improve-scores-over-the-past-20-years/
  2. https://gfbrandenburg.wordpress.com/2018/04/16/maybe-there-was-progress-with-hispanic-students-in-dc-and-elsewhere/
  3. https://gfbrandenburg.wordpress.com/2018/04/16/progress-perhaps-with-8th-grade-white-students-in-dc-on-naep-after-mayoral-control/
  4. https://gfbrandenburg.wordpress.com/2018/04/16/was-there-any-progress-in-8th-grade-math-on-the-naep-in-dc-or-elsewhere/
  5. https://gfbrandenburg.wordpress.com/2018/04/17/one-area-with-a-bit-of-improvement-4th-grade-math-for-black-students-on-the-naep/
  6. https://gfbrandenburg.wordpress.com/2018/04/17/more-flat-lines-4th-grade-reading-for-hispanic-and-white-students-dc-and-nationwide/
  7. https://gfbrandenburg.wordpress.com/2018/04/17/the-one-area-where-some-dc-students-improved-under-mayoral-control-of-education/
  8. https://gfbrandenburg.wordpress.com/2018/04/20/how-dcs-black-white-and-hispanic-students-compare-with-each-other-on-the-naep-over-the-past-20-years/
  9. https://gfbrandenburg.wordpress.com/2018/04/20/comparing-dcs-4th-grade-white-black-and-hispanic-students-in-the-math-naep/
  10. https://gfbrandenburg.wordpress.com/2018/04/20/dcs-black-hispanic-and-white-students-progress-on-the-naep-under-mayoral-control-and-before-8th-grade-reading/

DC’s Black, Hispanic and White Students Progress on the NAEP Under Mayoral Control and Before – 8th Grade Reading

8th grade naep reading, DC, B + W + H

We are looking at the average scale scores for 8th grade black, Hispanic, and white students in DC on the NAEP reading tests over the past two decades. Ten years ago, Washington DC made the transition from a popularly-elected school board to direct mayoral control of the school system. Michelle Rhee and Kaya Henderson, our first and second Chancellors under the new system, promised some pretty amazing gains if they were given all that power and many millions of dollars from the Walton, Arnold, and Broad foundations, and I showed that almost none of their promises worked out.

In the graph above, the vertical, dashed, green line shows when mayoral control was imposed, shortly after the end of school in 2007, so it marks a convenient end-point for school board control and a baseline for measuring the effects of mayoral control.

For 8th grade black students in reading in DC, their average scale scores went from 233 in 1998 to 238 in 2007, under the elected school board, which is a (very small) rise of 5 points in 9 years, or about 0.6 points per year. Under mayoral control, their scores went from 238 to 240, which is an even tinier increase of 2 points in 10 years, or 0.2 points per year.

Worse, not better.

For the Hispanic students, scores only increased from 246 to 249 before we had chancellors, or 3 points in 9 years, or about 0.3 points per year. After mayoral control, their scores went DOWN from 249 to 242 in 10 years, or a decrease of 0.7 points per year.

Again, worse, not better: going in the wrong direction entirely.

For white DC 8th graders, it’s not possible to make the same types of comparisons, because there were not sufficient numbers of white eighth-grade students in DC taking the test during five of the last ten test administrations for the NCES statisticians to give reliable results. However, we do know that in 2005 (pre-mayoral control) white 8th graders in DC scored 301 points. And since the mayors and the chancellors took over direct control of education in DC, not once have white students scored that high.

Again, worse, not better.

Why do we keep doing the same things that keep making things worse?

==============================================

My previous posts on this topic:

  1. https://gfbrandenburg.wordpress.com/2018/04/20/comparing-dcs-4th-grade-white-black-and-hispanic-students-in-the-math-naep/
  2. https://gfbrandenburg.wordpress.com/2018/04/17/the-one-area-where-some-dc-students-improved-under-mayoral-control-of-education/
  3. https://gfbrandenburg.wordpress.com/2018/04/17/more-flat-lines-4th-grade-reading-for-hispanic-and-white-students-dc-and-nationwide/
  4. https://gfbrandenburg.wordpress.com/2018/04/17/one-area-with-a-bit-of-improvement-4th-grade-math-for-black-students-on-the-naep/
  5. https://gfbrandenburg.wordpress.com/2018/04/16/was-there-any-progress-in-8th-grade-math-on-the-naep-in-dc-or-elsewhere/
  6. https://gfbrandenburg.wordpress.com/2018/04/16/progress-perhaps-with-8th-grade-white-students-in-dc-on-naep-after-mayoral-control/
  7. https://gfbrandenburg.wordpress.com/2018/04/16/maybe-there-was-progress-with-hispanic-students-in-dc-and-elsewhere/
  8. https://gfbrandenburg.wordpress.com/2018/04/16/just-how-much-success-has-there-been-with-the-reformista-drive-to-improve-scores-over-the-past-20-years/

 

Comparing DC’s 4th Grade White, Black, and Hispanic Students in the Math NAEP

4th grade math naep, DC, w + B + H

Here we have the average scale scores for DC’s white, black, and Hispanic fourth graders in math on the National Assessment for Educational Progress, prompted by the data rollout earlier this week of the 2017 results.

The vertical, blue, dashed line at the year 2007 shows where DC changed from having an elected school board with real power, to having a mayor who sets educational policy on his/her own, appointing a Chancellor (starting with the serial fabulist, Michelle Rhee).

If mayoral control of the schools, along with the firing or forcing out of hundreds or thousands of teachers, and all the other ‘reforms’ that have been instituted since 2007, were such a great success, then you would see the purple, orange, and green lines going sharply upwards to the right after the year 2007.

But you don’t.

In fact, let’s do a little math here, and look at rates of change pre- and post-mayoral control

For black 4th graders in math in DC, under the elected school board, the average scale scores went from 188 in the year 2000 to 209 in the year 2007. That is an increase of 21 points in 7 years, or about 3.0 points per year. After mayoral control, those scores went from 209 in year 2007 to 224 in year 2017. That is a rise of 15 points in 10 years, or a rate of change of 1.5 points per year.

That’s worse, not better.

For Hispanic students, during period under the school board, the scores went from 190 to 220 in 7 years, which is a growth of about 4.3 points per year. After mayoral control, their scores went from 220 to 230, which is an increase of 1.0 points per year.

Once again, that’s worse under mayoral control, not better.

For white students in DC, pre-Rhee, the scores went from 254 to 262 in 7 years, or a growth of  roughly 1.1 points per year. After mayoral control (and under Rhee and her successors), their scores went from 262 to 273 in 10 years, which is exactly 1.1 points per year.

No change.

So, to sum things up: for black and Hispanic students, who are obviously the two main groups of economically-deprived students in DC, if we look at scores on the NAEP over the past 20 years, there has been LESS improvement under mayoral control (and under IMPACT, VAM, PARCC and everything else) than there was before.

Is anybody paying any attention to this?

Or will the beatings continue and intensify until morale somehow, miraculously, improves?

==============================================================

You can see my previous posts on this topic at these links:

  1. https://gfbrandenburg.wordpress.com/2018/04/20/how-dcs-black-white-and-hispanic-students-compare-with-each-other-on-the-naep-over-the-past-20-years/
  2. https://gfbrandenburg.wordpress.com/2018/04/17/the-one-area-where-some-dc-students-improved-under-mayoral-control-of-education/
  3. https://gfbrandenburg.wordpress.com/2018/04/17/more-flat-lines-4th-grade-reading-for-hispanic-and-white-students-dc-and-nationwide/
  4. https://gfbrandenburg.wordpress.com/2018/04/17/one-area-with-a-bit-of-improvement-4th-grade-math-for-black-students-on-the-naep/
  5. https://gfbrandenburg.wordpress.com/2018/04/16/was-there-any-progress-in-8th-grade-math-on-the-naep-in-dc-or-elsewhere/
  6. https://gfbrandenburg.wordpress.com/2018/04/16/progress-perhaps-with-8th-grade-white-students-in-dc-on-naep-after-mayoral-control/
  7. https://gfbrandenburg.wordpress.com/2018/04/16/maybe-there-was-progress-with-hispanic-students-in-dc-and-elsewhere/
  8. https://gfbrandenburg.wordpress.com/2018/04/16/just-how-much-success-has-there-been-with-the-reformista-drive-to-improve-scores-over-the-past-20-years/

 

 

Has Mayoral Control In DC Caused A Miracle Regarding Hispanic Students?

I will now post graphs showing how Hispanic students in fourth and eighth grade in DC have scored in math and reading in comparison to other US large cities and the nation’s public schools. As with the previous post, I drew a thick, vertical, red, dotted line showing where the previous, democratically-elected school board was replaced by mayoral control under a law called PERAA.

Here are the ‘average scale scores’ for eighth-grade Hispanic students in math and reading in DC (green), the NAEP sample of Hispanic 8th graders in US large cities (orange), and the NAEP sample of all Hispanic 8th grade students in public schools:

Do you see a miracle that happened to the right of that dotted red line?

I don’t.

What I do see is that in math, the rate of improvement for DC’s Hispanic 8th graders from 2000 to 2007 (under democratic local control of schools) seems considerably faster than the corresponding rate afterwards (under mayoral control).

In reading, it seems like Hispanic 8th grade students in DC were scoring generally higher than their national peers, but after PERAA, they scored lower than their peers. Some miracle.

Let’s look at 4th grade:

Once again, from 2000 through 2007 (under local democratic control of schools), the rate of increase in DC Hispanic students’ scores in both math and reading was considerably higher than after the mayor took over.

Some miracle.

Jersey Jazzman On NY State Charter Schools and Indentured Servitude by their Teachers…

Very interesting article on the methods by which certain New York State charter school chains plan to make sure that their teachers don’t depart for less onerous working conditions and better pay in the regular public school sector. JJ says that the plan won’t work in the long run. Interesting reading, if you can follow his reasoning.

Here is the link:

http://jerseyjazzman.blogspot.com/2017/07/shooting-themselves-in-foot-teacher.html

Texas Decision Slams Value Added Measurements

And it does so for many of the reasons that I have been advocating. I am going to quote the entirety of Diane Ravitch’s column on this:


Audrey Amrein-Beardsley of Arizona State University is one of the nation’s most prominent scholars of teacher evaluation. She is especially critical of VAM (value-added measurement); she has studied TVAAS, EVAAS, and other similar metrics and found them deeply flawed. She has testified frequently in court cases as an expert witness.

In this post, she analyzes the court decision that blocks the use of VAM to evaluate teachers in Houston. The misuse of VAM was especially egregious in Houston, which terminated 221 teachers in one year, based on their VAM scores.

This is a very important article. Amrein-Beardsley and Jesse Rothstein of the University of California testified on behalf of the teachers; Tom Kane (who led the Gates’ Measures of Effective Teaching (MET) Study) and John Friedman (of the notorious Chetty-Friedman-Rockoff study) testified on behalf of the district.

Amrein-Beardsley writes:

Of primary issue will be the following (as taken from Judge Smith’s Summary Judgment released yesterday): “Plaintiffs [will continue to] challenge the use of EVAAS under various aspects of the Fourteenth Amendment, including: (1) procedural due process, due to lack of sufficient information to meaningfully challenge terminations based on low EVAAS scores,” and given “due process is designed to foster government decision-making that is both fair and accurate.”

Related, and of most importance, as also taken directly from Judge Smith’s Summary, he wrote:

HISD’s value-added appraisal system poses a realistic threat to deprive plaintiffs of constitutionally protected property interests in employment.

HISD does not itself calculate the EVAAS score for any of its teachers. Instead, that task is delegated to its third party vendor, SAS. The scores are generated by complex algorithms, employing “sophisticated software and many layers of calculations.” SAS treats these algorithms and software as trade secrets, refusing to divulge them to either HISD or the teachers themselves. HISD has admitted that it does not itself verify or audit the EVAAS scores received from SAS, nor does it engage any contractor to do so. HISD further concedes that any effort by teachers to replicate their own scores, with the limited information available to them, will necessarily fail. This has been confirmed by plaintiffs’ expert, who was unable to replicate the scores despite being given far greater access to the underlying computer codes than is available to an individual teacher [emphasis added, as also related to a prior post about how SAS claimed that plaintiffs violated SAS’s protective order (protecting its trade secrets), that the court overruled, see here].

The EVAAS score might be erroneously calculated for any number of reasons, ranging from data-entry mistakes to glitches in the computer code itself. Algorithms are human creations, and subject to error like any other human endeavor. HISD has acknowledged that mistakes can occur in calculating a teacher’s EVAAS score; moreover, even when a mistake is found in a particular teacher’s score, it will not be promptly corrected. As HISD candidly explained in response to a frequently asked question, “Why can’t my value-added analysis be recalculated?”:

Once completed, any re-analysis can only occur at the system level. What this means is that if we change information for one teacher, we would have to re- run the analysis for the entire district, which has two effects: one, this would be very costly for the district, as the analysis itself would have to be paid for again; and two, this re-analysis has the potential to change all other teachers’ reports.

The remarkable thing about this passage is not simply that cost considerations trump accuracy in teacher evaluations, troubling as that might be. Of greater concern is the house-of-cards fragility of the EVAAS system, where the wrong score of a single teacher could alter the scores of every other teacher in the district. This interconnectivity means that the accuracy of one score hinges upon the accuracy of all. Thus, without access to data supporting all teacher scores, any teacher facing discharge for a low value-added score will necessarily be unable to verify that her own score is error-free.

HISD’s own discovery responses and witnesses concede that an HISD teacher is unable to verify or replicate his EVAAS score based on the limited information provided by HISD.

According to the unrebutted testimony of plaintiffs’ expert, without access to SAS’s proprietary information – the value-added equations, computer source codes, decision rules, and assumptions – EVAAS scores will remain a mysterious “black box,” impervious to challenge.

While conceding that a teacher’s EVAAS score cannot be independently verified, HISD argues that the Constitution does not require the ability to replicate EVAAS scores “down to the last decimal point.” But EVAAS scores are calculated to the second decimal place, so an error as small as one hundredth of a point could spell the difference between a positive or negative EVAAS effectiveness rating, with serious consequences for the affected teacher.

Hence, “When a public agency adopts a policy of making high stakes employment decisions based on secret algorithms incompatible with minimum due process, the proper remedy is to overturn the policy.”

How ‘Zero-Tolerance’ Policies Harm All Students

See:

Image result

The author, Derek Black told Jennifer Berkshire that “…some of the charter schools you’re referencing actually take it to one more level. They say ‘you don’t think we can? Just watch us. We’re going to have suspension and expulsion rates higher than anything you’ve ever seen before.’

“I think the difference between the charter system and the public system, which is really what my book is about, is that the public system doesn’t really get rid of its students; they come back. The charter school doesn’t have the responsibility of serving the community and all of its children, so that what it’s trying to do is sort of slash and burn.

“I suppose that one can slash and burn all of the low achievers and the troublemakers until there is no one left. It’s not that they’ve made the students who are left perform better, but that they’ve lopped off their low performers.”

%d bloggers like this: