Teacher Unions

I got this from Diane Ravitch’s blog.

Here in Michigan, the Democratic legislature just re-affirmed our state’s longstanding commitment to working families by removing anti-laborprovisions from state law. The move doesn’t apply to teachers and other public employees, because the conservative U.S. Supreme Court sideda few years back with Right-wing activists in their efforts to hinder contributions to public sector unions, but it’s still good news for the labor movement overall.

And I wanted to use their effort—alongside Republican efforts in other states to threaten teachers for what they say in classrooms—to make a simple point. 

We need teachers unions. Other folks more prominent than me, like AFT’s Randi Weingarten, have made this pointrecently too. But I wanted to add my own voice as someone who has not been a union member, and someone who—although I’ve appeared with Randion her podcast and count many union members as friends—has never been an employee or even a consultant. 

If you want to talk dollars, The Walton Family Foundation once supported my research on charter schools to the tune of more than $300,000. Arnold Ventures supported my fundraising for a research center at Michigan State–$1.9 million from them. And the US Department of Education awarded my team more than $2 million to study school choice—while Betsy DeVos was secretary.

Think about that when I say school vouchers are horrific. And understand, I’m getting no support from teachers’ unions. 

Instead it is I who supports them. 

I’ve been studying teacher labor markets almost as long as school vouchers. Mostly my research has looked at teacher recruitment and retention. But I’ve also written about teachers’unionsspecifically. There’s a debate among scholars on what unions do and whether their emphasis on spending translates into test score differences. In the “rent seeking” framework economists use, the concern is that dollars spent on salaries don’t have direct academic payoffs. 

There is no question that spending more money on public schools has sustained and generational impacts on kids. Research has “essentially settled” that debate, according to today’s leading expert on the topic. 

But I want to branch out from dollars and cents and test scores to talk about teacher voice. 

And I want to do that by raising a few questions that I’ve asked myself over the last couple years:

Why should the voice of a billionaire heiress from Michigan with no experience in public schools count for more than the voices of 100,000 teachers in my state’s classrooms every day?

Why should the simple fact that they work with children made by other people mean that teachers surrender their own autonomy and judgment not just as professionals but as human beings?

Why should educators have to work under what amounts to gag orders, afraid to broach certain topics or issues in the classroom? Some states are setting up hotlines to report on teachers as if they’re parolees, and a bill in New Hampshire would essentially give the fringe-Right Secretary of Education subpoena power to haul teachers in front of a special tribunal for teaching “divisive concepts.” This, after a Moms for Liberty chapter put out a bounty on New Hampshire teachers who were likewise divisive on an issue. Read: an issue of race or gender. 

It’s not just threats to teacher employment. We know this. There are threats to teachers’ lives. How many teachers have died alongside their students—other people’s children—over the years in school shootings?

Why does the Right claim to trust teachers enough to arm them with gunsin response to those shootings, but not enough to let them talk about race, gender, or any other “divisive concept?” Even some conservative commentatorshave worried publicly that we’re asking teachers to do too much. Why are we asking them to be an armed security force too?

‘In her recent history of “The Teacher Wars”, The New York Times’ Dana Goldstein noted that teachers formed unions, and fought for teacher tenure, to protect themselves not just professionally but personally. For free speech. To prevent harassment from supervisors—then as now, teachers were mostly professional women—and to keep from being fired for pregnancy or marital status. 

So really, attacks on teachers are nothing new. Instead, teachers seem to be one of the few professions that it’s still acceptable in political conversation—even a mark of supposed intellectual sophistication in some circles—to ponder the shortcomings of the educators who work with our kids every day. 

There’s nothing sophisticated about attacking hardworking, thoughtful, and dedicated people. And the only result of doing so will be the further erosion of our public, community schools. And that’s really the point. Just a few days ago, we learned that the big data that I and many others have gotten used to working with finally caught up to the on-the-frontlines warnings of educators everywhere: teachers are exiting the profession at unprecedented rates. 

I’ve taken no money from teachers’ unions for any of the work I do. I’ve never been a member of a union—teachers’ or otherwise. Until now. Because after writing this today, I made a donation to my state’s primary teachers’ union and became a general member: a person “interested in advancing the cause of education…not eligible for other categories of membership.”

There’s a word for that in the labor movement. You hear it a lot here in Michigan, where I grew up and now teach future teachers in a college of education. That word is Solidarity. 

Sign me up.

Democrats Need to Get a Clue About Education!

Peter Greene at Curmudgucation gets it right again, even more when we realize that big business has always been lying about not having enough skilled workers. (see)

Democrats Need A New Theory Of Action Posted: 28 Dec 2020 07:24 AM PST For four years, Democrats have had a fairly simple theory of action when it came to education. Something along the lines of “Good lord, a crazy lady just came into our china shop riding a bull, waving around a flamethrower, and dragging a shark with a head-mounted laser beam; we have to stop her from destroying the place (while pretending that we have a bull and a shark in the back just like hers).”  Now, of course, that will, thank heavens, no longer fit the circumstances. The Democrats will need a new plan. Trouble is, the old plan, the one spanning both the Clinton and Obama years, is not a winner. It went, roughly, like this: The way to fix poverty, racism, injustice, inequity and economic strife is to get a bunch of children to make higher scores on a single narrow standardized test; the best shot at getting this done is to give education amateurs the opportunity to make money doing it. This was never, ever a good plan. Ever. Let me count the ways. For one thing, education’s ability to fix social injustice is limited. Having a better education will not raise the minimum wage. It will not eradicate poverty. And as we’ve just spent four years having hammered into us, it will not even be sure to make people better thinkers or cleanse them of racism. It will help some people escape the tar pit, but it will not cleanse the pit itself. And that, of course, is simply talking about education, and that’s not what the Dems theory was about anyway–it was about a mediocre computer-scorable once-a-year test of math and reading. And that was never going to fix a thing. Nobody was going to get a better job because she got a high score on the PARCC. Nobody was ever going to achieve a happier, healthier life just because they’d raised their Big Standardized Test scores by fifty points. Any such score bump was always going to be the result of test prep and test-taker training, and that sort of preparation was always going to come at the expense of real education. Now, a couple of decades on, all the evidence says that test-centric education didn’t improve society, schools, or the lives of the young humans who passed through the system. Democrats must also wrestle with the fact that many of the ideas attached to this theory of action were always conservative ideas, always ideas that didn’t belong to traditional Democratic Party stuff at all.  Jack Schneider and Jennifer Berkshire talk about a “treaty” between Dems and the GOP, and that’s a way to look at how the ed reform movement brought people into each side who weren’t natural fits. The conservative market reform side teamed up with folks who believed choice was a matter of social justice, and that truce held until about four years ago, actually before Trump was elected. Meanwhile, in Schneider and Berkshire’s telling, Democrats gave up supporting teachers (or at least their unions) while embracing the Thought Leadership of groups like Democrats for Education Reform, a group launched by hedge fund guys who adopted “Democrat” because it seemed like a good way to get the support they needed. Plus (and this seems like it was a thousand years ago) embracing “heroes” like Michelle Rhee, nominally listed as a Democrat, but certainly not acting like one.  All of this made a perfect soup for feeding neo-liberals. It had the additional effect of seriously muddying the water about what, exactly, Democrats stand for when it comes to public education. The laundry list of ideas now has two problems. One is that they have all been given a long, hard trial, and they’ve failed. The other, which is perhaps worse from a political gamesmanship standpoint, is that they have Trump/DeVos stink all over them.  But while Dems and the GOP share the problems with the first half of that statement, it’s the Democrats who have to own the second part. The amateur part. I often complain that the roots of almost all our education woes for the modern reform period come from the empowerment of clueless amateurs, and while it may appear at first glance that both parties are responsible, on closer examination, I’m not so sure. The GOP position hasn’t been that we need more amateurs and fewer professionals–their stance is that education is being run by the wrong profession. Eli Broad has built his whole edu-brand on the assertion that education doesn’t have education problems, it has business management problems, and that they will best be solved by management professionals. In some regions, education has been reinterpreted by conservatives as a real estate problem, best solved by real estate professionals. The conservative model calls for education to be properly understood as a business, and as such, run not by elected bozos on a board or by a bunch of teachers, but by visionary CEOs with the power to hire and fire and set the rules and not be tied down by regulations and unions.  Democrats of the neo-liberal persuasion kind of agree with that last part. And they have taken it a step further by embracing the notion that all it takes to run a school is a vision, with no professional expertise of any sort at all. I blame Democrats for the whole business of putting un-trained Best and Brightest Ivy Leaguers in classrooms, and the letting them turn around and use their brief classroom visit to establish themselves as “experts” capable of running entire district or even state systems. It takes Democrats to decide that a clueless amateur like David Coleman should be given a chance to impose his vision on the entire nation (and it takes right-tilted folks to see that this is a perfect chance to cash in big time).  Am I over-simplifying? Sure. But you get the idea. Democrats turned their backs on public education and the teaching profession. They decided that virtually every ill in society is caused by teachers with low expectations and lousy standards, and then they jumped on the bandwagon that insisted that somehow all of that could be fixed by making students take a Big Standardized Test and generating a pile of data that could be massaged for any and all purposes (never forget–No Child Left Behind was hailed as a great bi-partisan achievement). I would be far more excited about Biden if at any point in the campaign he had said something along the lines of, “Boy, did we get education policy wrong.” And I suppose that’s a lot to ask. But if Democrats are going to launch a new day in education, they have a lot to turn their backs on, along with a pressing need for a new theory of action. They need to reject the concept of an entire system built on the flawed foundation of a single standardized test. Operating with flawed data is, in fact, worse than no data at all, and for decades ed policy has been driven by folks looking for their car keys under a lamppost hundreds of feet away from where the keys were dropped because “the light’s better over here.” They need to embrace the notion that teachers are, in fact, the pre-eminent experts in the field of education. They need to accept that while education can be a powerful engine for pulling against the forces of inequity and injustice, but those forces also shape the environment within which schools must work.  They need to stop listening to amateurs. Success in other fields does not qualify someone to set education policy. Cruising through a classroom for two years does not make someone an education expert. Everyone who ever went to the doctor is not a medical expert, everyone who ever had their car worked on is not a mechanic, and everyone who ever went to school is not an education expert. Doesn’t mean they can’t add something to the conversation, but they shouldn’t be leading it. They need to grasp that schools are not businesses. And not only are schools not businesses, but their primary function is not to supply businesses with useful worker bees. If they want to run multiple parallel education systems with charters and vouchers and all the rest, they need to face up to properly funding it. If they won’t do that, then they need to shut up about choicey policies. “We can run three or four school systems for the cost of one” was always a lie, and it’s time to stop pretending otherwise. Otherwise school choice is just one more unfunded mandate. They need to accept that privatized school systems have not come up with anything new, revolutionary, or previously undiscovered about education. But they have come up with some clever new ways to waste and make off with taxpayer money. Listen to teachers. Listen to parents in the community served by the school. Commit to a search for long term solutions instead of quick fixy silver bullets. And maybe become a force for public education slightly more useful than simply fending off a crazy lady with a flamethrower.

Part Two: Cheating in DCPS

DC Education Reform Ten Years After, 

Part 2: Test Cheats

Richard P Phelps

Ten years ago, I worked as the Director of Assessments for the District of Columbia Public Schools (DCPS). For temporal context, I arrived after the first of the infamous test cheating scandals and left just before the incident that spawned a second. Indeed, I filled a new position created to both manage test security and design an expanded testing program. I departed shortly after Vincent Gray, who opposed an expanded testing program, defeated Adrian Fenty in the September 2010 DC mayoral primary. My tenure coincided with Michelle Rhee’s last nine months as Chancellor. 

The recurring test cheating scandals of the Rhee-Henderson years may seem extraordinary but, in fairness, DCPS was more likely than the average US school district to be caught because it received a much higher degree of scrutiny. Given how tests are typically administered in this country, the incidence of cheating is likely far greater than news accounts suggest, for several reasons: 

·      in most cases, those who administer tests—schoolteachers and administrators—have an interest in their results;

·      test security protocols are numerous and complicated yet, nonetheless, the responsibility of non-expert ordinary school personnel, guaranteeing their inconsistent application across schools and over time; 

·      after-the-fact statistical analyses are not legal proof—the odds of a certain amount of wrong-to-right erasures in a single classroom on a paper-and-pencil test being coincidental may be a thousand to one, but one-in-a-thousand is still legally plausible; and

·      after-the-fact investigations based on interviews are time-consuming, scattershot, and uneven. 

Still, there were measures that the Rhee-Henderson administrations could have adopted to substantially reduce the incidence of cheating, but they chose none that might have been effective. Rather, they dug in their heels, insisted that only a few schools had issues, which they thoroughly resolved, and repeatedly denied any systematic problem.  

Cheating scandals

From 2007 to 2009 rumors percolated of an extraordinary level of wrong-to-right erasures on the test answer sheets at many DCPS schools. “Erasure analysis” is one among several “red flag” indicators that testing contractors calculate to monitor cheating. The testing companies take no responsibility for investigating suspected test cheating, however; that is the customer’s, the local or state education agency. 

In her autobiographical account of her time as DCPS Chancellor, Michelle Johnson (nee Rhee), wrote (p. 197)

“For the first time in the history of DCPS, we brought in an outside expert to examine and audit our system. Caveon Test Security – the leading expert in the field at the time – assessed our tests, results, and security measures. Their investigators interviewed teachers, principals, and administrators.

“Caveon found no evidence of systematic cheating. None.”

Caveon, however, had not looked for “systematic” cheating. All they did was interview a few people at several schools where the statistical anomalies were more extraordinary than at others. As none of those individuals would admit to knowingly cheating, Caveon branded all their excuses as “plausible” explanations. That’s it; that is all that Caveon did. But, Caveon’s statement that they found no evidence of “widespread” cheating—despite not having looked for it—would be frequently invoked by DCPS leaders over the next several years.[1]

Incidentally, prior to the revelation of its infamous decades-long, systematic test cheating, the Atlanta Public Schools had similarly retained Caveon Test Security and was, likewise, granted a clean bill of health. Only later did the Georgia state attorney general swoop in and reveal the truth. 

In its defense, Caveon would note that several cheating prevention measures it had recommended to DCPS were never adopted.[2] None of the cheating prevention measures that I recommended were adopted, either.

The single most effective means for reducing in-classroom cheating would have been to rotate teachers on test days so that no teacher administered a test to his or her own students. It would not have been that difficult to randomly assign teachers to different classrooms on test days.

The single most effective means for reducing school administratorcheating would have been to rotate test administrators on test days so that none managed the test materials for their own schools. The visiting test administrators would have been responsible for keeping test materials away from the school until test day, distributing sealed test booklets to the rotated teachers on test day, and for collecting re-sealed test booklets at the end of testing and immediately removing them from the school. 

Instead of implementing these, or a number of other feasible and effective test security measures, DCPS leaders increased the number of test proctors, assigning each of a few dozen or so central office staff a school to monitor. Those proctors could not reasonably manage the volume of oversight required. A single DC test administration could encompass a hundred schools and a thousand classrooms.

Investigations

So, what effort, if any, did DCPS make to counter test cheating? They hired me, but then rejected all my suggestions for increasing security. Also, they established a telephone tip line. Anyone who suspected cheating could report it, even anonymously, and, allegedly, their tip would be investigated. 

Some forms of cheating are best investigated through interviews. Probably the most frequent forms of cheating at DCPS—teachers helping students during test administrations and school administrators looking at test forms prior to administration—leave no statistical residue. Eyewitness testimony is the only type of legal evidence available in such cases, but it is not just inconsistent, it may be socially destructive. 

I remember two investigations best: one occurred in a relatively well-to-do neighborhood with well-educated parents active in school affairs; the other in one of the city’s poorest neighborhoods. Superficially, the cases were similar—an individual teacher was accused of helping his or her own students with answers during test administrations. Making a case against either elementary school teacher required sworn testimony from eyewitnesses, that is, students—eight-to-ten-year olds. 

My investigations, then, consisted of calling children into the principal’s office one-by-one to be questioned about their teacher’s behavior. We couldn’t hide the reason we were asking the questions. And, even though each student agreed not to tell others what had occurred in their visit to the principal’s office, we knew we had only one shot at an uncorrupted jury pool. 

Though the accusations against the two teachers were similar and the cases against them equally strong, the outcomes could not have been more different. In the high-poverty neighborhood, the students seemed suspicious and said little; none would implicate the teacher, whom they all seemed to like. 

In the more prosperous neighborhood, students were more outgoing, freely divulging what they had witnessed. The students had discussed the alleged coaching with their parents who, in turn, urged them to tell investigators what they knew. During his turn in the principal’s office, the accused teacher denied any wrongdoing. I wrote up each interview, then requested that each student read and sign. 

Thankfully, that accused teacher made a deal and left the school system a few weeks later. Had he not, we would have required the presence in court of the eight-to-ten-year olds to testify under oath against their former teacher, who taught multi-grade classes. Had that prosecution not succeeded, the eyewitness students could have been routinely assigned to his classroom the following school year.

My conclusion? Only in certain schools is the successful prosecution of a cheating teacher through eyewitness testimony even possible. But, even where possible, it consumes inordinate amounts of time and, otherwise, comes at a high price, turning young innocents against authority figures they naturally trusted. 

Cheating blueprints

Arguably the most widespread and persistent testing malfeasance in DCPS received little attention from the press. Moreover, it was directly propagated by District leaders, who published test blueprints on the web. Put simply, test “blueprints” are lists of the curricular standards (e.g., “student shall correctly add two-digit numbers”) and the number of test items included in an upcoming test related to each standard. DC had been advance publishing its blueprints for years.

I argued that the way DC did it was unethical. The head of the Division of Data & Accountability, Erin McGoldrick, however, defended the practice, claimed it was common, and cited its existence in the state of California as precedent. The next time she and I met for a conference call with one of DCPS’s test providers, Discover Education, I asked their sales agent how many of their hundreds of other customers advance-published blueprints. His answer: none.

In the state of California, the location of McGoldrick’s only prior professional experience, blueprints were, indeed, published in advance of test administrations. But their tests were longer than DC’s and all standards were tested. Publication of California’s blueprints served more to remind the populace what the standards were in advance of each test administration. Occasionally, a standard considered to be of unusual importance might be assigned a greater number of test items than the average, and the California blueprints signaled that emphasis. 

In Washington, DC, the tests used in judging teacher performance were shorter, covering only some of each year’s standards. So, DC’s blueprints showed everyone well in advance of the test dates exactly which standards would be tested and which would not. For each teacher, this posed an ethical dilemma: should they “narrow the curriculum” by teaching only that content they knew would be tested? Or, should they do the right thing and teach all the standards, as they were legally and ethically bound to, even though it meant spending less time on the to-be-tested content? It’s quite a conundrum when one risks punishment for behaving ethically.

Monthly meetings convened to discuss issues with the districtwide testing program, the DC Comprehensive Assessment System (DC-CAS)—administered to comply with the federal No Child Left Behind (NCLB) Act. All public schools, both DCPS and charters, administered those tests. At one of these regular meetings, two representatives from the Office of the State Superintendent of Education (OSSE) announced plans to repair the broken blueprint process.[3]

The State Office employees argued thoughtfully and reasonably that it was professionally unethical to advance publish DC test blueprints. Moreover, they had surveyed other US jurisdictions in an effort to find others that followed DC’s practice and found none. I was the highest-ranking DCPS employee at the meeting and I expressed my support, congratulating them for doing the right thing. I assumed that their decision was final.

I mentioned the decision to McGoldrick, who expressed surprise and speculation that it might have not been made at the highest level in the organizational hierarchy. Wasting no time, she met with other DCPS senior managers and the proposed change was forthwith shelved. In that, and other ways, the DCPS tail wagged the OSSE dog. 

* * *

It may be too easy to finger ethical deficits for the recalcitrant attitude toward test security of the Rhee-Henderson era ed reformers. The columnist Peter Greene insists that knowledge deficits among self-appointed education reformers also matter: 

“… the reformistan bubble … has been built from Day One without any actual educators inside it. Instead, the bubble is populated by rich people, people who want rich people’s money, people who think they have great ideas about education, and even people who sincerely want to make education better. The bubble does not include people who can turn to an Arne Duncan or a Betsy DeVos or a Bill Gates and say, ‘Based on my years of experience in a classroom, I’d have to say that idea is ridiculous bullshit.’”

“There are a tiny handful of people within the bubble who will occasionally act as bullshit detectors, but they are not enough. The ed reform movement has gathered power and money and set up a parallel education system even as it has managed to capture leadership roles within public education, but the ed reform movement still lacks what it has always lacked–actual teachers and experienced educators who know what the hell they’re talking about.”

In my twenties, I worked for several years in the research department of a state education agency. My primary political lesson from that experience, consistently reinforced subsequently, is that most education bureaucrats tell the public that the system they manage works just fine, no matter what the reality. They can get away with this because they control most of the evidence and can suppress it or spin it to their advantage.

In this proclivity, the DCPS central office leaders of the Rhee-Henderson era proved themselves to be no different than the traditional public-school educators they so casually demonized. 

US school systems are structured to be opaque and, it seems, both educators and testing contractors like it that way. For their part, and contrary to their rhetoric, Rhee, Henderson, and McGoldrick passed on many opportunities to make their system more transparent and accountable.

Education policy will not improve until control of the evidence is ceded to genuinely independent third parties, hired neither by the public education establishment nor by the education reform club.

The author gratefully acknowledges the fact-checking assistance of Erich Martel and Mary Levy.

Access this testimonial in .pdf format

Citation:  Phelps, R. P. (2020, September). Looking Back on DC Education Reform 10 Years After, Part 2: Test Cheats. Nonpartisan Education Review / Testimonials. https://nonpartisaneducation.org/Review/Testimonials/v16n3.htm

---

[1] A perusal of Caveon’s website clarifies that their mission is to help their clients–state and local education departments–not get caught. Sometimes this means not cheating in the first place; other times it might mean something else. One might argue that, ironically, Caveon could be helping its clients to cheat in more sophisticated ways and cover their tracks better.

[2] Among them: test booklets should be sealed until the students open them and resealed by the students immediately after; and students should be assigned seats on test day and a seating chart submitted to test coordinators (necessary for verifying cluster patterns in student responses that would suggest answer copying).

[3] Yes, for those new to the area, the District of Columbia has an Office of the “State” Superintendent of Education (OSSE). Its domain of relationships includes not just the regular public schools (i.e., DCPS), but also other public schools (i.e., charters) and private schools. Practically, it primarily serves as a conduit for funneling money from a menagerie of federal education-related grant and aid programs

What did Education Reform in DC Actually Mean?

Short answer: nothing that would actually help students or teachers. But it’s made for well-padded resumes for a handful of insiders.

This is an important review, by the then-director of assessment. His criticisms echo the points that I have been making along with Mary Levy, Erich Martel, Adell Cothorne, and many others.

Nonpartisan Education Review / Testimonials

Access this testimonial in .pdf format

Looking Back on DC Education Reform 10 Years After, 

Part 1: The Grand Tour

Richard P Phelps

Ten years ago, I worked as the Director of Assessments for the District of Columbia Public Schools (DCPS). My tenure coincided with Michelle Rhee’s last nine months as Chancellor. I departed shortly after Vincent Gray defeated Adrian Fenty in the September 2010 DC mayoral primary. 

My primary task was to design an expansion of that testing program that served the IMPACT teacher evaluation system to include all core subjects and all grade levels. Despite its fame (or infamy), the test score aspect of the IMPACT program affected only 13% of teachers, those teaching either reading or math in grades four through eight. Only those subjects and grade levels included the requisite pre- and post-tests required for teacher “value added” measurements (VAM). Not included were most subjects (e.g., science, social studies, art, music, physical education), grades kindergarten to two, and high school.

Chancellor Rhee wanted many more teachers included. So, I designed a system that would cover more than half the DCPS teacher force, from kindergarten through high school. You haven’t heard about it because it never happened. The newly elected Vincent Gray had promised during his mayoral campaign to reduce the amount of testing; the proposed expansion would have increased it fourfold.

VAM affected teachers’ jobs. A low value-added score could lead to termination; a high score, to promotion and a cash bonus. VAM as it was then structured was obviously, glaringly flawed,[1] as anyone with a strong background in educational testing could have seen. Unfortunately, among the many new central office hires from the elite of ed reform circles, none had such a background.

Before posting a request for proposals from commercial test developers for the testing expansion plan, I was instructed to survey two groups of stakeholders—central office managers and school-level teachers and administrators.

Not surprisingly, some of the central office managers consulted requested additions or changes to the proposed testing program where they thought it would benefit their domain of responsibility. The net effect on school-level personnel would have been to add to their administrative burden. Nonetheless, all requests from central office managers would be honored. 

The Grand Tour

At about the same time, over several weeks of the late Spring and early Summer of 2010, along with a bright summer intern, I visited a dozen DCPS schools. The alleged purpose was to collect feedback on the design of the expanded testing program. I enjoyed these meetings. They were informative, animated, and very well attended. School staff appreciated the apparent opportunity to contribute to policy decisions and tried to make the most of it.

Each school greeted us with a full complement of faculty and staff on their days off, numbering a several dozen educators at some venues. They believed what we had told them: that we were in the process of redesigning the DCPS assessment program and were genuinely interested in their suggestions for how best to do it. 

At no venue did we encounter stand-pat knee-jerk rejection of education reform efforts. Some educators were avowed advocates for the Rhee administration’s reform policies, but most were basically dedicated educators determined to do what was best for their community within the current context. 

The Grand Tour was insightful, too. I learned for the first time of certain aspects of DCPS’s assessment system that were essential to consider in its proper design, aspects of which the higher-ups in the DCPS Central Office either were not aware or did not consider relevant. 

The group of visited schools represented DCPS as a whole in appropriate proportions geographically, ethnically, and by education level (i.e., primary, middle, and high). Within those parameters, however, only schools with “friendly” administrations were chosen. That is, we only visited schools with principals and staff openly supportive of the Rhee-Henderson agenda. 

But even they desired changes to the testing program, whether or not it was expanded. Their suggestions covered both the annual districtwide DC-CAS (or “comprehensive” assessment system), on which the teacher evaluation system was based, and the DC-BAS (or “benchmarking” assessment system), a series of four annual “no-stakes” interim tests unique to DCPS, ostensibly offered to help prepare students and teachers for the consequential-for-some-school-staff DC-CAS.[2]

At each staff meeting I asked for a show of hands on several issues of interest that I thought were actionable. Some suggestions for program changes received close to unanimous support. Allow me to describe several.

1. Move DC-CAS test administration later in the school year. Many citizens may have logically assumed that the IMPACT teacher evaluation numbers were calculated from a standard pre-post test schedule, testing a teacher’s students at the beginning of their academic year together and then again at the end. In 2010, however, the DC-CAS was administered in March, three months before school year end. Moreover, that single administration of the test served as both pre- and post-test, posttest for the current school year and pretest for the following school year. Thus, before a teacher even met their new students in late August or early September, almost half of the year for which teachers were judged had already transpired—the three months in the Spring spent with the previous year’s teacher and almost three months of summer vacation. 

School staff recommended pushing DC-CAS administration to later in the school year. Furthermore, they advocated a genuine pre-post-test administration schedule—pre-test the students in late August–early September and post-test them in late-May–early June—to cover a teacher’s actual span of time with the students.

This suggestion was rejected because the test development firm with the DC-CAS contract required three months to score some portions of the test in time for the IMPACT teacher ratings scheduled for early July delivery, before the start of the new school year. Some small number of teachers would be terminated based on their IMPACT scores, so management demanded those scores be available before preparations for the new school year began.[3] The tail wagged the dog.

2. Add some stakes to the DC-CAS in the upper grades. Because DC-CAS test scores portended consequences for teachers but none for students, some students expended little effort on the test. Indeed, extensive research on “no-stakes” (for students) tests reveal that motivation and effort vary by a range of factors including gender, ethnicity, socioeconomic class, the weather, and age. Generally, the older the student, the lower the test-taking effort. This disadvantaged some teachers in the IMPACT ratings for circumstances beyond their control: unlucky student demographics. 

Central office management rejected this suggestion to add even modest stakes to the upper grades’ DC-CAS; no reason given. 

3. Move one of the DC-BAS tests to year end. If management rejected the suggestion to move DC-CAS test administration to the end of the school year, school staff suggested scheduling one of the no-stakes DC-BAS benchmarking tests for late May–early June. As it was, the schedule squeezed all four benchmarking test administrations between early September and mid-February. Moving just one of them to the end of the year would give the following year’s teachers a more recent reading (by more than three months) of their new students’ academic levels and needs.

Central Office management rejected this suggestion probably because the real purpose of the DC-BAS was not to help teachers understand their students’ academic levels and needs, as the following will explain.

4. Change DC-BAS tests so they cover recently taught content. Many DC citizens probably assumed that, like most tests, the DC-BAS interim tests covered recently taught content, such as that covered since the previous test administration. Not so in 2010. The first annual DC-BAS was administered in early September, just after the year’s courses commenced. Moreover, it covered the same content domain—that for the entirety of the school year—as each of the next three DC-BAS tests. 

School staff proposed changing the full-year “comprehensive” content coverage of each DC-BAS test to partial-year “cumulative” coverage, so students would only be tested on what they had been taught prior to each test administration.

This suggestion, too, was rejected. Testing the same full-year comprehensive content domain produced a predictable, flattering score rise. With each DC-BAS test administration, students recognized more of the content, because they had just been exposed to more of it, so average scores predictably rose. With test scores always rising, it looked like student achievement improved steadily each year. Achieving this contrived score increase required testing students on some material to which they had not yet been exposed, both a violation of professional testing standards and a poor method for instilling student confidence. (Of course, it was also less expensive to administer essentially the same test four times a year than to develop four genuinely different tests.)

5. Synchronize the sequencing of curricular content across the District. DCPS management rhetoric circa 2010 attributed classroom-level benefits to the testing program. Teachers would know more about their students’ levels and needs and could also learn from each other. Yet, the only student test results teachers received at the beginning of each school year was half-a-year old, and most of the information they received over the course of four DC-BAS test administrations was based on not-yet-taught content.

As for cross-district teacher cooperation, unfortunately there was no cross-District coordination of common curricular sequences. Each teacher paced their subject matter however they wished and varied topical emphases according to their own personal preference.

It took DCPS’s Chief Academic Officer, Carey Wright, and her chief of staff, Dan Gordon, less than a minute to reject the suggestion to standardize topical sequencing across schools so that teachers could consult with one another in real time. Tallying up the votes: several hundred school-level District educators favored the proposal, two of Rhee’s trusted lieutenants opposed it. It lost.

6. Offer and require a keyboarding course in the early grades. DCPS was planning to convert all its testing from paper-and-pencil mode to computer delivery within a few years. Yet, keyboarding courses were rare in the early grades. Obviously, without systemwide keyboarding training in computer use some students would be at a disadvantage in computer testing.

Suggestion rejected.

In all, I had polled over 500 DCPS school staff. Not only were all of their suggestions reasonable, some were essential in order to comply with professional assessment standards and ethics. 

Nonetheless, back at DCPS’ Central Office, each suggestion was rejected without, to my observation, any serious consideration. The rejecters included Chancellor Rhee, the head of the office of Data and Accountability—the self-titled “Data Lady,” Erin McGoldrick—and the head of the curriculum and instruction division, Carey Wright, and her chief deputy, Dan Gordon. 

Four central office staff outvoted several-hundred school staff (and my recommendations as assessment director). In each case, the changes recommended would have meant some additional work on their parts, but in return for substantial improvements in the testing program. Their rhetoric was all about helping teachers and students; but the facts were that the testing program wasn’t structured to help them.

What was the purpose of my several weeks of school visits and staff polling? To solicit “buy in” from school level staff, not feedback.

Ultimately, the new testing program proposal would incorporate all the new features requested by senior Central Office staff, no matter how burdensome, and not a single feature requested by several hundred supportive school-level staff, no matter how helpful. Like many others, I had hoped that the education reform intention of the Rhee-Henderson years was genuine. DCPS could certainly have benefitted from some genuine reform. 

Alas, much of the activity labelled “reform” was just for show, and for padding resumes. Numerous central office managers would later work for the Bill and Melinda Gates Foundation. Numerous others would work for entities supported by the Gates or aligned foundations, or in jurisdictions such as Louisiana, where ed reformers held political power. Most would be well paid. 

Their genuine accomplishments, or lack thereof, while at DCPS seemed to matter little. What mattered was the appearance of accomplishment and, above all, loyalty to the group. That loyalty required going along to get along: complicity in maintaining the façade of success while withholding any public criticism of or disagreement with other in-group members.

Unfortunately, in the United States what is commonly showcased as education reform is neither a civic enterprise nor a popular movement. Neither parents, the public, nor school-level educators have any direct influence. Rather, at the national level, US education reform is an elite, private club—a small group of tightly-connected politicos and academics—a mutual admiration society dedicated to the career advancement, political influence, and financial benefit of its members, supported by a gaggle of wealthy foundations (e.g., Gates, Walton, Broad, Wallace, Hewlett, Smith-Richardson). 

For over a decade, The Ed Reform Club exploited DC for its own benefit. Local elite formed the DC Public Education Fund (DCPEF) to sponsor education projects, such as IMPACT, which they deemed worthy. In the negotiations between the Washington Teachers’ Union and DCPS concluded in 2010, DCPEF arranged a 3 year grant of $64.5M from the Arnold, Broad, Robertson and Walton Foundations to fund a 5-year retroactive teacher pay raise in return for contract language allowing teacher excessing tied to IMPACT, which Rhee promised would lead to annual student test score increases by 2012. Projected goals were not met; foundation support continued nonetheless.

Michelle Johnson (nee Rhee) now chairs the board of a charter school chain in California and occasionally collects $30,000+ in speaker fees but, otherwise, seems to have deliberately withdrawn from the limelight. Despite contributing her own additional scandalsafter she assumed the DCPS Chancellorship, Kaya Henderson ascended to great fame and glory with a “distinguished professorship” at Georgetown; honorary degrees from Georgetown and Catholic Universities; gigs with the Chan Zuckerberg Initiative, Broad Leadership Academy, and Teach for All; and board memberships with The Aspen Institute, The College Board, Robin Hood NYC, and Teach For America. Carey Wright is now state superintendent in Mississippi. Dan Gordon runs a 30-person consulting firm, Education Counsel that strategically partners with major players in US education policy. The manager of the IMPACT teacher evaluation program, Jason Kamras, now works as Superintendent of the Richmond, VA public schools. 

Arguably the person most directly responsible for the recurring assessment system fiascos of the Rhee-Henderson years, then Chief of Data and Accountability Erin McGoldrick, now specializes in “data innovation” as partner and chief operating officer at an education management consulting firm. Her firm, Kitamba, strategically partners with its own panoply of major players in US education policy. Its list of recent clients includes the DC Public Charter School Board and DCPS.

If the ambitious DC central office folk who gaudily declared themselves leading education reformers were not really, who were the genuine education reformers during the Rhee-Henderson decade of massive upheaval and per-student expenditures three times those in the state of Utah? They were the school principals and staff whose practical suggestions were ignored by central office glitterati. They were whistleblowers like history teacher Erich Martel who had documented DCPS’ student records’ manipulation and phony graduation rates years before the Washington Post’s celebrated investigation of Ballou High School, and was demoted and then “excessed” by Henderson. Or, school principal Adell Cothorne, who spilled the beans on test answer sheet “erasure parties” at Noyes Education Campus and lost her job under Rhee. 

Real reformers with “skin in the game” can’t play it safe.

The author appreciates the helpful comments of Mary Levy and Erich Martel in researching this article. 

Access this testimonial in .pdf format

How to decide if anybody should listen to your ideas on how and whether to re-open schools, or maybe you should just hush.

Peter Greene has provided a nice flow chart to let you decide whether you should open your mouth with your ideas on how and whether to re-open the public schools, or whether you should just be quiet and listen.

So, should you just hush, or do you have something valuable to contribute to this subject?

My wife and I each taught for 30 years or so, and so we would be in the ‘speak right up’ category, but I don’t really know how the USA can get public education to work next year, especially since the danger is not going away, but apparently once more growing at an exponential clip.

Nobody should be listening to billionaires or their bought-and-paid-for policy wonks who once spent a whole two years in a classroom.

A few quotes from Greene’s column. (He is a much better writer than me, and much more original as well.)

==================================

To everyone who was never a classroom teacher but who has some ideas about how school should be reopened in the fall:

Hush.

Just hush.

There are some special categories of life experiences. Divorce. Parenthood. Deafness. Living as a Black person in the US. Classroom teacher. They are very different experiences, but they all have on thing in common.

You can read about these things. But if you haven’t lived it, you don’t know. You can study up, read up, talk to people. And in some rare cases that brings you close enough to knowing that your insights might actually be useful.

But mostly, you are a Dunning-Krueger case study just waiting to be written up.

The last thirty-seven-ish years of education have been marked by one major feature– a whole lot of people who just don’t know, throwing their weight around and trying to set the conditions under which the people who actually do the work will have to try to actually do the work. Policy wonks, privateers, Teach for America pass-throughs, guys who wanted to run for President, folks walking by on the street who happen to be filthy rich, amateurs who believe their ignorance is a qualification– everyone has stuck their oar in to try to reshape US education. And in ordinary times, as much as I argue against these folks, I would not wave my magic wand to silence them, because 1) educators are just as susceptible as anyone to becoming too insular and entrenched and convinced of their own eternal rightness and 2) it is a teacher’s job to serve all those amateurs, so it behooves the education world to listen, even if what they hear is 98% bosh.

But that’s in ordinary times, and these are not ordinary times.

There’s a whole lot of discussion about the issues involved in starting up school this fall. The discussion is made difficult by the fact that all options stink. It is further complicated by the loud voices of people who literally do not know what they are talking about.

How Dutch Schools are Re-Opening

Schools in The Netherlands are opening back up with no social distancing for the littlest students. A Dutch writer describes the details at Larry Cuban’s site. She says one ingredient for success with younger kids was bubbles.

I hope it all works.

https://larrycuban.wordpress.com/2020/05/30/how-dutch-schools-reopened-with-no-pupil-distancing-linda-van-druijten/

Trends on NAEP for 8th grade math, black students in DC, DCPS, DC charters, and nation

Yet another graph, this one showing how this year’s group of African-American 8th grade students did on the NAEP math tests in the regular DC public schools, in all DC publicly-funded schools, in the DC charter schools, in large cities across the nation, and in all US public school systems, going back to the early 1990s.

As usual, I had to do a bit of algebra to calculate what the average charter school scores were in the post-Rhee era, since those are not explicitly given anywhere. I give the explanation in my previous two posts.

My previous results seem to disagree a bit with those produced by NCES (by a couple of points). Therefore I used their data instead of what I calculated; the graph above is new as of 1/6/2014.

I still make these conclusions:

(1) Since the establishment of mayoral control of the schools, as a whole, the overall average for DC students in publicly-supported schools is following just about the exact same trends that were established from 2000 through 2007.  As a result, math scores for DC’s African-American 8th graders are now equal to those in large cities across the nation, which is a positive development.

(2) The DC charter schools seemed to have siphoned off the more motivated black 8th grade students and their families; as a result, scores for students in the regular DC public schools at that level in math lag significantly behind those of their counterparts in the charter schools, whose scores now surpass those of black 8th graders n the nation’s public schools as a whole and also those in large urban school systems as well.

As usual, if anybody finds any errors in my work, please let me know by leaving a comment.

Trends in DC on the NAEP for 4th grade reading, black students only: regular DCPS, charter schools, and pre- and post-Rhee

Here is a graph showing how African-American 4th students have been doing over time in Washington DC public schools and charter schools. I have drawn a clear dividing line at year 2008, because the scores before that were under the influence of DC’s former school board and superintendents. After that time, DC has been under a chancellor answerable only to the mayor.

You may notice that the blue, black and purple lines separate after 2007. That’s because NAEP began reporting separate scores for DC’s regular public schools and for all publicly-supported schools, though not for the charter schools as a bloc. As a result, you have to do a little bit of linear algebra to calculate what the average scales were for the charter schools from 2009 onwards. (I used essentially the same equation that I did in the previous post. Please write me a note if you think I made an error.)

As usual, we can see that since the late 1990s and up until Rhee took over, the overall trend in all large cities, in the nation’s public schools, and in DC’s publicly-supported schools was upwards on this test. (Yes, I know, these are not scores that follow the same kids year after year, but for whatever reason, the group of kids answering these tests are in general getting more answers right every two years.) Before that, i.e. from 1992 to 1998, scores bounced around or went down.

After Rhee took over, those scores seem to have entered another bouncy period. In fact, in DCPS, the scores on this test in 2013 were only back up to the level of 2007. There is a clear demarcation between the scores in the charter schools (blue line) and the regular public schools. The line for the charter schools seems to follow the trend from 1998 to 2007.

If I knew nothing about the politics of EduDeform, I would wonder why the WaPo editorial board is claiming victory.

 

 

Fact-free Praises for “Rhee-form” in DC from a Dick

Richard Whitmire is at it again, claiming huge success for the eduDEformers without the slightest evidence.

I’ll explain.

I think I have showed pretty clearly in my last several posts that the current trends (that is, slow but fairly steady progress as measured by the NAEP) in DCPS have been going on for the past decade or so: There has been no perceptible change in trends post-Rhee as opposed to pre-Rhee that we can see in any of the officially-produced data from the NCES on the NAEP and the TUDA. (Write something like NAEP TUDA DC in the little ‘search’ box on this page, perhaps to the right, and you’ll see a lot of my recent posts that have graphs and so on; you can see for yourself. )

From 2002 through the taking of the 2007 NAEP, DCPS used to have superintendents, an elected school board, and a veteran teaching staff, mostly black, that often had deep roots in the local community. DCPS also had a union that had to be listened to and reckoned with, because it actually was something that the members had themselves helped to build. (As in many other areas, we certainly had our share of crooks. It’s my contention that the crooks have had a very bad effect, by allowing themselves to be an example of black, inner-city corruption at all levels, so, as Richard Whitmire has argued, the African-American teachers and principals were precisely the ones who were holding their black DC students back. (I’m not making up this accusation – read The Bee Eater)). DCPS certainly had its share of very serious problems, about which I and many other teachers and parents spoke up and tried to fix in one way or another, not always successfully…

But for the last five years, Washington now has a completely powerless school board, a mayor who appoints chancellors based on wishful thinking, and a loss of about 80% of the former teaching staff (retired, resigned, or fired) and their replacement by overwhelmingly young, white recent college grads who find it a VERY difficult job and seldom last more than 2-3 years in the classroom, because the work load has become so overwhelming and crisis-like, with no support from any administration member at any level…

And over the last 5 years of Rhee-form, in a time when enrollment in K-12 was booming again in DC after many decades of free-fall, regular DC public schools have managed steadily to lose market share to charter schools, to such a degree that today, it’s nearly 50% charter, 50% regular public. And teaching staff are judged by a pseudo-scientific formula couched in impenetrably complex and ENORMOUS AMOUNTS of mathematical processing that literally no one can do by hand: a prominent mathematician calls this “Intimidation by Mathematics” is used to judge teachers’ and administrators’ worth. The pressure on teachers is unrelenting.

Nowadays, all of the principals and all of the downtown staff is new, too. Many of the higher-ups seem to be connected through Teach for America and various other foundations funded by a relative handful of billionaires (some very public, such as Bill Gates or Michael Bloomberg or the Koch brothers or the Walton family) but they often jump from city to city, too, seeking higher pay and better perks wherever they go…

The curriculum has now become preparation for standardized tests; art, music, gym, recess, projects, libraries, and anything else not tested is disappearing from the curriculum.

On the charter-school side, it’s fairly easy for someone to open up a few charter schools and pay him/herself high salaries, set up a separate for-profit corporation that the “public” charter school does all its business with, and it’s often perfectly legal. But it’s very common for charter school operators to earn half-a-million dollars a year, or more. (Options PCS, anybody? Many charter heads report that they earn large six figures, and I wonder what they don’t report…)

So, to repeat, there has been an almost complete changeover of teaching and administrative staff in the District of Columbia’s public education sector.  And the ‘system’ appears to have totally changed, to the point that every administrator and every teachers knows full well that he/she has absolutely no right to any due process: they can be fired or forced to resign at almost any time, even in the middle of the school year, while they waste untold amounts of time that could be used actively engaging kids in real thought-provoking activities, they are expected to follow scripted lessons to the letter, and spend almost the entire year preparing a test that many of the students don’t care about all and means nothing at all to their future.

And what has changed regarding these all-important test scores? Nothing..

The trends before Rhee in the NAEP tests are almost exactly the same as after Rhee, on all levels that NAEP reports on, for DCPS.

All those changes – for NOTHING?

(I have not yet teased out the charter schools data for DC, so I won’t say anything about how they compare with the regular public schools.)

In any case, this same Dick Whitmire has, as usual, been given yet another opportunity in the Washington Post to pour his accolades on his  personal friends, Michelle Rhee, Kaya Henderson, and the rest of the new millionaire class of edupreneurs who made good via TFA, and their billionaire backers.

Here’s a quote from that Dick:

“The education momentum has shifted so dramatically in the past few years that most Washingtonians have no idea why D.C. students suddenly are being singled out for making remarkable progress.”

A Look at population trends in DC’s school population

I’m going my best to play it straight.

In the following fiew posts I will try to give you a clear look at how the publicly-funded student enrollment in Washington, DC has been trending over the past decade or so.

I’ll then make a few predictions of how I think things will continue in the next few years.

And then make some judgments on what these records mean.

I think that graphs are often one of the very easiest ways to make things clear, but as Darrell Huff wrote a long time ago in a classic work called “How to Lie With Statistics“, you can still use them in many ways to mislead if you want to.

Here is the very first graph given by DC’s Office of the State Superintendent of Education, or OSSE:

Looks like a huge jump, right? Maybe the latest enrollment is about twice as much as it was at its low point just after Rhee got here to save the day in 2008, right?

No.

It’s not such a huge jump.

And it’s for the regular DC public schools combined with the DC charter schools (privately run tho funded by taxpayers). Not just DCPS, which I’ll look at in a subsequent blog.

The scale is really misleading. The total population is in fact increasing, but (a) most of it seems to have occurred after Rhee left, and (b) from the current high of 80,854 from a nadir of 70,922 is only a 14% increase, or about one-seventh, not a doubling of population.

One’s eye wouldn’t trick one so if one used a scale that went all the way to zero on the vertical axis. (BTW, this is precisely one of Huff’s methods of lying with statistics!) So here is what I think is a fairer way to represent the data, with a scale that goes from 0 to 90,000.

You can see that over the past decade or so, there was a modest drop, followed by a modest rise. These are NOT huge changes, folks!

Is there something special and weird going on? Not really. The population of DC is rebounding somewhat, as well. Take a look at this graph prepared by Google and the US Census Bureau, not by me:

I hope it’s not a surprise that the school enrollment numbers and the total DC population of all ages do not move in lockstep! But, as a general rule, if you get more adults, they have a mysterious way of making babies, and those little’uns eventually do grow up and go to school somewhere!