What Exactly Were the Differences Between Cheating in Atlanta Under Beverly Hall and the Cheating in DC Under Michelle Rhee?

We all know that administrators and teachers in DC and in Atlanta cheated in order to keep their jobs and gain large cash bonuses. In one city, scores of teachers were indicted, some plea=bargained, some went to jail, and the chief died of cancer. In the other city, only a couple of whistle-blowers lost their jobs, but the chief went on to fame and fortune while all the other culpable parties kept their bonuses.

But why is it that only in Atlanta were teachers and administrators indicted and convicted, but nowhere else?

What difference was there in their actual behavior?

To me, the answer is simple: in DC, officials at every level, from the Mayor’s office up to the President of the US and the Secretary of Education, were determined to make sure that Michelle Rhee’s lying and suborning of perjury and lies would never be revealed, no matter what.

Read for yourself part of the official documents in Atlanta (I’m quoting from The Answer Sheet) and see if you can find any real differences in behavior between what happened there and what happened in DC.

“A[tlanta] P[ublic] S[schools] principals and teachers were frequently told by Beverly Hall and her subordinates that excuses for not meeting targets would not be tolerated. When principals and teachers could not reach their targets, their performance was criticized, their jobs were threatened and some were terminated. Over time, the unnreasonable pressure to meet annual APS targets led some employees to cheat on the CRCT. The refusal of Beverly Hall and her top administrators to accept anything other than satisfying targets created an environment where achieving the desired end result was more important than the students’ education.

“To satisfy annual targets and AYP, test answer sheets were altered, fabricated, and falsely certified. Test scores that were inflated as a result of cheating were purported to be the actual achievement of targets through legitimately obtained improvements in students’ performance when, in fact, the conspirators knew those results had been obtained through cheating and did not reflect students’ actual academic performance.

“As part of the conspiracy, employees of APS who failed to satisfy targets were terminated or threatened with termination, while others who achieved targets through cheating were publicly praised and financially rewarded. For example, teachers who reported other teachers who cheated were terminated, while teachers who were caught cheating were only suspended. The message from Beverly Hall was clear: there were to be no exceptions and no excuses for failure to meet targets.

“Beverly Hall placed unreasonable emphasis on achieving targets; protected and rewarded those who achieved targets through cheating; terminated principals who failed to achieve targets; and ignored suspicions CRCT score gains at schools within APS. As a result, cheating became more and more prevalent within APS, until by the time the 2009 CRCT was administered, cheating was taking place in a majority of APS’s 83 elementary and middle schools. This was substantiated by GOSA’s erasure analysis, which identified 43 APS elementary and middle schools with at least one out of four classrooms within those schools having a statistically improbable number of erasures changing wrong answers to right answers. GOSA’s erasure analysis identified an additional 9 APS elementary and middle schools as having at least one out of five classrooms with a statistically improbable number of erasures changing wrong answers to right answers. Confessions by dozens of APS employees subsequently confirmed what GOSA’s statistical analysis indicated; widespread cheating occurred on the 2009 CRCT.

“It was further a part of the conspiracy and endeavor that targets achieved through cheating were used to obtain financial and other rewards for many of the conspirators.

“It was further part of the conspiracy and endeavor that targets achieved through cheating were used by Beverly Hall to obtain substantial performance bonuses.

“It was further part of the conspiracy and endeavor that Beverly Hall and other conspirators would interfere with, suppress and obstruct investigations into cheating using various methods. Conspirators would refuse to investigate reports of cheating; suppress and deny the existence of reports of cheating; fail to act upon APS investigators’ conclusions that cheating was occurring; suppress and deny the APS investigators’ conclusions that cheating was in fact occurring; fail and refuse to provide complaints of cheating to the Governor’s Special Investigators, the Georgia Bureau of Investigation and investigators from the Fulton County District Attorney’s Office; and intimidate witnesses with the intent to hinder, delay, or prevent the communication of criminal offenses to law enforcement officers. When questioned by the Governor’s Special Investigators and law enforcement officers, many of the conspirators made false statements some under oath denying their knowledge of and participation in the cheating.”

Listing of Educational Bloggers

This is a list of the blogs maintained at the present time by some fellow-activist teachers and others.

Enjoy!

BLOGGER NAME BLOG NAME BLOG WEBSITE
A Teacher on Teaching A Teacher on Teaching http://ateacheronteaching.blogspot.com/
Aaron Barlow Aaron Barlow http://academeblog.org/author/aaronbarlow/ or http://audsandens.blogspot.com/
Accountable Talk Accountable Talk http://www.accountabletalk.com/
Adam Bessie Automated Teaching Machine http://adambessie.com/
Alan Singer Alan Singer http://www.huffingtonpost.com/alan-singer/
Alexandra Miletta Alexandra Miletta http://alexandramiletta.blogspot.com
Alice Mercer Reflections on Teaching http://mizmercer.edublogs.org
Allan Jones Allan Jones https://www.facebook.com/groups/1398276720427252/
Amy Moore Amy Moore http://www.desmoinesregister.com/topic/065294af-047d-4b86-beb4-0d401eb82096/
Andy Spears Tennessee Education Report http://tnedreport.com/
Ani McHugh Teacherbiz http://teacherbiz.wordpress.com
Ann Policelli Cronin Ann Policelli Cronin http://reallearningct.com/
Anne Tenaglia Teacher’s Lessons Learned http://teacherslessonslearned.blogspot.com/
Anthony Cody Anthony Cody http://www.livingindialogue.com/
Arthur Getzel The Public Educator (aka liberalteacher) http://thepubliceducator.com/
Arthur Goldstein NYCEducator http://nyceducator.com/
Arthur H. Camins Arthur H. Camins http://www.arthurcamins.com/
Audrey Amrein-Beardsley VAMboozled http://vamboozled.com/
Aurelio M. Montemayor Parent Leadership in Education http://parentleadershipined.blogspot.com/
Badass Teachers Association (Marla Kilfoyle, Melissa Tomlinson) Badass Teachers Association http://badassteachers.blogspot.com/ and http://www.badassteacher.org/
Barbara Madeloni Educators for a Democratic Union http://www.educatorsforademocraticunion.com/
Barbara McClanahan readingdoc http://readingdoc.wordpress.com/
Betsy Combier Parent Advocatees http://www.parentadvocates.org/
Big Education Ape Big Education Ape http://bigeducationape.blogspot.com/
Bill Betzen School Achieve Project http://schoolarchiveproject.blogspot.com/
Bill Boyle Educarenow http://educarenow.wordpress.com/
Bob Sikes Scathing Purple Musings http://bobsidlethoughtsandmusings.wordpress.com/
Bob Valiant Defend-Ed http://defend-ed.org/
Bonnie Cunard Continuing Change http://gatorbonbc.wordpress.com/ orhttp://bonniecunardmargolin.weebly.com/
Bonny Buffington BBBloviations http://www.bbbloviations.blogspot.com/
Brett Bymaster Stop Rocketship http://www.stoprocketship.com
Brett Dickerson Life At the Intersections http://www.brettdickerson.net/
Brian Cohen Making the grade blog http://www.bncohen.com/
Brian Redmond rsbandman http://rsbandman.wordpress.com
Bruce Baker School Finance 101 http://schoolfinance101.wordpress.com/
Bruce Bowers Reflections on teaching and learning www.tremphil.com
Carol Burris Carol Burris http://roundtheinkwell.com/ and Answer Sheet
Chaz Chaz’s School Daze http://chaz11.blogspot.com/
Chris Cerrone Children should not be a number http://www.nystoptesting.com/
Chris Guerrieri Jaxkidsmatter http://jaxkidsmatter.blogspot.com/
Chris Thinnes Chris Thinnes http://chris.thinnes.me
Christian Goering Edusanity http://www.edusanity.com/
Christopher Martell On Social Studies and Education http://christophermartell.blogspot.com
Christopher Tienken Christopher Tienken http://christienken.com/blog/
Christopher Wooleyhand Common Sense School Leadership http://christopherwooleyhand.edublogs.org
Claudia Swisher Claudia Swisher http://fourthgenerationteacher.blogspot.com/
Cynthia Liu K12NN News Network http://k12newsnetwork.com/
Dan McConnell Truth and Consequences http://dan-mcconnell.blogspot.com/
Daniel Katz Daniel Katz http://danielskatz.net/
Darcie Cimarusti Mother Crusader http://mothercrusader.blogspot.com/
David Chura Kids in the System http://kidsinthesystem.wordpress.com/
David Cohen InterACT:  Accomplished California Teacher http://accomplishedcaliforniateachers.wordpress.com/
David Ellison A Teacher’s Mark’s http://ateachersmarks.blogspot.com/
David Greene DCG MENTORING https://dcgmentor.wordpress.com 
Debbie Forward PFF Faculty Lounge http://pfffacultylounge.wordpress.com/
Deborah McCallum Big Ideas in Education http://bigideasineducation.ca/
Deborah Meier Deborah Meier http://blogs.edweek.org/edweek/Bridging-Differences/
Demian Godon Reconsidering TFA https://reconsideringtfa.wordpress.com/
Derek Black Education Law Prof Blog http://lawprofessors.typepad.com/education_law/
Diane Aoki The Teacher I Want to Be http://dianeaoki.blogspot.com/
Diane Ravitch Diane Ravitch http://dianeravitch.net
DOE Nutes DOE Nuts Blog http://nycdoenuts.blogspot.com/
Don Russell Lifting The Curtain http://liftingthecurtainoneducation.wordpress.com/
Dora Taylor Seattle Education http://seattleducation2010.wordpress.com/
Doug Martin Doug Martin http://www.schoolsmatter.info/ 
Edward Berger Edward Berger http://edwardfberger.com/
Elizabeth Rose Yo Miz http://yomizthebook.com/
Francesco Portelos Educator Fights Back  or Don’t Tread on Educators http://dtoe.org/ or http://protectportelos.org/
Fred Klonsky Fred Klonsky http://preaprez.wordpress.com/
Gary Rubinstein Gary Rubinstein https://garyrubinstein.wordpress.com/
Gene Glass Education in Two Words http://ed2worlds.blogspot.com/
George Schmidt Substance News http://www.substancenews.net/
George Wood George Wood http://www.essentialschools.org/
Gerri Songer Gerri Song http://gerriksonger.wordpress.com/
Glen Brown Teacher Poet Musician http://teacherpoetmusicianglenbrown.blogspot.com/
Good Morning Art Teacher Good Morning Art Teacher http://goodmorningartteacher.blogspot.com/
Greg Mild Plumberbund http://www.plunderbund.com/
Guy Brandenburg Guy Brandenburg https://gfbrandenburg.wordpress.com/
Helen Gym Philadelphia Public School Notebook http://thenotebook.org/blog
Jack McKay Horace Mann League Blog http://blog.hmleague.org/
James Arnold Dr. James Arnold http://drjamesarnold.blogspot.com/
James Avington Miller, Jr The War Report on Public Education http://thewarreportonpubliceducation.wordpress.com and http://bbsradio.com/thewarreport
James Boutin An Urban Teachers Education http://www.anurbanteacherseducation.com/
James Chascherrie Stop Common Core in Washington State http://stopcommoncorewa.wordpress.com/
James Hamric Hammy’s Education Blog http://edreformblog.wordpress.com/
Jan Resseger Jan Resseger http://janresseger.wordpress.com/
Jane Nixon Willis Staying Strong in School http://stayingstronginschool.blogspot.com/
Jason France Crazy Crawfish http://crazycrawfish.wordpress.com/
Jason L. Endacott EduSanity http://www.edusanity.com/
Jason Stanford Jason Stanford http://www.huffingtonpost.com/jason-stanford/
Jeff Bryant Jeff Bryant http://educationopportunitynetwork.org/
Jen Hogue V.A.M. It! http://valueaddedmeasureit.blogspot.com/
Jennifer Berkshire EduShyster http://edushyster.com/
Jesse Hagopian Jesse Hagopian http://iamaneducator.com/
Jessie Ramey Yinzercation http://yinzercation.wordpress.com/
Jill Conroy The Indignant Teacher http://theindignantteacher.wordpress.com/
Jo Lieb Poetic Justice http://poeticjusticect.com/
Joe Bower For the love of learning http://www.joebower.org/
John J. Viall A Teacher on Teaching http://ateacheronteaching.blogspot.com/
John Kuhn EdGator https://edgator.com
John Young Transparent Christina http://transparentchristina.wordpress.com/
Jonathan Lovell Jonathan Lovell’s Blog http://jonathanlovell.blogspot.com/
Jonathan Pelto Wait, What? http://jonathanpelto.com/
Jose Vilson Jose Vilson http://thejosevilson.com/
Joshua Block Joshua Block http://mrjblock.com/
Julian Vasquez Heilig Cloaking Inquity http://cloakinginequity.com/
Justin Aion Relearning to Teach http://relearningtoteach.blogspot.com/
Karren Harper Royal Edutalknola http://edutalknola.com/
Katie Lapham Critical Classrooms https://criticalclassrooms.wordpress.com/
Ken Derstine Defend Public Education http://www.defendpubliceducation.net/
Ken Previti Reclaim Reform http://reclaimreform.com/
Kenneth Bernstein Teacher Ken http://www.dailykos.com/user/teacherken
Kevin Welner Kevin Welner http://www.huffingtonpost.com/kevin-welner/ andhttp://nepc.colorado.edu
Lani Cox The Missing Teacher http://lanivcox.blogspot.com/
Larry Cuban Larry Cuban http://larrycuban.wordpress.com/
Larry Feinberg Keystone State Education Coalition http://keystonestateeducationcoalition.blogspot.com/
Lee Barrios Geauxteacher http://www.geauxteacher.net/
Leonard Isenberg Perdaily http://www.perdaily.com/
Leonie Haimson Class Size Matters http://nycpublicschoolparents.blogspot.com/
Levi B Cavener Idahospromise http://idahospromise.org/
Linda Thomas Restore Reason http://restorereason.com/
Lisa Guisbond Fairtest http://www.fairtest.org/
Lloyd Lofthouse Crazy Normal the classroom expose http://crazynormaltheclassroomexpose.com/  or http://lloydlofthouse.org/
Lucianna Sanson The War Report on Public Education https://thewarreportonpubliceducation.wordpress.com/
M. Shannon Hernandez My Final 40 Days http://myfinal40days.com/
Maria Rosa THE INSURGENT TEACHER BLOG http://theinsurgentteacher.blogspot.com/
Marie Corfield Marie Corfield http://mcorfield.blogspot.com/
Marion Brady Marion Brady http://www.marionbrady.com/
Mark Naison With a Brooklyn Accent and Dump Duncan http://withabrooklynaccent.blogspot.com/ and http://dumpduncan.org/
Mark Weber Jersey Jazzman http://jerseyjazzman.blogspot.com/
Martha Infante Martha Infante http://dontforgetsouthcentral.blogspot.com/
Matt Farmer Matt Farmer http://www.huffingtonpost.com/matt-farmer/
Mel Katz The Education Activist: From Student to Teacher https://theeducationactivist.wordpress.com/
Melissa Westbrook Seattle Schools Community Forum http://saveseattleschools.blogspot.com/
Mercedes Schneider Deutsch29 http://deutsch29.wordpress.com/
Michael Klonsky Michael Klonsky http://michaelklonsky.blogspot.com/ and http://schoolingintheownershipsociety.blogspot.com/
Michelle Gunderson Education Matters https://www.facebook.com/michelle.gunderson.education.matters
Mike Deshotels Louisiana Educator http://louisianaeducator.blogspot.com/
Mike Rose Mike Rose’s Blog http://mikerosebooks.blogspot.com
Mike Warner Education Under Attack http://educationunderattack.info/
Minnsanity Minnsanity http://minnsanity.wordpress.com/
Morna McDermott Education Alchemy http://www.educationalchemy.com/
Mrs. Fanning LA Woman http://fanninglawoman.blogspot.com/
Ms Kate Ms Katie’s Ramblings http://mskatiesramblings.blogspot.com/
Nancy Bailey Nancy Bailey’s Education Website http://nancyebailey.com/
Nancy Flanagan Teacher in a Strange Land http://blogs.edweek.org/teachers/teacher_in_a_strange_land/
Nicholas Tampio Nicholas Tampio http://www.huffingtonpost.com/nicholas-tampio/
Nikhil Goyal Nikhil Goyal http://nikhilgoyal.me/
Norm Scott Ed Notes Online http://ednotesonline.blogspot.com/
Ogo Okoye-Johnson Ogo Okoye-Johnson http://ogookoye-johnson.net/
OK Education Truth okeducationtruths http://okeducationtruths.wordpress.com/
Outside The Box Outside the Box http://teacher-anon.blogspot.com/ 
Patrick Walsh http://raginghorse.wordpress.com/
Paul Horton Education News http://www.educationviews.org/author/paulh/
Paul Thomas The becoming radical http://radicalscholarship.wordpress.com/
Peggy Robertson Peg with Pen http://www.pegwithpen.com/
Perdido St School Perdido St School http://perdidostreetschool.blogspot.com/
Peter DeWitt Peter DeWitt http://blogs.edweek.org/edweek/finding_common_ground/
Peter Goodman Ed in the Apple http://mets2006.wordpress.com/
Peter Greene Curmudgucation http://www.curmudgucation.blogspot.com/
Phillip Cantor Sustainable Education Transformation http://phillipcantor.com/
Rachael Stickland Student Privacy Matters http://www.studentprivacymatters.org/
Rachel Levy All Things Education http://allthingsedu.blogspot.com/
Ralph Ratto Opine I will http://rlratto.wordpress.com/
Ray Salazar The White Rino http://www.chicagonow.com/white-rhino
Rob Miller View From the Edge http://www.viewfromtheedge.net/
Rob Panning-Miller Public Education Justice Alliance of Minnesota http://pejamn.blogspot.com/
Robert Cotto Jr. The Cities, Suburbs & Schools Project http://commons.trincoll.edu/cssp/
Robert D. Skeels Solidaridad http://rdsathene.blogspot.com/
Russ Walsh Russ on Reading http://russonreading.blogspot.com/
Ruth Conniff Public School Shakedown http://www.publicschoolshakedown.org/
Sam Chaltain Sam Chaltain http://www.samchaltain.com
Sara Roos Sara Roos http://redqueeninla.com/
Sarah Blaine Parenting the core http://parentingthecore.wordpress.com/
Sarah Darer Littman Sarah Darer Littman http://www.ctnewsjunkie.com
Sarah Lahm Sarah Lahm http://www.tcdailyplanet.net/eyes-education
Save Public Education Save Public Education
Sharon Higgins Charter School Scandals http://charterschoolscandals.blogspot.com/
Shaun Johnson Chalk Face http://atthechalkface.com/
Sherman Dorn Sherman Dorn http://shermandorn.com/wordpress/
South Bronx School South Bronx School http://www.southbronxschool.com/
Stephanie Rivera Teacher Under Construction http://teacherunderconstruction.com/
Stephen Dyer 10th Period http://10thperiod.blogspot.com/
Stephen Krashen Stephen Krashen http://www.schoolsmatter.info/ and http://skrashen.blogspot.com/
Steve Hinnefeld Steve Hinnefeld http://inschoolmatters.wordpress.com/
Steve O’Donoghue Steve O’Donogue http://www.counterintuitive.com/
Steve Strieker One Teachers Perspective http://oneteachersperspective.blogspot.com/
Steven Singer Gad Fly On the Wall Blog http://gadflyonthewallblog.wordpress.com/
Stu Bloom Live Long and Prsoper http://bloom-at.blogspot.com/
Sullio The Pen is Mightier than the Person http://sullio.blogspot.com/
Susan DuFresne Educating the Gates Foundation http://educatingthegatesfoundation.com/
Susan DuFresne and Katie Lapham Teachers Letters to Bill Gates http://teachersletterstobillgates.com/
Susan Ohanian Susan Ohanian http://www.susanohanian.org/
TB Furman tbfurman http://www.tbfurman.us/
TC Dad Gone Wild http://norinrad10.wordpress.com/
Teacher Reality Teacher Reality http://teacherreality.com/
Teacher Tom Teacher Tom http://teachertomsblog.blogspot.com/
Ted Cohen Newark Schools For Sale http://NewarkSchoolsForSale.wordpress.com
The Assailed Teacher http://theassailedteacher.com/
The Teaching Nomad The Teaching Nomad www.theteachingnomad.com/blog 
Tim Slekar Busted Pencils http://bustedpencils.com/ 
Tom Aswell Louisiana Voice http://louisianavoice.com/
Tracy Novick Who-cester Blog http://who-cester.blogspot.com/
Ty Alper Ty Alper (SF School Board candidate) http://www.huffingtonpost.com/ty-alper/ or http://www.tyalper.org
Urban Ed Urban Ed http://nycurbaned.blogspot.com/
Vanessa Vaile Precarious Faculty Blog http://www.precariousfacultyblog.com/ or http://nationalmobilizationforequity.org/
Wag the Dog Wag the Dog http://vigornotrigor.wordpress.com/
Walt Gardner Walt Garnder http://blogs.edweek.org/edweek/walt_gardners_reality_check/
Wayne Gersen Network Schools http://waynegersen.com/
Wendy Lecker Wendy Lecker http://www.stamfordadvocate.com
Xian Barrett Xian Barrett http://newvoicestrategies.org/
Yohuru Williams Yohuru Williams http://www.yohuruwilliams.net/
Yong Zhao Education in the Age of Globalization http://zhaolearning.com

Kaya Henderson Really Doesn’t Know How to Run a School System

DCPS Chancellor Kaya Henderson told the city two days ago, “I want to be clear. We know what we need to do, and we have what it takes to get it done.”

That is patently untrue.

Even by her own yardsticks, namely test scores, Henderson and her kind of ‘reform’ has so far been a complete failure; Continuing the churn-and-test-prep regime won’t make it any better

As I wrote in a comment on the article in the Washington Post:

All of Henderson’s boasts of continuous progress are completely bogus. 
 
If you look at the scores on the DC-CAS for every single subgroup, you can see that they have stagnated since 2009, which was the year before Rhee, Kamras and Henderson implemented their trademark reforms (IMPACT, TLF, VAM “merit pay” and eliminating seniority protections for teachers). The gaps between white students and hispanic or black students have NOT narrowed since that time. There were some increases from 2006-2009, but it’s not clear how much of that was due to adults cheating, or simply because students and teachers were adapting to a brand-new test. (You may recall that the DC-CAS was administered for the very first time in 2006, and the percentages of kids deemed ‘proficient’ dropped quite a bit in comparison to what they were under the old test, especially in math.) 
 
Also: out of the 78 measurable goals set by Rhee and four large foundations, in order to earn that $64.5 million grant in 2009, the DCPS leadership has achieved a mere one and one-half of those goals (and I’m being generous with the one-half). That is a success rate of TWO PERCENT. 
 
In other words, Rhee and Henderson have an almost perfect record of failure, none of which is publicized by the media (esp. not WaPo editorial staff) but is easy to see if you look at the official OSSE statistics and are willing to dig a little bit.  
 
I’ve done some digging and have made some pretty easy-to-understand graphs showing how much Rhee and Henderson have failed. Look at my blog, gfbrandenburg.wordpress.com , and in particular at http://bit.ly/10mna8c , http://bit.ly/10mneEY , and http://bit.ly/1ptal1K . 
 
After you read those blog posts, can you explain to me why Kaya Henderson still has a job? It is so clear that mayoral control has been a complete failure!

Did Rheeformers Rhee and Henderson Actually Close Any of Those Achievement Gaps in DC Public Schools?

Part Sixteen and Final

Today we look at the black-white and hispanic-white achievement gaps in the Washington, DC public school system, which has now been under mayoral control for seven full years.

My four graphs and tables today will show how laughably pitiful their claims of success really are.

You will see that the achievement gap is pretty much unchanged since the year I retired (2009), but the gap between Rhee’s promises and reality has been getting wider and wider.

A lot of their promises had to do with closing the ‘achievement gaps’ between white and more-affluent students on the one hand, and black, white, and impoverished students on the other hand. As you probably are aware, standardized test scores are very strongly linked to family income and educational levels. You may not be aware that the white population of Washington DC is generally very well-educated.and fairly affluent (unlike rural white populations in, say, West Virginia or Kentucky). Washington has the highest-scoring white student body in the nation on the National Assessment of Educational Progress (NAEP), and the widest gap between the scores of white students and of hispanic or black students.

However, Michelle Rhee and her minions promised spectacular reductions in those gaps, as measured by the relative percentages of students scoring ‘proficient’ or ‘advanced’ on the DC-CAS among white students, hispanic students, black students, and students who are eligible for free and reduced-price lunches (versus those not eligible).

What I found is a complete and utter failure to make any progress whatsoever since 2008 or 2009 — the year that Rhee twisted the arms of every single principal in the school system to come up with miraculous gains, and when many of those principals (and teachers) engaged in cheating to boost the scores.

As usual, don’t just take my word for it. Look at the following four graphs and check my sources if you like.

With these graphs and tables, low numbers are GOOD because that means that the gap between white students on the one hand and black or hispanic students on the other is getting smaller. High numbers are BAD because the gap is getting bigger.

You will notice that each graph has a solid black line — that represents what really happened.

Each graph also has a dotted red line. It represents how much Rhee et al promised that things would improve.

I don’t exactly know what they were smoking when they made those promises, but it seems like they were hallucinating that by WILL alone, and by replacing all the veteran teachers and administrators with untrained, unqualified and inexperienced newbies from TFA or TNTP, they would achieve miracles.

Again, see for yourself.

First we look at the gaps between the scores of black and white students, in math, on the DC-CAS, from 2007-2014.

promised and actual math black-white gaps, 2007-2014

Since 2009, the year that Rhee and many principals were outed as cheaters by a lengthy series of reports in USAToday, you can see that there has in fact been no progress in closing the gap. The prediction is the red, dotted line. The actual performance is the black line, which is essentially horizontal after 2009.

Now let’s look at the black-white achievement gap in reading:

promised and actual reading black-white gaps, 2007-2014

In this case, the gap between the scores of black and white students — as shown by the solid black line — has actually been growing slightly wider since 2008! As in the previous graph, the totally imaginary promises of Rhee and Henderson are the red, dotted line – a line which got farther and farther away from the truth every single year.  Some accomplishment, Rhee and Henderson and Gray!

Thirdly, we look at the gaps between hispanic and white students in math:

promised and actual hispanic-white math gaps, 2007-2014

We see here that the black line has been wiggling up and down since 2009, with the result that the gap for 2014 is almost exactly the same as the gap in 2009, while we were promised miracles. Once again, there is a very important gap that is getting much wider: the gap between the prediction and reality.

My last table and graph for the day concerns the achievement gap for reading, between hispanic and white students.

promised and actual hispanic-white reading gaps, 2007-2014

As you can see, this achievement gap is now actually a bit wider than it was in either 2008 or 2009. And the gap between those promises and reality got steadily wider and wider.

Some people have told me that I’m being unfair, because Rhee and Henderson, under mayoral control, have been making tremendous progress in raising test scores and in closing the achievement gaps. I hope that this post sets the record straight: they have in fact made NO progress in closing the achievement gaps, and their predictions became more and more laughable as time went on.

Can someone explain to me why Kaya Henderson still has a job as chancellor of DC public schools?

========================================================

This is my last post in this series of articles.

I’ve been examining the promised, miraculous gains that were promised in the troubled Washington, DC public school system to see whether any of those 78 promised goals were reached.

Rhee and Henderson actually accomplished one and a half out of that 78 goals.

It is true that there have been steady improvements on the scores of DCPS students (all groups) in math on the NAEP — but those improvements began in the 1990s, a decade before Mayor Adrian Fenty got the wacky idea of hiring a totally unqualified sociopathic liar (Michelle Rhee) as Chancellor. There were also some fairly large gains in DC-CAS test scores during the first two years it was given, but that’s normal. As far as I have seen, any time any school district adopts a new standardized test, students’ test scores plummet the first year, but then rise after a year or two, as the teachers and students get used to the new format.

The sources I used to compile this data are here and here. My fifteen previous posts on this topic can be found here:

The saga so far:

  1.  https://gfbrandenburg.wordpress.com/2014/09/02/did-any-of-michelle-rhees-promises-actually-work-in-dc/
  2. https://gfbrandenburg.wordpress.com/2014/09/02/more-on-michelle-rhees-promises-concerning-dcps/
  3. https://gfbrandenburg.wordpress.com/2014/09/04/what-rhee-promised-to-the-billionaires-walton-gates-et-al-but-didnt-deliver/
  4. https://gfbrandenburg.wordpress.com/2014/09/04/two-more-promises-by-rhee-et-al-were-they-kept/
  5. https://gfbrandenburg.wordpress.com/2014/09/05/ten-more-promises-from-rhee-henderson-company-were-any-of-them-kept/
  6. https://gfbrandenburg.wordpress.com/2014/09/05/33-6-for-nearly-all-values-of-3-not-5/
  7. https://gfbrandenburg.wordpress.com/2014/09/05/5281/
  8. https://gfbrandenburg.wordpress.com/2014/09/07/more-failures-to-deliver-on-promises-by-michelle-rhee-and-her-acolytes/
  9. https://gfbrandenburg.wordpress.com/2014/09/08/another-day-another-bunch-of-failures-from-rhee-henderson/
  10. https://gfbrandenburg.wordpress.com/2014/09/09/even-more-missed-targets-dc-cas-proficiency-in-2010-and-2011/
  11. https://gfbrandenburg.wordpress.com/2014/09/13/rhees-failures-in-dc-the-continuing-saga-2012-dc-cas/
  12. https://gfbrandenburg.wordpress.com/2014/09/21/the-long-list-of-failures-by-rhee-and-henderson-continued/
  13. https://gfbrandenburg.wordpress.com/2014/09/21/did-michelle-rhee-actually-close-those-achievement-gaps/
  14. https://gfbrandenburg.wordpress.com/2014/09/22/twelve-more-testing-goals-assessed-today-how-many-did-rhee-succeed-at/
  15. https://gfbrandenburg.wordpress.com/2014/09/22/final-listing-of-completed-and-failed-goals-but-some-analysis-will-follow/

What I actually had time to say …

Since I had to abbreviate my remarks, here is what I actually said:

I am Guy Brandenburg, retired DCPS mathematics teacher.

To depart from my text, I want to start by proposing a solution: look hard at the collaborative assessment model being used a few miles away in Montgomery County [MD] and follow the advice of Edwards Deming.

Even though I personally retired before [the establishment of the] IMPACT [teacher evaluation system], I want to use statistics and graphs to show that the Value-Added measurements that are used to evaluate teachers are unreliable, invalid, and do not help teachers improve instruction. To the contrary: IVA measurements are driving a number of excellent, veteran teachers to resign or be fired from DCPS to go elsewhere.

Celebrated mathematician John Ewing says that VAM is “mathematical intimidation” and a “modern, mathematical version of the Emperor’s New Clothes.”

I agree.

One of my colleagues was able to pry the value-added formula [used in DC] from [DC data honcho] Jason Kamras after SIX MONTHS of back-and-forth emails. [Here it is:]

value added formula for dcps - in mathtype format

One problem with that formula is that nobody outside a small group of highly-paid consultants has any idea what are the values of any of those variables.

In not a single case has the [DCPS] Office of Data and Accountability sat down with a teacher and explained, in detail, exactly how a teacher’s score is calculated, student by student and class by class.

Nor has that office shared that data with the Washington Teachers’ Union.

I would ask you, Mr. Catania, to ask the Office of Data and Accountability to share with the WTU all IMPACT scores for every single teacher, including all the sub-scores, for every single class a teacher has.

Now let’s look at some statistics.

My first graph is completely random data points that I had Excel make up for me [and plot as x-y pairs].

pic 3 - completely random points

Notice that even though these are completely random, Excel still found a small correlation: r-squared was about 0.08 and r was about 29%.

Now let’s look at a very strong case of negative correlation in the real world: poverty rates and student achievement in Nebraska:

pic  4 - nebraska poverty vs achievement

The next graph is for the same sort of thing in Wisconsin:

pic 5 - wisconsin poverty vs achievement

Again, quite a strong correlation, just as we see here in Washington, DC:

pic 6 - poverty vs proficiency in DC

Now, how about those Value-Added scores? Do they correlate with classroom observations?

Mostly, we don’t know, because the data is kept secret. However, someone leaked to me the IVA and classroom observation scores for [DCPS in] SY 2009-10, and I plotted them [as you can see below].

pic 7 - VAM versus TLF in DC IMPACT 2009-10

I would say this looks pretty much no correlation at all. It certainly gives teachers no assistance on what to improve in order to help their students learn better.

And how stable are Value-Added measurements [in DCPS] over time? Unfortunately, since DCPS keeps all the data hidden, we don’t know how stable these scores are here. However, the New York Times leaked the value-added data for NYC teachers for several years, and we can look at those scores to [find out]. Here is one such graph [showing how the same teachers, in the same schools, scored in 2008-9 versus 2009-10]:

pic 8 - value added for 2 successive years Rubenstein NYC

That is very close to random.

How about teachers who teach the same subject to two different grade levels, say, fourth-grade math and fifth-grade math? Again, random points:

pic 9 - VAM for same subject different grades NYC rubenstein

One last point:

Mayor Gray and chancellors Henderson and Rhee all claim that education in DC only started improving after mayoral control of the schools, starting in 2007. Look for yourself [in the next two graphs].

pic 11 - naep 8th grade math avge scale scores since 1990 many states incl dc

 

pic 12 naep 4th grade reading scale scores since 1993 many states incl dc

Notice that gains began almost 20 years ago, long before mayoral control or chancellors Rhee and Henderson, long before IMPACT.

To repeat, I suggest that we throw out IMPACT and look hard at the ideas of Edwards Deming and the assessment models used in Montgomery County.

Recent Articles Against Race to the Trough and other Deformations of US Public Education

Bob Schaeffer of FairTest has been compiling weekly lists of good articles that give a view from ordinary schools and households on what it’s been like under NCLB and its successor, RTTT. Here’s Schaeffer’s latest list.   — gfb

=====================================================

Assessment reform pressure continued to escalate even as Hurricane Sandy slammed ashore.  Best wishes to our friends and allies in the mid-Atlantic states as they recover from the storm.

Arne Duncan’s Legacy: Doubling Down on High Stakes Testing Failures
http://education.nationaljournal.com/2012/10/what-has-arne-done-for-us.php#2258005

Texas Tests Breed Schools for Scandal
http://www.texastribune.org/texas-education/public-education/guest-column-tests-breed-schools-scandal/

Testing in Kindergarten — Whatever Happened to Story Time?
http://www.chicagoreader.com/chicago/testing-consumes-kindergarten-class-time-in-chicago/Content?oid=7740293

Hudson Valley Parents Rip Excess Testing
http://newyork.newsday.com/westchester/westchester-now-1.3784383/hudson-valley-parents-rip-excess-school-testing-1.4152170

Data Missing for School Improvement Grant Claims
http://blogs.edweek.org/edweek/campaign-k-12/2012/10/transparency_watch_obama_has_t.html

The MLK Imperative in an Era of “No Excuses”
http://www.dailykos.com/story/2012/10/27/1149535/-The-MLK-Imperative-in-an-Era-of-No-Excuses

Researchers Urge “Caution” in Use of Value-Added Scores
http://www.edweek.org/ew/articles/2012/10/25/10valueadd.h32.html

Measuring the Worth of a Teacher
http://www.latimes.com/news/local/la-me-teacher-evals-20121029,0,592261,full.story

The Naked Emporer: What Test Scores Don’t Tell Us
http://www.psychologytoday.com/blog/young-minds/201210/what-test-scores-dont-tell-us-the-naked-emperor

Superintendent Dissects Race to the Trough’s Flaws
http://www.washingtonpost.com/blogs/answer-sheet/wp/2012/10/31/school-superintendent-to-thomas-friedman-why-you-are-wrong-about-race-to-the-top/

Bob Schaeffer, Public Education Director
FairTest: National Center for Fair & Open Testing
ph-   (239) 395-6773    fax-  (239) 395-6779
cell-  (239) 699-0468
web- http://www.fairtest.org
Published in: on October 31, 2012 at 4:41 pm  Comments (1)  
Tags: , , ,

Where the data came from

I neglected to give the source for the data for my last two posts. It’s at the website for what looks like a NYC radio or TV station:

http://www.ny1.com/content/top_stories/156599/now-available–2007-2010-nyc-teacher-performance-data#doereports

or

http://tinyurl.com/836a8cj

if you prefer it shorter.

I will warn you that some of the spreadsheets are quite large.

BTW, I just now did a graph showing how well New York City does at predicting the value-added scores of its teachers for school year 2007-2008. The answer seems to be, not very well. Here is the scatter plot:

The correlation is, again, close to zero, even though NYC’s department of assessment and numerology has done their best to try to get it right. In fact, even though the line of best fit doesn’t fit very well, you notice that it slopes downwards to the right. That means that with kids who are predicted to improve relative to the previous year, teachers’ value-added scores are, in general, lower than predicted; whereas with kids who are predicted to do worse than the previous year, teachers’ value-added scores are, in general, a tad higher than predicted.

Not ready for prime time. And not ready to be used to base hiring and firing and bonus decisions on.

Published in: on March 4, 2012 at 2:39 pm  Comments (3)  
Tags: , ,

An Apology? And a look at the DQC website, as I should have done earlier

I’m thinking of asking the DQC leadership for an apology for not even allowing me to stay and observe their national summit last week.

Even though I had pre-registered for the conference.

Even if I were to solemnly promise to sit there like a good boy and not bother anybody by giving them a 2-page commentary I had written, I could not remain.

Nor even if I promised to raise my hand politely before either being ignored or called on, at their pleasure…

I guess they seriously consider me a dangerous crank. But you know something? There seem to be a lot of teachers in the classrooms or retired, old or young, as well as parents and students, who make pretty much the same points that I do. Often they make their points much more eloquently and clearly than me on their blogs, in replies to other folks’ comments, on Facebook, and elsewhere. My major (very small, but not without significance) contribution to the debate on NCLB and the future of education has been mostly to supply some data showing that the Educational DEform movement does not seem to be based on real data.

I am still working on the wording of the letter to DQC, and am trying to figure out what to ask for.* I sent out a couple of drafts, got considerable help from those folks who edited the drafts, and now need to somehow combine all the contributions and make my letter to DQC first of all a lot shorter than it is.

Was this official DQC policy that was spelled out that Guy Brandenburg is so special that he can’t come to any of our conferences? Or more broadly, anybody who disagrees with Arne Duncan or Michelle Rhee cannot attend? Or that anybody will be barred who raises the idea that there are serious problems with a lot of the data that is being collected, and that a lot of these mathematical models are built upon an utterly shaky and weak deck of cards, and give wrong results? (I refer to the sudden surge, across the nation, in “Value-added methods”.)

Or was it just someone local who really hates me? Gosh, I didn’t think I was so infamous. Should I be flattered?

Meanwhile, I began looking closer at the DQC site, which I had only glanced at earlier.

A lot of what I saw, or didn’t see, shocked me.

I had no idea that this group has been around for several years and has been busy attempting essentially to federalize/nationalize all data about schools and everything else, in all 50 states and all the counties and school boards and city councils and individual schools and teachers and classrooms. I think it’s kinda scary when anybody at all has that much information about you, AND THAT SO MUCH OF IT IS WRONG!

It’s clear now that there is a lot of fraudulent test data in a lot of schools and school districts across the country, in many cities and states. Some states have gone after the cheating problem with serious investigations that netted scores, or is it hundreds, of confessions, and long lists of chargees. A lot of folks who understand a little bit about human nature said, “I told you so. When people are put under pressure to keep their jobs by meeting impossible goals, then they cheat. People cheat to achieve large bonuses, as many bankers, politicans, and businessmen bear witness.” (Some do a little time in jail, but generally they get away with their riches with merely some bad headlines in the press for a week or so.) They also point out, “When you dangle rewards in front of people, you get lousy results. People do their best work because they really want to, deep down, not for a paycheck.” (Confirmed in many studies of learning and human response, and once again by Dr. Roland Fryer of Harvard, as I’ve mentioned earlier. Search this blog, top right of this page.)

And this fraud has sometimes devastating effects for honest teachers, and doesn’t help the kids at all. For example, suppose that teacher T has an average-achieving class as scored onthe NCLB test. The kids are promoted to the next grade, where they have teacher U. Teacher U, with or without the knowledge of anybody else, cheats, somehow or other, and raises the kids’ scores significantly above where they would have without the cheating. [there are many ways of doing it, I realized by doing some brainstorming with some other folks a while ago. Don’t think I’m going to list them, at least not here. Never tried any of them!!!!!]

So, Teacher U earns a big fat bonus check, her name on certificates and programs, perhaps other benefits as well, like a promotion to master educator so she can get out of the classroom… Who knows?

Next year, those kids go to teacher V. Teacher V receives kids, and V eventually notices an enormous discrepancy between the kids’ achievements on tests made by the school district’s own publisher, given in the second week of school, way before teacher V had learned all of their mothers’ last names by heart or had had much time to have much of an impact on the kids at all. I mean, how could all of those kids go from “Advanced” or “Proficient” to “Basic” and “Below Basic” in the time from June 20 to about August 25? That sort of thing happens only in the magical world of high-stakes, corruptible testing as we have now.

Kids in V’s class who should have had an extra class in math or reading or whatever because they are so far behind, don’t receive those services, because they are supposedly well above average. Sometimes those extra classes really help, too.

So there is teacher V with a class of kids with contradictory data: last year’s data which showed wonderful scores, and all of this year’s data, starting with the very first official, district-wide standardized, multiple-choice, machine-scored commercially-produced and -marketed test; a test supposed to “inform” the instructor what he/she should instruct. Teacher V doesn’t cheat; instead he/she works his/her but off trying to use all that data to determine what to teach, how and when. But V still does not perform miracles. (We know that miracles are, at best, and by definition, rather rare.) In other words, V’s students score much lower on the NCLB test than they had done the previous year’s test would supposedly predict by the incomprehensibly complex mathematical data algorithm that the school district is using. There are many such models; they are not all the same.)

Teacher V is notified in late July that he/she is terminated because of those bad test scores.

Remember teacher U, who cheated? He or she might be the teacher leader for that grade level next year. And might show the others just how it’s done…

But there seems to be no awareness of this by our ‘friends’ at DQC.

We all know people who have lied to us. And we’ve all told lies before. All of us do it from time to time. We only disagree about exactly how much, and when we tell those lies, and whether they are justifiable or not. Why doesn’t DQC seem to emphasize the riskiness in all of this?

Curious, and knowing that there was no time to search through the enormous DQC website by mouse, I used their “search” engine to look for a few terms, to see if they even consider the concepts of fraud and cheating.

Here are the number of hits I got on their website:

Fraud – 0 hits. Zero.

Cheat – 1 hit; the reference pointed to a page on theft of social security numbers.

dishonest – 0 hits.

data – 750 hits on their website (that was just to make sure the search engine was working!)

erasure – 0.

erase – 0.

form – 400 (yup, it’s still working. They are very much into forms and other paperwork…)

erasing – 0 {I didn’t know if it would consider erasure, erase, and erasing differently. I still don’t, but none of them turned up anything}.

jeopardy – 0.

risk – 9 .

This last one is quite instructive. When I got those 9 hits from the word “risk”, one of the hits was the following, and I swear that I am not making this up:

“Guide to Protecting the Confidentiality of Personally Identifiable Information (PII).”

Not that that’s a bad thing, of course. Had you come across the acronym PII before? Wow. They’ve really been at this for a while, haven’t they? An entirely new set of acronyms…

The entire bureaucratic mind-set is stunning. Reminds me of nothing more than the US military and federal government bureaucracies, and I don’t know about you, but they scare me. I want as little as possible to do with them; and with that, my sympathies definitely lie with the people who rose up and fought a revolutionary war in this country for about 7 years and defeated the greatest naval and military power in the world at that time.  They didn’t want something like Big Brother watching over them. Not just the right-wingers want some privacy! I mean, I think everybody has a right to their own private life, and unless you’re the type of weirdo that likes everybody to know everything about you, there’s a lot that I, and just about all of you as well, want to keep private.

After all, for one thing, medical conditions can sometimes cause really enormous financial problems (like going bankrupt) if the wrong people find out about them — namely insurance companies. (Irony of ironies!)

Now some of the stuff on the DQC website seems very reasonable and logical, and I find no objection to at all. Individually.

But it seems to me that they really think that putting all of the quantifiable data on every person into a single database will immediately produce policy conclusions that must be promptly put into effect.

Not so fast.

What if the data you are using is utterly fraudulent in the fist place?

Wouldn’t that then be like the phony data described in various books and stories by Gulag prisoners and others in the USSR or in Kafka stories – perverse incentives to do useless things to survive by cheating. (I don’t think Kafka ever quite figured out how some people can prosper and live quite beautiful lives of luxury by cheating others.)

Are those formulas really valid? After all, you aren’t using all of that data in those conclusions you just drew. You cherry-picked the numbers you wanted to get the result you wanted using a formula of your own choosing, producing the result in a clearly visible way, or a way that appeals to certain decision-makers.

What if we use different data, different formulas, and throw out stuff that we think is invalid? Well, we’d probably get different results. And what about all of those internal TFA survey documents that apparently show no positive results, or else they would have been trumpeted in the national media?

Instead, you could use this as a data base for social “scientists” to examine and try a number of different models, and see whether stuff works. But unlike with drug or medical companies, we need to publicize the results of experiments with NEGATIVE results as well. (BTW: it’s not only companies like Glaxo or Pfizer that do this sort of selective data blackout.  I remember looking at the NIH alternative medicine website a few years ago to see what the results were for the various experiments that NIH had paid good money to fund – you know, on acupuncture and other stuff like that. I did this search many years after the studies had started. But NONE of them had any published results.

Does that mean that they were all incompetent and couldn’t finish their studies?

In that case, they should pay us (i.e., the public in the form of NIH) back with interest or penalties or something.

Or does it mean that the results weren’t published because they did not show what the authors WANTED them to show?

I suspect the latter.

It also really began to bother me that so many person-years of highly skilled, highly-paid labor had been poured into this project, linking up pretty much all of the data on every single person in every state, county, city, and every single teacher and school and every student, just about completely out of the limelight. For lots and lots of money, in other words, some of it privately raised, but I’ll bet there is a lot of taxpayer money in there as well in one way or another.

Keep in mind that a relative handful of testing-and-data companies will earn enormous revenues from processing all of this enormous database of data .

While none of us citizens have had a say on this at all.

And while so much of the data is flat out WRONG.

Which seems to be utterly ignored.

Be for real: In the entire Data Quality Campaign, is there no written acknowledgment that there is cheating and erasures on high-stakes tests? No procedures to discount and correct for that? No calls for additional forensic studies of cheating patterns?

Answer: No. The word “forensic” returned no hits at all on their website.

That’s pretty disturbing.

Or did I miss something?

==========

* no, not for money! I think that the views of teachers, parents and students in the trenches, so to speak, should be heard, and the problems with fraud and misrepresentation in test data are very serious and must be discussed. Roland Fryer’s conclusions also need to be aired. {and I speak as someone who has disagreed with him, in print, in the past.}

Published in: on January 25, 2012 at 10:53 am  Comments (1)  
Tags: , , , ,
Follow

Get every new post delivered to your Inbox.

Join 464 other followers

%d bloggers like this: