The Correlation Between ‘Value-Added’ Scores and Observation Scores in DCPS under IMPACT is, in fact, Exceedingly Weak

As I suspected, there is nearly no correlation between the scores obtained by DCPS teachers on two critical measures.

I know this because someone leaked me a copy of the entire summary spreadsheet, which I will post on the web at Google Docs shortly.

As usual, a scatter plot does an excellent job of showing how ridiculous the entire IMPACT evaluation system is. It doesn’t predict anything to speak of.

Here is the first graph.

Notice that the r^2 value is quite low: 0.1233, or about 12%. Not quite a random distribution, but fairly close. Certainly not something that should be used to decide whether someone gets to keep their job or earn a bonus.

The Aspen Institute study apparently used R rather than r*2; they reported R values of about 0.35, which is about what you get when you take the square root of 0.1233.

Here is the second graph, which plots teachers’ ranks on the classroom observations versus their ranks on the Value Added scores. Do you see any correlation?

 

Remember, this is the correlation that Jason Kamras said was quite strong.

The URI to TrackBack this entry is: https://gfbrandenburg.wordpress.com/2012/03/09/the-correlation-between-value-added-scores-and-observation-scores-in-dcps-under-impact-is-in-fact-exceedingly-weak/trackback/

RSS feed for comments on this post.

5 CommentsLeave a comment

  1. I hate you.

    Like

    • Hmm. Is this really Jason Kamras? I doubt it. And I don’t really know you personally, but if the writer (you) are really JK himself, you have had a profoundly negative impact on education all across the US. And you are probably quite proud of it, too.

      Like

  2. I thought that you DCPS got rid of Ms. Rhee. Your data seem to suggest that she is still running things. Keep us posted.

    Like

    • Her faithful henchperson and enablers are running things in dc
      However Rhee is now on the national stagecausi g trouble for teachers, students and parents.

      Like

  3. Yet when Jason Kamras was named Teacher of the Year, he didn’t believe in this shit.
    Power tends to corrupt, and absolute power corrupts absolutely.

    Like


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: