One of the The Things Wrong With Testing: They Are Invalid to Begin With!

A Test Writer Comments on New York’s Common Core Tests

by dianerav

This comment was posted yesterday:

I am a former, part time item writer for a private testing company; I wrote for many different state standards under NCLB. I must say that poorly constructed, confusing, or developmentally inappropriate items undermine the validity of standardized scores and subsequent use in teacher evaluation. When standardized tests are properly constructed, such items which might make it to a field test will almost certainly be vetted during what is typically a two year process. Many items on the Pearson math and ELA administered last April here in NY were written, in my opinion, in an intentionally confusing style using obtuse or arcane vocabulary. The ELA test in particular included confusing item stems and distractors that were not clearly wrong. There were far too many items that turned subjective opinions (most likely; best; author’s intent; etc.) into a “one right, three wrong” format. Many teachers were unsure of the correct answers on a number of vague and fuzzy items.
The math test included many items that were ridiculously convoluted. Although there may be other compelling arguments against VAM teacher evaluations, corrupt test writing, norm referencing (instead of criterion referenced scoring), and manipulating cut scores add up to a rather important set of reasons to invalidate the entire process.

About these ads
Published in: on October 23, 2013 at 2:44 pm  Comments (2)  
Tags: , ,

The URI to TrackBack this entry is: http://gfbrandenburg.wordpress.com/2013/10/23/one-of-the-the-things-wrong-with-testing-they-are-invalid-to-begin-with/trackback/

RSS feed for comments on this post.

2 CommentsLeave a comment

  1. I AGREE WITH THE WRITER of A POST ABOUT the construction and implementation of STANDARDIZED MATH ASSESSMENTS. THE PROBLEM STEMS FROM A LACK OF LEADERSHIP “and Vision”. I believe you may find my recent blog post(s) informative: http://KennethFetterman.wordpress.com

  2. There may not be a problem with this if they are doing an illegal psychological test on the children.

    “There were far too many items that turned subjective opinions (most likely; best; author’s intent; etc.) into a “one right, three wrong” format. Many teachers were unsure of the correct answers on a number of vague and fuzzy items.”


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 349 other followers

%d bloggers like this: