[NIFL-ASSESSMENT:1209] RE: Developing a test, EFF Style

From: Marie Cora (marie.cora@hotspurpartners.com)
Date: Fri Aug 05 2005 - 13:36:26 EDT


Return-Path: <nifl-assessment@literacy.nifl.gov>
Received: from literacy (localhost [127.0.0.1]) by literacy.nifl.gov (8.10.2/8.10.2) with SMTP id j75HaQG11930; Fri, 5 Aug 2005 13:36:26 -0400 (EDT)
Date: Fri, 5 Aug 2005 13:36:26 -0400 (EDT)
Message-Id: <013001c599e5$73dc11d0$0602a8c0@frodo>
Errors-To: listowner@literacy.nifl.gov
Reply-To: nifl-assessment@literacy.nifl.gov
Originator: nifl-assessment@literacy.nifl.gov
Sender: nifl-assessment@literacy.nifl.gov
Precedence: bulk
From: "Marie Cora" <marie.cora@hotspurpartners.com>
To: Multiple recipients of list <nifl-assessment@literacy.nifl.gov>
Subject: [NIFL-ASSESSMENT:1209] RE: Developing a test, EFF Style
X-Listprocessor-Version: 6.0c -- ListProcessor by Anastasios Kotsikonas
X-Mailer: Microsoft Outlook, Build 10.0.2627
Content-Transfer-Encoding: 7bit
Content-Type: text/plain;
Status: O
Content-Length: 2983
Lines: 89

Dear everyone,

The following is from Peggy McGuire, who regrets not being able to write
more at the moment (busy, busy!).  We thank Peggy for this contribution,
and perhaps we'll hear more from her another day.  The EFF Resource
Collection can be found at:
http://eff.cls.utk.edu/resources/default.htm

Thanks,
marie



The EFF Assessment Resource Collection includes the publication
Improving Performance, Reporting Results that describes in exhaustive
detail the development and appropriate use of prototype EFF assessments
for Read with Understanding (RWU), including test specifications and
samples of high-stakes assessments for each EFF level of RWU.

Peggy McGuire, M.A.
Senior Research Associate and Equipped for the Future National
Consultant
Center for Literacy Studies
The University of Tennessee
111 5th Street, PO Box 16
Mt. Gretna, PA 17064
717-964-1341 (p/f)
215-888-6507 (cell)
mcguirep555@aol.com


-----Original Message-----
From: nifl-assessment@nifl.gov [mailto:nifl-assessment@nifl.gov] On
Behalf Of Marie Cora
Sent: Thursday, August 04, 2005 1:52 PM
To: Multiple recipients of list
Subject: [NIFL-ASSESSMENT:1204] Developing a test

Hello everyone,

I thought perhaps this might be of interest to some of you, given the
discussions that have been taking place as of late:

"Update on Pilot ABE Test Process"

This is an overview of the work that Massachusetts has done to develop
high stakes assessments that are aligned with the state ABE curriculum
frameworks.  It is a joint project between Mass. DOE Adult and Community
Learning Services and UMass, Amherst's Center for Educational
Assessment.

Go to:
http://www.doe.mass.edu/acls/mailings/2005/0513/assess.html
and scroll down until you see 
"Update on Pilot ABE Test Process"

It's all fascinating, and I find these pieces to be extraordinary:
-that more than 80 practitioners wrote items for the test (go teachers
go!)
-that nearly 5000 tests had been taken by ABE students in the pilot
phases (wow!)

I'm mostly posting this here because it does give you a very good sense
of what it actually entails to do such a monumental task.  Much time,
many people, and I've no doubt much money (but to the latter I cannot
speak, except that I don't doubt it).

So - these tests are Selected Response (multiple choice), and it looks
as if they will try and make them computer adaptive as well.

It makes me wonder about other test development - particularly EFF and
the accompanying assessments that are being developed.  I'll assume that
those assessments are Constructed Response (the person creates the
response; i.e.:  performance assessment).  Can anyone speak to the EFF
development of assessments at all?  We'd be interested in hearing about
that.

Looking for Assessment Definitions?  You can go to:
LINCS Special Collection in Assessment at
http://literacy.kent.edu/Midwest/assessment/
or
Adult Literacy Education Wiki (ALEWiki) at
http://wiki.literacytent.org/index.php/AleAssessment

Thanks,
marie



This archive was generated by hypermail 2b30 : Mon Oct 31 2005 - 09:48:52 EST