Return-Path: <nifl-assessment@literacy.nifl.gov> Received: from literacy (localhost [127.0.0.1]) by literacy.nifl.gov (8.10.2/8.10.2) with SMTP id j97MXDG20450; Fri, 7 Oct 2005 18:33:13 -0400 (EDT) Date: Fri, 7 Oct 2005 18:33:13 -0400 (EDT) Message-Id: <2716C9F0CFC0A54C8D0E1F429681AE784CEBD8@XNG.casas.org> Errors-To: listowner@literacy.nifl.gov Reply-To: nifl-assessment@literacy.nifl.gov Originator: nifl-assessment@literacy.nifl.gov Sender: nifl-assessment@literacy.nifl.gov Precedence: bulk From: "Jane Eguez" <jeguez@casas.org> To: Multiple recipients of list <nifl-assessment@literacy.nifl.gov> Subject: [NIFL-ASSESSMENT:1270] RE: FW: [NIFL-TECHNOLOGY:3795] reading digital vs. print materilas X-Listprocessor-Version: 6.0c -- ListProcessor by Anastasios Kotsikonas Content-Transfer-Encoding: 8bit Content-Type: text/plain; Status: O Content-Length: 12147 Lines: 355 -----Original Message----- From: Barbara Jacala [mailto:bjacala@guamcc.edu] Sent: Thursday, October 06, 2005 11:11 PM We've used CASAS CBT for three years now and we find that it increases our efficiency. We have year round registration so we are open for appraisal testing every Monday through Thursday at 1 PM and on Fridays at 10 AM. At intake, we have the students fill out the student entry form. We also inform the applicants that they will be taking their test on the computer. (We are ready to give them the test on pencil and paper if they insist. None have objected yet. We even tested those who are physically disabled and required someone to input for them.) We enter the student information into the server so that when they come in to take their test, all they have to do is type in their SSN and verify their identity before taking the test. Before they actually start taking the test, the proctor gives simple directions on computer use as well as navigation from screen to screen. Those who have not had computer experience quickly learn during this brief period. Operator error is always inevitable so we have a proctor moving around to check how the test takers are doing. We also have our MIS person on standby for emergency calls when a computer glitch occurs. Backing up data on the server regularly has been a procedure we have adopted. We administer our progress tests on the computer. Using CASAS CBT is so helpful since the computer automatically assigns the next test based on previous scores so we could have a room full (max of 20) of test takers taking different level tests. We do not have to start and begin together as a group, so a student can leave when they finish and another one can take over even while others are still testing. Our local One Stop Center is now proposing to have us administer CASAS appraisal to all their WIA clients and we are considering the possibility of using CBT. We use laptops for testing with an eye to making our operation portable in the future. All in all we have had very good success in using CASAS CBT and we are happy to share any information or insights with anyone. Barbara Jacala Adult Education Program Specialist Guam Community College Telephone: 671-735-5625 Excerpt from the CASAS Quarterly Fall 2003 CASAS received these comments from a community college program in Guam that is using the CASAS system, including computer-based testing: "We will be giving pre- and post-tests for the next several weeks to see where our students place. This whole system seems to be working out really well. When we encountered a problem this morning, we offered students the opportunity to take the manual (paper pencil) test; however, they asked to just come back tomorrow to take the test on the computer. The computer-based testing is really a great means for students to be introduced to the electronic world of today. Many students, especially the adult learners, are afraid of computers, but when they see how fast they get results, their fears seem to fade away. "Thank you so much for your help. It's the great support we receive from CASAS that makes your software so appealing." Marlena O.P. Montague Computer Systems Analyst Guam Community College -----Original Message----- From: nifl-technology@nifl.gov [mailto:nifl-technology@nifl.gov] On Behalf Of Mariann Fedele Sent: Friday, October 07, 2005 10:13 AM To: Multiple recipients of list Subject: [NIFL-TECHNOLOGY:3795] reading digital vs. print materilas Ira thanks for raising this question. In addition to any research you all may be able to share does any one on the list have professional wisdom or experience to share about the difference between reading in a digital vs. traditional print format? How do students respond differently to each? Do they seem more engaged using one or the other? Regards, Mariann At 09:37 AM 10/7/2005 -0400, you wrote: >As a former ABE teacher, this discussion about computer-based assessment >has raised a question for me: does anyone know of any research on the >cognitive or psycho-social differences between reading in a digital >environment vs. reading in a more traditional print format? > >At 09:23 AM 10/7/05 -0400, Howard Dooley wrote: >>Interesting discussion and comments. My program also uses the CASAS to >>place our ESL students into classes and to assess progress (for funders and >>the NRS), and we find that it is both useful and practical, particularly in >>our large-scale registrations. We use other measures and assessments to >>gather further data that is of value to the learners, instructors and to >>make program improvements. In some classes we use the listening, some the >>reading; we have begun to pilot the workplace speaking at worksite literacy >>classes which are ESOL, and instructors are reviewing the CASAS functional >>writing assessment and comparing it to the REEP to see what would fit best >>with our program structure and learners. >> >>I recently spoke with Richard Ackermann, the CASAS staff point person for >>CASAS' computerized assessments. CASAS provides several options for >>assessing learners, though the multiple-choice tests are the most familiar. >>Two of the CASAS assessment series, Life and Work & Employability >>Competency, are available as CBT -- which means the test booklet has been >>put onto the computer, no change in items. The advantage is immediate >>scoring and ease of download into an MIS. >> >>CASAS is currently working on computer adaptive testing. Richard provides >>the following description for us: CASAS is currently pilot testing computer >>adaptive testing (CAT) with a large workforce development program. The >>workforce program is using CAT in reading, math and listening. A single >>administration of a reading, math or listening CAT is used to both place the >>student in the appropriate level of training and serve as the benchmark >>pre-test for measuring gain. A principal advantage of CAT is that one test >>administration serves as both appraisal and pre-test. A further economy is >>that the examinee is administered fewer test items in a CAT than with paper >>and pencil. (Because the assessment "adapts" to each individual learner.) >>CASAS is planning a widespread release of reading CAT, math CAT and >>listening CAT in early summer 2006. >> >>With advances in technology, there will soon be a wide variety of assessment >>options available to us. As always, we should view these advances as >>expanding our opportunities to match the best method of assessment to each >>of our learners. Some of the comments earlier in the discussion seemed to >>fear that programs would "force" learners to take CBT or CAT, when that >>choice would clearly be inappropriate; just as it would be inappropriate to >>give a learner a pencil-and-paper test if the learner had no experience with >>reading, multiple-choice testing, bubble sheets, or pencils. I hope neither >>happens; and if we suspect or see it happens, that we can find a way to stop >>it, by mentoring or educating practitioners. >> >>Howard >> >> >> >> >>-----Original Message----- >>From: nifl-assessment@nifl.gov [mailto:nifl-assessment@nifl.gov] On Behalf >>Of Gustav Kocsis >>Sent: Thursday, October 06, 2005 9:19 PM >>To: Multiple recipients of list >>Subject: [NIFL-ASSESSMENT:1265] RE: FW: [NIFL-TECHNOLOGY:3792] Re: Computer >>assessment and adult learners >> >> >>We would like to see a good and easy to score paper and pencil test for our >>ESL students. We are now using the CASAS and we are finding that the CASAS >>tests are not useful to use to asses an ESL student's language ability. We >>have to register too many students at one time to be able to use computer >>testing such as the BEST PLUS. Many of our students are not very skilled >>with computers and a computer based test might not truly reflect the >>student's English skills. I know of many other large programs that would be >>interested in a valid and reliable paper and pencil ESL test for NRS >>reporting. Is there anything else out there that is better than CASAS? >> >>Gustav A. Kocsis >>English as a Second Language Coordinator Adult Basic Education Santa >>Fe Community College >>6401 Richards Ave >>Santa Fe, NM 87508 >>505-428-1444 >>Gkocsis@sfccnm.edu >> >> >>-----Original Message----- >>From: nifl-assessment@nifl.gov [mailto:nifl-assessment@nifl.gov] On Behalf >>Of Marie Cora >>Sent: Thursday, October 06, 2005 1:59 PM >>To: Multiple recipients of list >>Subject: [NIFL-ASSESSMENT:1264] FW: [NIFL-TECHNOLOGY:3792] Re: Computer >>assessment and adult learners >> >> >> >>-----Original Message----- >>From: nifl-technology@nifl.gov [mailto:nifl-technology@nifl.gov] On Behalf >>Of ra_duffy@comcast.net >>Sent: Thursday, October 06, 2005 1:16 PM >>To: Multiple recipients of list >>Subject: [NIFL-TECHNOLOGY:3792] Re: Computer assessment and adult learners >> >>If the purpose is also to assess their computer skills, I could see >>assessing via a computer. However, if a student has virtually no computer >>experience, as many of the older immigrants who are in our program do not >>have, I can not imagine adding this layer on to what is really trying to be >>assessed. >> >>-- >>Ruthann Duffy >>ESL Tech Coordinator >>Essential Skills Program >>Shoreline Community College >>16101 Greenwood Ave N. >>Seattle, WA 98133 >> >>Telephone: 206-533-6624 >>email: ra_duffy@comcast.net >>http://success.shore.ctc.edu/callab >> >> >>> Hi everyone, >>> >>> I wanted to prod you all to add your thoughts to Nancy's questions >>from >>> the other day regarding testing via computers in ABE/ESOL. What are >>> your thoughts, and what have been your experiences on this? >>> >>> I have done a little bit of work using the BEST Plus with adult >>learners >>> - but in that case, it is the teacher/test administrator who actually >>is >>> using the computer and asking questions of the test-taker. As an >>aside, >>> the great thing about this type of computer testing is that the >>software >>> program automatically stops you when the student has reached as far as >>> they can go, and it also jumps over questions that it realizes the >>> student will have no problem answering. Thus, you avoid the >>unnecessary >>> and sometimes painful process of forcing students to answer way too >>easy >>> questions, for example. >>> >>> But! This is not the situation Nancy is describing here - so do folks >>> have thoughts on adult students personally using a computer for >>> assessment purposes? I am also sending this reply to the >>> NIFL-Technology List to see if folks over there have something to >>> contribute to this discussion. >>> >>> Thanks! >>> marie >>> >>> marie cora >>> Moderator, NIFL Assessment Discussion List, and >>> Coordinator/Developer LINCS Assessment Special Collection at >>> http://literacy.kent.edu/Midwest/assessment/ >>> >>> marie.cora@hotspurpartners.com >>> >>> >>> >>> On Wed 10/5/2005, Nancy Hansen wrote: >>> >>> I also have a question to those who test using >>> > computers: Do you find the skills of the learner who has had next >>> > to NO exposure to computers and LITTLE literacy skills >>> > are accurately being portrayed via this style testing? >>> > >>> > I have men and women in our adult literacy program who had never >>> > sat down at a computer - much less used a mouse before. I cannot >>> > imagine that their extensive life skills would be evaluated >>> > appropriately when they hit and miss at the computer - sometimes >>> > even striking incorrect keys. >>> > >>> > Nancy Hansen >>> > Sioux Falls Area Literacy Council >>> > sfallsliteracy@yahoo.com >>> > >>> >>> >> >> >> >> >> > > >Ira Yankwitt, Director >Professional Development / >NYC Regional Adult Education Network >Literacy Assistance Center >32 Broadway, 10th Floor >NY, NY 10004 >(212) 803-3356 >iray@lacnyc.org > > Mariann Fedele Coordinator of Professional Development, Literacy Assistance Center Moderator, NIFL Technology and Literacy Discussion List 32 Broadway 10th Floor New York, New York 10004 212-803-3325 mariannf@lacnyc.org www.lacnyc.org
This archive was generated by hypermail 2b30 : Mon Oct 31 2005 - 09:48:53 EST