Exploring Individual and Item Factors that Affect Assessment Validity for Diverse Learners: Results from a Large-Scale Cognitive Lab
| Title: | Exploring Individual and Item Factors that Affect Assessment Validity for Diverse Learners: Results from a Large-Scale Cognitive Lab |
|---|---|
| Language: | English |
| Authors: | Winter, Phoebe C., Kopriva, Rebecca J., Chen, Chen-Su |
| Source: | Learning and Individual Differences. 2006 16(4):267-276. |
| Availability: | Elsevier. 6277 Sea Harbor Drive, Orlando, FL 32887-4800. Tel: 877-839-7126; Tel: 407-345-4020; Fax: 407-363-1354; e-mail: usjcs@elsevier.com; Web site: http://www.elsevier.com |
| Peer Reviewed: | Y |
| Page Count: | 10 |
| Publication Date: | 2006 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Elementary Education Grade 3 Grade 5 |
| Descriptors: | Individual Characteristics, Second Language Learning, Grade 5, Grade 3, Student Reaction, Validity, English (Second Language), Item Analysis, Problem Solving, Mathematics, Test Items, Anxiety |
| DOI: | 10.1016/j.lindif.2007.01.001 |
| ISSN: | 1041-6080 |
| Abstract: | A cognitive lab technique (n=156) was used to investigate interactions between individual factors and item factors presumed to affect assessment validity for diverse students, including English language learners. Findings support the concept of "access"--an interaction between specific construct-irrelevant item features and individual characteristics that either permits or inhibits student response to the targeted measurement content of an assessment item. Access issues of 3rd and 5th grade students were explored at three stages during problem solving on mathematics items: 1) apprehension of task demands; 2) formulation of a solution; and 3) articulation of a solution. Adequacy of access at these levels appears to affect student performance. In particular, where students were able to experience increased apprehension in the first stage through the provision of item variations consistent with their individual access needs, they were more likely to formulate correct solution strategies. The implications of these findings are discussed and suggestions for future research are offered. |
| Abstractor: | Author |
| Entry Date: | 2007 |
| Accession Number: | EJ756105 |
| Database: | ERIC |
| ISSN: | 1041-6080 |
|---|---|
| DOI: | 10.1016/j.lindif.2007.01.001 |
| Published in: | Learning and Individual Differences |
| Language: | English |