AI-Assisted Assessment of Inquiry Skills in Socioscientific Issue Contexts

Authors: Wen Xin Zhang (ORCID 0000-0002-0198-7674), John J. H. Lin (ORCID 0000-0001-7784-9609), Ying-Shao Hsu (ORCID 0000-0002-1635-8213)

Source: Journal of Computer Assisted Learning. 2025 41(1).

Peer Reviewed: Y

Page Count: 18

Descriptors: Artificial Intelligence, Computer Assisted Testing, Inquiry, Active Learning, Science Education, Social Influences, Political Influences, Influence of Technology, Scoring Rubrics, Comparative Testing, Evaluation Criteria, Interrater Reliability

Test-Retest and Inter-Rater Reliability for Selected Outcomes from a Wearable 3D Inertial Sensor over Different Stable and Unstable Postural Conditions: A Validation Study

Authors: Samuel D'Emanuele (ORCID 0000-0001-6232-9870), Francesca Nardello (ORCID 0000-0001-8942-3920), Fabrizio Garau (ORCID 0009-0007-1564-2347), Diego Campaci (ORCID 0009-0008-4238-2146), Federico Schena (ORCID 0000-0002-2052-5117), Cantor Tarperi (ORCID 0000-0002-7208-9484)

Source: Measurement in Physical Education and Exercise Science. 2025 29(1):98-112.

Peer Reviewed: Y

Page Count: 15

Descriptors: Human Posture, Measurement Equipment, Interrater Reliability, Measurement Techniques, Young Adults, Test Reliability, Validity, Foreign Countries

Geographic Terms: Italy

The Vague Language Use Scale: Clinical Utility and Psychometrics from Adults with Traumatic Brain Injury

Authors: Kathryn J. Greenslade (ORCID 0000-0001-6269-4624), Julia K. Bushell, Emily F. Dillon (ORCID 0000-0002-9362-7085), Amy E. Ramage (ORCID 0000-0001-8554-555X)

Source: International Journal of Language & Communication Disorders. 2025 60(1).

Peer Reviewed: Y

Page Count: 18

Sponsoring Agency: National Institute on Deafness and Other Communication Disorders (NIDCD) (DHHS/NIH)

Descriptors: Neurological Impairments, Head Injuries, Language Impairments, Language Tests, Language Skills, Test Validity, Test Reliability, Communication Problems, Error of Measurement, Measurement Techniques, Rating Scales, Interrater Reliability

Profiling Communication Ability in Dementia: Validation of a New Cognitive-Communication Assessment Tool

Authors: Suzanna Dooley (ORCID 0000-0002-7627-7773), Tammy Hopper, Rachael Doyle, Orla Gilheaney, Margaret Walshe (ORCID 0000-0003-3924-8073)

Source: International Journal of Language & Communication Disorders. 2025 60(1).

Peer Reviewed: Y

Page Count: 10

Descriptors: Communication Skills, Communication Problems, Dementia, Intellectual Disability, Cognitive Measurement, Profiles, Test Validity, Interrater Reliability, Foreign Countries, Scores, Longitudinal Studies, Correlation

Geographic Terms: Ireland, Canada

Statistically Guided Grading Judgements: Contextualisation or Contamination?

Authors: Louise Badham (ORCID 0000-0003-0411-1827)

Source: Oxford Review of Education. 2025 51(1):17-35.

Peer Reviewed: Y

Page Count: 19

Descriptors: Advanced Placement Programs, Grading, Interrater Reliability, Evaluative Thinking, Evaluation Criteria, Statistical Data, Teacher Attitudes, Error of Measurement, Scoring, Scoring Rubrics, Context Effect, Bias

Informant Discrepancies in Universal Screening as a Function of Student and Teacher Characteristics

Authors: Brittany N. Zakszeski (ORCID 0000-0002-0503-7879), Heather E. Ormiston, Malena A. Nygaard (ORCID 0000-0002-5265-2073), Kane Carlock

Source: School Psychology Review. 2025 54(1):128-142.

Peer Reviewed: Y

Page Count: 15

Sponsoring Agency: Department of Education (ED)

Descriptors: Middle School Students, Middle School Teachers, Screening Tests, Affective Behavior, At Risk Students, Student Characteristics, Teacher Characteristics, Interrater Reliability, Testing Problems

Do Source Use Features Impact Raters' Judgment of Argumentation? An Experimental Study

Authors: Ping-Lin Chuang (ORCID 0000-0003-2907-5324)

Source: Language Testing. 2025 42(1):48-72.

Peer Reviewed: Y

Page Count: 25

Descriptors: Interrater Reliability, Evaluators, Information Sources, Primary Sources, Persuasive Discourse, Evaluative Thinking, Evaluation Criteria, Evaluation Methods, Second Language Learning, Writing Tests, Achievement Rating, Causal Models

Geographic Terms: Illinois (Urbana)

Content Validity Report for Rivet Education's Scoring and Evidence Guide (SEG)

Authors: Melanie Livet, Caryn S. Ward, Amelia Krysinski, National Implementation Research Network (NIRN)

Source: National Implementation Research Network. 2024.

Peer Reviewed: N

Page Count: 21

Descriptors: Professional Development, Directories, Databases, Instructional Materials, Content Validity, Test Validity, Scoring Rubrics, Information Retrieval, Evaluation Criteria, Interrater Reliability, Gateway Systems, Teachers, Teacher Educators

Development of an artificial intelligence-based measure of therapists’ skills: A multimodal proof of concept.

Authors: Aafjes-van Doorn, Katie, ORCID 0000-0003-2584-5897. Faculty of Arts and Sciences, New York University Shanghai, Shanghai, China, kav9239@nyu.edu, Cicconet, Marcelo. Deliberate AI, New York, NY, US, Bate, Jordan. Ferkauf Graduate School of Psychology, Yeshiva University, New York, NY, US, Cohn, Jeffrey F.. Deliberate AI, New York, NY, US, Aafjes, Marc. Deliberate AI, New York, NY, US

Source: Psychotherapy, Feb 03, 2025.

NLM Title Abbreviation: Psychotherapy (Chic)

Publisher: US : Educational Publishing Foundation

Other Journal Titles: Psychotherapy: Theory, Research & Practice; Psychotherapy: Theory, Research, Practice, Training

Other Publishers: US : Division of Psychotherapy (29), American Psychological Association

Supplemental Data: Tables and Figures Internet

Publication Type: Journal; Peer Reviewed Journal

Objective structured therapeutic examination (OSTE) for the assessment of psychodynamic intervention competencies in psychotherapy trainees.

Authors: Nikendei, Christoph. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany, Montan, Inka, ORCID 0000-0002-8638-5823. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany, inka.montan@med.uni-heidelberg.de, Stölting, Julia. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany, Ehrenthal, Johannes C.. Department of Psychology, University of Cologne, Cologne, Germany, Storck, Timo. Department of Clinical Psychology and Psychotherapy, Psychologische Hochschule Berlin, Berlin, Germany, Taubner, Svenja. Centre for Psychosocial Medicine, Institute of Psychosocial Prevention, Heidelberg University Hospital, Heidelberg, Germany, Friederich, Hans-Christoph. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany, Schauenburg, Henning. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany, Schultz, Jobst-Hendrik. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany, Dinger, Ulrike. Department of General Internal Medicine and Psychosomatics, Centre for Psychosocial Medicine, Heidelberg University Hospital, Heidelberg, Germany

Source: Training and Education in Professional Psychology, Vol 19(1), Feb, 2025. pp. 26-36.

NLM Title Abbreviation: Train Educ Prof Psychol

Publisher: US : Educational Publishing Foundation

Publication Type: Journal; Peer Reviewed Journal

Assessing adherence and competence in delivering telehealth group cognitive behavioral stress management.

Authors: May, Marcella, ORCID 0000-0002-5413-8334. Department of Psychology, University of Miami, Coral Gables, FL, US, marcellahmay@gmail.com, Ream, Molly. Department of Psychology, University of Miami, Coral Gables, FL, US, Milrad, Sara F.. Department of Psychiatry, University of Maryland, Baltimore, MD, US, Perdomo, Dolores M.. Department of Psychiatry, University of Miami, Coral Gables, FL, US, Czaja, Sara J.. Department of Medicine, Weill Cornell Medical College, Cornell University, Ithaca, NY, US, Jutagir, Devika R.. Department of Psychiatry and Behavioral Sciences, Memorial Sloan Kettering Cancer Center, New York, NY, US, Hall, Daniel L.. Department of Psychiatry, Harvard Medical School, Harvard University, Cambridge, MA, US, Klimas, Nancy. Department of Clinical Immunology, Nova Southeastern University, Davie, FL, US, Antoni, Michael H.. Department of Psychology, University of Miami, Coral Gables, FL, US

Source: International Journal of Stress Management, Vol 31(4), Nov, 2024. pp. 329-335.

NLM Title Abbreviation: Int J Stress Manag

Publisher: US : Educational Publishing Foundation

Other Publishers: Netherlands : Kluwer Academic/Human Sciences Press

Supplemental Data: Tables and Figures Internet

Publication Type: Journal; Peer Reviewed Journal

Updated guidelines on selecting an intraclass correlation coefficient for interrater reliability, with applications to incomplete observational designs.

Authors: ten Hove, Debby, ORCID 0000-0002-1335-4452. Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, Netherlands, D.tenHove@uva.nl, Jorgensen, Terrence D., ORCID 0000-0001-5111-6773. Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, Netherlands, van der Ark, L. Andries, ORCID 0000-0003-3131-7943. Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, Netherlands

Source: Psychological Methods, Vol 29(5), Oct, 2024. pp. 967-979.

NLM Title Abbreviation: Psychol Methods

Publisher: US : American Psychological Association

Publication Type: Journal; Peer Reviewed Journal

Synthesizing Validity and Reliability Evidence for the Draw-A-Scientist Test

Authors: Julia Brochey-Taylor, Joseph A. Taylor

Source: Educational Research and Reviews. 2024 19(3):44-52.

Peer Reviewed: Y

Page Count: 9

Descriptors: Cognitive Tests, Freehand Drawing, Personality Measures, Projective Measures, Scientists, Stereotypes, Test Reliability, Test Validity, Construct Validity, Predictive Validity, Interrater Reliability, College Students

Assessment and Survey Identifiers: Draw a Person Test

Automated Classification of Elementary Instructional Activities: Analyzing the Consistency of Human Annotations

Authors: Jonathan K. Foster (ORCID 0000-0002-7842-6277), Peter Youngs (ORCID 0000-0002-1711-1749), Rachel van Aswegen, Samarth Singh, Ginger S. Watson (ORCID 0000-0001-7197-1654), Scott T. Acton (ORCID 0000-0003-3288-1255)

Source: Journal of Learning Analytics. 2024 11(3):142-159.

Peer Reviewed: Y

Page Count: 18

Sponsoring Agency: National Science Foundation (NSF)

Descriptors: Learning Analytics, Automation, Classification, Artificial Intelligence, Algorithms, Natural Language Processing, Learning Activities, Video Technology, Interrater Reliability, Validity, Educational Research, Elementary Education, Documentation

Development and Validation of the Tablet-Based ERAL Nonverbal Intelligence Test 5-17 (ERAL-NIT)

Authors: Ercümend Ersanli (ORCID 0000-0003-4840-3629), Ali Kilicarslan (ORCID 0000-0001-9306-4430)

Source: Open Journal for Educational Research. 2024 8(1):1-16.

Peer Reviewed: Y

Page Count: 16

Descriptors: Intelligence Tests, Nonverbal Tests, Test Construction, Test Validity, Test Reliability, Interrater Reliability, Cognitive Tests, Children, Adolescents, Handheld Devices, Content Validity, Autism Spectrum Disorders, Attention Deficit Disorders, Language Impairments, Clinical Diagnosis, Diagnostic Tests

The Underlying Cognitive Processes of Thin Slices Judgments on Teaching Quality

Authors: Konstantin Vinokic, Lukas Begrich, Mareike Kunter, Susanne Kuger

Source: Frontline Learning Research. 2024 12(3):69-98.

Peer Reviewed: Y

Page Count: 30

Descriptors: Teacher Effectiveness, Teacher Student Relationship, Foreign Countries, Classroom Observation Techniques, College Students, Psychological Studies, Video Technology, Opinions, Association Measures, Interrater Reliability, Social Cognition, Reflection, Measurement Techniques, Evaluation Methods

Geographic Terms: Germany

The Reliability of Using ChatGPT in Rating EFL Writings

Authors: Yang Yang (ORCID 0000-0003-3114-0682)

Source: Shanlax International Journal of Education. 2024 12(4):49-59.

Peer Reviewed: Y

Page Count: 11

Descriptors: English (Second Language), Second Language Instruction, Writing (Composition), Evaluation Methods, Artificial Intelligence, Written Language, Interrater Reliability, Foreign Countries, College Students

Geographic Terms: China

Toward Greater Transparency and Inclusion in Manuscript Review Processes: A Relational Model

Authors: Alison Cook-Sather (ORCID 0000-0002-0116-7158), Ruth L. Healey (ORCID 0000-0001-6872-4900)

Source: Teaching & Learning Inquiry. 2024 12.

Peer Reviewed: Y

Page Count: 23

Descriptors: Peer Evaluation, Academic Language, Writing (Composition), Interrater Reliability, Evaluation Methods, Feedback (Response), Equal Education, Inclusion, Professionalism, Pragmatics, Policy, Learning Strategies, Teacher Effectiveness

The Feasibility and Effectiveness of Life Science in STEM Practical Learning Environment

Authors: King-Dow Su (ORCID 0000-0001-5248-5589)

Source: Journal of Baltic Science Education. 2024 23(1):151-163.

Peer Reviewed: Y

Page Count: 13

Descriptors: STEM Education, Content Validity, Instructional Effectiveness, Interrater Reliability, Food, Experiential Learning, Cooking Instruction, Thinking Skills, Instructional Design, Entrepreneurship, Measures (Individuals), Undergraduate Students, Tourism, Foreign Countries

Geographic Terms: Taiwan

Teachers or ChatGPT: The Issue of Accuracy and Consistency in L2 Assessment

Authors: Ramy Shabara, Khaled ElEbyary, Deena Boraie

Source: Teaching English with Technology. 2024 24(2):71-92.

Peer Reviewed: Y

Page Count: 22

Descriptors: Foreign Countries, Artificial Intelligence, Scoring Rubrics, Student Evaluation, Writing Evaluation, Grading, Computer Uses in Education, English (Second Language), Language Teachers, Accuracy, Interrater Reliability

Geographic Terms: Egypt