ARTIST Logo
The CAOS test
Home Page
Item Database [Assessment Builder]
Item Database FAQ's
ARTIST Scales and CAOS Test
Assessment Resources
Research Instruments
ARTIST Publications, Presentations, and Workshops
About ARTIST
Feedback

ARTIST Testing Page
Register to use ARTIST tests
Login to
1. Request Access Code
2. Modify Access Code
3. Retrieve Reports
Q&A

CAOS - Comprehensive Assessment of Outcomes in a First Statistics course
  The CAOS test was designed to provide an instrument that would assess students’ statistical reasoning after any first course in statistics. Rather than focus on computation and procedures, the CAOS test focuses on statistical literacy and conceptual understanding, with a focus on reasoning about variability. The test was developed through a three-year process of acquiring and writing items, testing and revising items, and gathering evidence of reliability and validity.
   
Reliability Analysis
  Based on a sample of 10287 students, an analysis of internal consistency of the 40 items on the CAOS posttest produced a Cronbach’s alpha coefficient of .77.
   
Analysis of Content Validity
  There was unanimous agreement by a set of 18 expert raters that CAOS 4 measures important basic learning outcomes, and 94% agreement that it measures important learning outcomes. In addition, all raters agreed with the statement “CAOS measures outcomes for which I would be disappointed if they were not achieved by students who succeed in my statistics courses.” Although some raters indicated topics that they felt were missing from the scale, there was no agreement among these raters about the topics that were missing. Based on this evidence, the assumption was made that CAOS4 is a valid measure of important learning outcomes in a first course in statistics.
 

Our AERA 2006 paper provides more information on the psychometric analysis of CAOS.

 
Online testing format
 

Our online forced-choice testing format allows for quick summaries of the results to be sent to instructors via e-mail, as well as a spreadsheet of student records.Our online forced-choice testing format allows for quick summaries of the results to be sent to instructors via e-mail, as well as a spreadsheet of student records. A test may be given as an assessment of student learning, for research purposes or for feedback to the instructor. It may also be used as an out of class review for students.

   
If you would like to administer the CAOS test in your course, please go to https://apps3.cehd.umn.edu/artist/tests/index.html
Copyright 2006 by the Regents of the University of Minnesota. The University of Minnesota is an equal opportunity educator and employer. This page is subject to change without notice. Last modified: June 13, 2006. For questions or comments, contact Bob delMas at delma001@umn.edu