The three usual criteria for assessments from the psychometric perspective - reliability, validity, and utility - are discussed in this paper in the context of alternate assessments that are individualized for students with severe cognitive disabilities. Possible sources of data for documentation of the technical quality of alternate assessments are discussed. Some suggestions for developing alternate assessments are presented. Alternate assessments can arise from a need to represent, in a broad (e.g., statewide) assessment and accountability system, students with the most significant cognitive disabilities, whose levels of cognitive functioning are below that needed for instruction and assessment using the content and achievement standards and/or formats expected of students in the general (regular) instructional program. Students who participate in alternate assessments are expected to be rare (i.e., a maximum of 1% by 2014, as implied by current federal guidelines) and expectations are often tailored to their individual needs based on discussions of committees (e.g., an IEP, or Individualized Education Program, or similar team)