Week 5: Validity
Validity is concerned with whether an assessment actually measures what it purports to measure. When we are measuring validity, then we are not measuring the test, but we are measuring the actual use of the test. Validation measures let the counselors know if and what they can infer from the results of any given assessment. The responsibility to use assessments that are valid for the specific testing event, is completely given to the counselor. This is true because a test can be valid for one use, but not for another! Does this make sense?
For instance, if a counselor has a (fictional) JHU Exit Exam for all counselors, would that test be valid as an indicator for doctoral readiness for UMUC’s doctoral program? Its original purpose was to determine if test takers had mastered enough of the counseling program content to achieve a passing score. As the interpretation is extended to one of determining readiness for a doctoral level program, the link between the validation evidence and the intended interpretation becomes more and more tenuous. Does this mean the test cannot be used for another purpose? No, but it does mean that additional validation evidence will be required for that specific use of that specific assessment since it is to be used for another purpose than what it was intended for.
There are several categories of validation measures – content validation, criterion-related validation, and construct validity. As counselors evaluate the validity of assessments and measures currently on the market, they should examine the huge amount of evidence available that indicates whether or not that assessment can be used for that specific purpose. There are many journal articles available online for this research, as well as many good texts in our libraries.
Session Objectives
By the end of this week, you will:
- Define validity and explain its importance in the context of assessment
- Define the term “construct” and provide examples of constructs examined in psychological and eduational assessment
- Describe and identify major threats to validity
- Explain the relationship between validity and reliability
- Describe the major sources of validity evidence and provide examples of the procedures used for assessing each source
- Explain how to evaluate a criterion
- Explain how validity coefficients are interpreted
- Explain the importance of considering the consequences of testing in the validation process
- Identify and describe the ethical standards of professional organizations related to assessment
