Content validity studies.
C. Content validity studies. Reports of content validity for a selection procedure should include the following information:
(1) User(s), location(s) and date(s) of study. Dates and location(s) of the job analysis should be shown (essential).
(2) Problem and setting. An explicit definition of the purpose(s) of the study and the circumstances in which the study was conducted should be provided. A description of existing selection procedures and cutoff scores, if any, should be provided.
(3) Job analysis—Content of the job. A description of the method used to analyze the job should be provided (essential). The work behavior(s), the associated tasks, and, if the behavior results in a work product, the work products should be completely described (essential). Measures of criticality and/or importance of the work behavior(s) and the method of determining these measures should be provided (essential). Where the job analysis also identified the knowledges, skills, and abilities used in work behavior(s), an operational definition for each knowledge in terms of a body of learned information and for each skill and ability in terms of observable behaviors and outcomes, and the relationship between each knowledge, skill, or ability and each work behavior, as well as the method used to determine this relationship, should be provided (essential). The work situation should be described, including the setting in which work behavior(s) are performed, and where appropriate, the manner in which knowledges, skills, or abilities are used, and the complexity and difficulty of the knowledge, skill, or ability as used in the work behavior(s).
(4) Selection procedure and its content. Selection procedures, including those constructed by or for the user, specific training requirements, composites of selection procedures, and any other procedure supported by content validity, should be completely and explicitly described or attached (essential). If commercially available selection procedures are used, they should be described by title, form, and publisher (essential). The behaviors measured or sampled by the selection procedure should be explicitly described (essential). Where the selection procedure purports to measure a knowledge, skill, or ability, evidence that the selection procedure measures and is a representative sample of the knowledge, skill, or ability should be provided (essential).
(5) Relationship between the selection procedure and the job. The evidence demonstrating that the selection procedure is a representative work sample, a representative sample of the work behavior(s), or a representative sample of a knowledge, skill, or ability as used as a part of a work behavior and necessary for that behavior should be provided (essential). The user should identify the work behavior(s) which each item or part of the selection procedure is intended to sample or measure (essential). Where the selection procedure purports to sample a work behavior or to provide a sample of a work product, a comparison should be provided of the manner, setting, and the level of complexity of the selection procedure with those of the work situation (essential). If any steps were taken to reduce adverse impact on a race, sex, or ethnic group in the content of the procedure or in its administration, these steps should be described. Establishment of time limits, if any, and how these limits are related to the speed with which duties must be performed on the job, should be explained. Measures of central tend- ency (e.g., means) and measures of dispersion (e.g., standard deviations) and estimates of realibility should be reported for all selection procedures if available. Such reports should be made for relevant race, sex, and ethnic subgroups, at least on a statistically reliable sample basis.
(6) Alternative procedures investigated. The alternative selection procedures investigated and available evidence of their impact should be identified (essential). The scope, method, and findings of the investigation, and the conclusions reached in light of the findings, should be fully described (essential).
(7) Uses and applications. The methods considered for use of the selection procedure (e.g., as a screening device with a cutoff score, for grouping or ranking, or combined with other procedures in a battery) and available evidence of their impact should be described (essential). This description should include the rationale for choosing the method for operational use, and the evidence of the validity and utility of the procedure as it is to be used (essential). The purpose for which the procedure is to be used (e.g., hiring, transfer, promotion) should be described (essential). If the selection procedure is used with a cutoff score, the user should describe the way in which normal expectations of proficiency within the work force were determined and the way in which the cutoff score was determined (essential). In addition, if the selection procedure is to be used for ranking, the user should specify the evidence showing that a higher score on the selection procedure is likely to result in better job performance.
(8) Contact person. The name, mailing address, and telephone number of the person who may be contacted for further information about the validity study should be provided (essential).
(9) Accuracy and completeness. The report should describe the steps taken to assure the accuracy and completeness of the collection, analysis, and report of data and results.