This webinar is freely available to all.
Arguing for validity: Structured evidence-based validation practice to improve PRO measurement
Description
Modern validation practice requires a network of empirical evidence to determine what scores mean in relation to the theory of the construct being measured within a specific context and for a specific measurement purpose. The 2014 Standards for Educational and Psychological Testing 5 sources of validity evidence framework facilitates validation planning according to the validity research question being asked. Qualitative and quantitative research methods enable validity testing across the 5 sources: 1. The content of a measure; 2. the ways in which respondents process (cognitively engage with and respond to) items; 3. the extent to which the internal relationships of items conform to the scale construct; 4. the patterns of score relationships to other variables, as predicted by the construct; and 5. validity and intended and unintended consequences of measurement. This webinar reviews the evolution of validity testing theory and describes the 5 sources of validity evidence framework of the Standards, positioning it as a planning and reporting format for PROM validation studies. Examples of research questions and methods for evidence generation will be provided. The webinar will emphasize the importance of minimizing measurement biases and maximizing accurate, useful, and equitable PRO measurement in diverse populations. Importantly, rather than viewing validation as a binary notion of an instrument being valid or not valid, the focus of this webinar is on modern views of validation as a clear and coherent evidence-based argument (or rationale) about the extent to which score-based inferences are valid within a context and for a specific purpose.
Intended AudienceModern validation practice requires a network of empirical evidence to determine what scores mean in relation to the theory of the construct being measured within a specific context and for a specific measurement purpose. The 2014 Standards for Educational and Psychological Testing 5 sources of validity evidence framework facilitates validation planning according to the validity research question being asked. Qualitative and quantitative research methods enable validity testing across the 5 sources: 1. The content of a measure; 2. the ways in which respondents process (cognitively engage with and respond to) items; 3. the extent to which the internal relationships of items conform to the scale construct; 4. the patterns of score relationships to other variables, as predicted by the construct; and 5. validity and intended and unintended consequences of measurement. This webinar reviews the evolution of validity testing theory and describes the 5 sources of validity evidence framework of the Standards, positioning it as a planning and reporting format for PROM validation studies. Examples of research questions and methods for evidence generation will be provided. The webinar will emphasize the importance of minimizing measurement biases and maximizing accurate, useful, and equitable PRO measurement in diverse populations. Importantly, rather than viewing validation as a binary notion of an instrument being valid or not valid, the focus of this webinar is on modern views of validation as a clear and coherent evidence-based argument (or rationale) about the extent to which score-based inferences are valid within a context and for a specific purpose.
All people involved in developing, choosing and using PROMs.
Level of Knowledge Needed
Basic
Audience Benefits
This webinar will provide the audience with an overview of:
- An introduction to the evolution of validity testing theory.
- Description of the 5 sources of validity evidence framework as proposed by the 2014 Standards for Educational and Psychological Testing: 1) content, 2) response processes, 3) internal structure, 4) relations to other variables, and 5) the intended and unintended consequences of measurement.
- Examples of validity testing research questions and evidence generation methods (qualitative and quantitative).
- Factors for minimizing measurement biases and ensuring accurate, useful (actionable), and equitable PRO measurements in diverse populations.
- Using the 5 sources of validity evidence framework for reporting validation studies and describing how the evidence might inform the plausibility of a validity rationale.
Learning Outcomes/Objectives
At the end of this webinar, attendees will be able to:
- Describe each of the Standard’s five sources of validity evidence.
- Formulate a measurement validation plan to answer research questions related to the kinds of evidence needed to interpret PRO data in context and for a measurement purpose.
- Choose appropriate qualitative and quantitative methods to generate evidence based on each source of evidence to ensure accurate, useful (actionable), and equitable PRO measurements.
- Craft a reporting format for presenting validity evidence based on each of the five sources.
Together with
Recording Policy
Photography, video or audio recording (including screen capture) of ISOQOL courses, sessions, digital materials, or ISOQOL graphics without written permission from ISOQOL is strictly prohibited.
Note that photographs and video recordings taken by or on behalf of ISOQOL is the property of ISOQOL.