%% [[Assessing]] tags:: #on/assessment | #on/validity people:: #people/messick %% # Response Process Validity Lon Setnik, MD date: 2022-04-03 *The process of responding to an assessment question should be investigated and argued with using the scientific process to ensure it represents the expected assessment.* Response Process is a type of [[Validity]], related to [[Content Validity]]. An assessment contains an item, the content of that item should be assessed as part of the validity argument. How that content is responded to by the participant can also be assessed. An example below: A test is being designed to assess learner's knowledge of the way to calculate the answers for 1-10 x 1-10 tables. The question 2x6 = 12 is designed as one of the test questions. The [[Content Validity]] makes sense, because 2x6 = 12 is a subitem of the set 1-10 x 1-10. The question: 2x6 = a) 12, b) 13, c)15 The [[Response Process Validity]] would be determine by several approaches: _Indirect Evidence:_ - Eye tracking and time to respond -> these require special equipment or measurements and offer possible indirect evidence of the inner workings of the mind of the participant _Direct evidence:_ - Cognitive Interview is most popular _In the cognitive interview the goal is to externalize the thought process of the respondent._ The answerer would be asked, "As you were going through that question, how did you think about answering it?" If the answerer responded that they knew the answer must be even, and 12 was the only even number, the response process may not match the desired goal of ensuring that the respondent knows how to calculate 2x6. ## Sources: Padilla, J.-L., & Benítez, I. (2014). Validity evidence based on response processes. _Psicothema_, _26.1_, 136–144. [https://doi.org/10.7334/psicothema2013.259](https://doi.org/10.7334/psicothema2013.259)