Models of Validity

Models of Validity

Models of Validity

Compare and contrast these two models in terms of how they conceptualize validity.

Discussion Models of Validity

Description
Validity: The Test Doth Purport Too Much, Methinks
In your unit readings, you read about two approaches or models of validity—trinitarian and unitary. In some ways, these two models are competing views of gathering evidence for a test’s validity. In other ways, the two approaches have an overlap of elements.

In your post:

Compare and contrast these two models in terms of how they conceptualize validity.
Identify at least one advantage and disadvantage of each model.
Decide which model appears to be the most valid for determining validity of a test.
Explain your decision in terms of the implications for decision making about a test’s validity.
Be sure to include citations from Guion’s 1980 article, “On Trinitarian Doctrines of Validity,” and Messick’s 1995 article, “Validity of Psychological Assessment: Validation of Inferences From Persons’ Responses and Performances As Scientific Inquiry Into Score Meaning.”

Mental models are shortcuts for reasoning. They are a set of ideas and beliefs that we consciously or unconsciously form based on our experiences to shape our representation of how the world works. While mental models are extremely useful to make decisions in times of uncertainty, they are still shortcuts—which can be harmful if we don’t take a step back to evaluate them.

Lucky for us, scientists have already devised a system we can take inspiration from. Evaluating the result of a chain of events and decisions is something that needs to be done every day in scientific research. In particular, scientists need to evaluate the validity and reliability of their measures.

Validity and reliability of mental models
Validity: is the mental model accurate?
In scientific research, validity is the extent to which a concept is accurately measured. To put it simply: are we measuring the right thing? As healthcare professionals Roberta Heale and Alison Twycross put it: “A survey designed to explore depression but which actually measures anxiety would not be considered valid.”

When it comes to mental models, questioning the validity of a mental model is equivalent to asking yourself: is this the right mental model for the situation? There are many mental models, and it may be that you apply the margin of safety mental model, when really you should be paying attention to your illusion of control.

Validity does not say anything about the mental model itself. Instead, it helps evaluate how appropriate and accurate a mental model is in a specific situation.

Reliability: is the mental model consistent?
Reliability is the consistency of a mental model when applied repeatedly under similar circumstances. Do you get the same result when you apply this mental model repeatedly?

Roberta Heale and Alison Twycross share a good illustration to understand the relationship between validity and reliability: “A simple example of validity and reliability is an alarm clock that rings at 7:00 each morning, but is set for 6:30. It is very reliable (it consistently rings the same time each day), but is not valid (it is not ringing at the desired time).”

Get a 10 % discount on an order above $ 100
Use the following coupon code :
NRSCODE