Validity and reliability

9/30/2015

Validity and Reliability

info

Vũ Hữu Thành.
Finance and Banking Faculty
0938.077.776


1


9/30/2015

• Refers to the approximate truth of an inference.
• Encompasses the entire experimental concept and
establishes whether the results obtained meet all of
the requirements of the scientific research method.

2


9/30/2015

Validity typology
• Statistical conclusion validity,
• Internal validity,
• Construct validity, and
• External validity

Cook and Campbell (1979)

Validity typology
1. Statistical Conclusion Validity: The validity of inferences about the
correlation (covariation) between treatment and outcome.
2. Internal Validity: The validity of inferences about whether observed
covariation between A (the presumed treatment) and B (the presumed
outcome) reflects a causal relationship from A to B as those variables
were manipulated or measured.
3. Construct Validity: The validity of inferences about the higher order
constructs that represent sampling particulars.
4. External Validity: The validity of inferences about whether the causeeffect relationship holds over variation in persons, settings, treatment
variables, and measurement variables.

3


9/30/2015

Refers "repeatability" or "consistency". A
measure is considered reliable if it would
give us the same result over and over.

4


9/30/2015

Types of Reliability Estimation
• Inter-Rater or Inter-Observer Reliability: Used to assess the degree to

which different raters/observers give consistent estimates of the same
phenomenon.
• Test-Retest Reliability: Used to assess the consistency of a measure
from one time to another.
• Parallel-Forms Reliability: Used to assess the consistency of the results of
two tests constructed in the same way from the same content domain.
• Internal Consistency Reliability: Used to assess the consistency of
results across items within a test.

Q
A

5