Definition of Validity
Validity refers to the appropriateness of the interpretation of the results and not to the test itself, though colloquially we speak about a test being valid.
Category of Validity
>> Content/Face validity
- Content validity addresses the match between test questions and the content or subject area they are intended to assess
- Face Validity refers to the extent to which a test or the questions on a test appear to measure a particular construct as viewed by examinees
A criterion-related validation study can be either predictive of later behavior or a concurrent measure of behavior or knowledge.
- Predictive validity refers to the "power" or usefulness of test scores to predict future performance.
- Concurrent Validity needs to be examined whenever one measure is substituted for another, such as allowing students to pass a test instead of taking a course.
>> Validity of constructs
- Construct validity refers to the degree to which a test or other measure assesses the underlying theoretical construct it is supposed to measure.
- Divided into two:
- Convergent validity consists of providing evidence that two tests that are believed to measure closely related skills or types of knowledge correlate strongly. That is to say, the two different tests end up ranking students similarly.
- Discriminant validity, by the same logic, consists of providing evidence that two tests that do not measure closely related skills or types of knowledge do not correlate strongly
Factors that influence the validity
- Preparation of questions paper
- Preparation of marking scheme
- assesment of answer scheme.
Definition of Reability
Determining of Reability
Measures the reability of a test solely on the number of items on the test and the intercorrelation among the items. Therefore, it compares each item to every other item.
> Test-retest reliability
measured by computing the correlation coefficient between scores of two administrations.
> Inter-rater reability
whenever you use humans as a part of your measurement procedure, you have worry about wherther the result you get are reliable or consistent.
refer to determining a correlation between the first half of the measurement and the second half of the measurement.
For example we would expect answer to the first half to be similar to the second half.
Factor that affecting reability
> Administrator factors
poor or unclear direction given during administration or inaccurate scoring can affect reability.