Psychological - Lecture 2 Validity & Reliability (Catherine) Part 2
This deck WAIS shows high internal consistency (r = 0.887) and acceptable test-retest reliability (r = 0.82), though slightly outside ideal limits.
What are the Internal Consistency and Test-Retest Reliabilities of the WAIS and MMPI?
Internal Consistency of WAIS: r = 0.887
Internal Consistency of MMPI: r = 0.84
Test-Retest Reliabilities of the WAIS: r = 0.82
Test-Retest Reliabilities of the MMPI: r = 0.74
NB: WAIS test-retest is just outside acceptable limits
the MMPI is suseptable to change over time as its a personality inventory used on clinical patients whoa re more likely to change over time
Key Terms
What are the Internal Consistency and Test-Retest Reliabilities of the WAIS and MMPI?
Internal Consistency of WAIS: r = 0.887
Internal Consistency of MMPI: r = 0.84
Test-Retest Reliabilities of the WAIS: r = 0.82
Te...
What type of reliability would a test administrator be assessing if they utilised a Kuder-Richardson, Chronbach's Alpha or Spearman-Brown?
The Test Administrator would be assessing a tests Internal Consistency
A Correlation coefficient can be used to check all other types of reliability except Internal Consistency. What are these types of reliability?
Test-Retest Reliability
Alternate Form Reliability
Inter-scorer Relaibility
What factors does a Test Administrator need to bear in mind when measuring reliability?
Is the test measuring state or trait? (trait is more enduring)
The range of possible responses (ideally 5-7 responses - 0 - 10 is not ideal a...
There are seven methods utilised to improve reliability, what are they?
Quality of items (need to be clear, concise, homogeneous)
Ensure consistent testing conditions
Reduce Test-Retest time intervals
...
There are 3 classes of Validity, what are they?
Internal Validity
External Validity
Test Validity
Related Flashcard Decks
Study Tips
- Press F to enter focus mode for distraction-free studying
- Review cards regularly to improve retention
- Try to recall the answer before flipping the card
- Share this deck with friends to study together
| Term | Definition |
|---|---|
What are the Internal Consistency and Test-Retest Reliabilities of the WAIS and MMPI? | Internal Consistency of WAIS: r = 0.887 Internal Consistency of MMPI: r = 0.84 Test-Retest Reliabilities of the WAIS: r = 0.82 Test-Retest Reliabilities of the MMPI: r = 0.74 NB: WAIS test-retest is just outside acceptable limits the MMPI is suseptable to change over time as its a personality inventory used on clinical patients whoa re more likely to change over time |
What type of reliability would a test administrator be assessing if they utilised a Kuder-Richardson, Chronbach's Alpha or Spearman-Brown? | The Test Administrator would be assessing a tests Internal Consistency |
A Correlation coefficient can be used to check all other types of reliability except Internal Consistency. What are these types of reliability? | Test-Retest Reliability Alternate Form Reliability Inter-scorer Relaibility |
What factors does a Test Administrator need to bear in mind when measuring reliability? | Is the test measuring state or trait? (trait is more enduring) The range of possible responses (ideally 5-7 responses - 0 - 10 is not ideal as people tend to cluster around the middle) Speeded tests - towards end of test test taker may not have had time to attempt a number of items, does not mean they would have been incorrect, did not get time to answer |
There are seven methods utilised to improve reliability, what are they? | Quality of items (need to be clear, concise, homogeneous) Ensure consistent testing conditions Reduce Test-Retest time intervals Longer assessments Develop a robust scoring plan Test items for reliability & adapt the measure Ensure Validity |
There are 3 classes of Validity, what are they? | Internal Validity External Validity Test Validity |
What is Internal Validity interested in? | | Relevant to Experimental Validity Confidence in making causal statements about study outcomes |
What is External Validity interested in? | | Relevant to Experimental Validity Confidence you can generalise results to people outside of the study |
What is Test Validity interested in? | | Relevant to this Unit!!!! Confidence that what you are measuring truly represents what you think you are measuring |
What are the 3 forms of assessing test validity? | Content Validity Criterion-Related Validity Construct Validity |
There are 3 traditional measures of test validity, name them | Content Validity Criterion-Related Validity Construct Validity |
There are 3 methods to assess each of these forms of validity, what are they? | Scrutinise test contents Comparing Scores on this test to other tests Perform an analysis of how scores on this test relate to scores on other tests and theories |
There is another form of validity, Face Validity, what is it? | Face Validity relates to whether the person being assessed believes the test appears to measure what is actually being measured |
Which is the most important form of validity? | Construct Validity |
What are the implications for low face validity | indirectly tests some aspect not perceived by the test-taker (e.g. MMPI asks about icecream as part of a personality assessment) may result in negative consequences such as poor test taker attitude, or disgruntlement Some tests have low face validity and others have high face validity |
What does Content Validity assess? | Content Validity Scrutinises the test's content |
What is Content Validity concerned with? | Content validity is concerned with how well does each item on the test measure what it intends to measure? Tests should capture all aspects of the target behaviour e.g. for HR test items should directly relate to the job role we are hiring for |
How do we measure Content Validity? | -We use a Content Validity Ratio (CVR - Lawshe, 1975) -We ask N number of experts to rate each item to reflect performance on an item in terms of essential, useful, not necessary -We remove items based on % of people who state the item is not necessary If less than 5% say necessary/essential it should be removed |
What does Criterion-Related Validity assess? | Criterion-Related Validity relates scores obtained on the current test to other test scores or other measures |
What is Criterion-Related Validity & what are the 2 varieties of Criterion-Related Validity? | Criterion-Related Validity is a judgement of how adequately a test score can be used to infer an individual's most probable standing on some measure of interest. The two varieties of Criterion-Related Validity are: *Concurrent Validity *Predictive Validity |
What is Criterion-Related Validity concerned with? | Criterion-Related Validity is interested in how well the test item reflect an individual's actual score on the criterion of interest |
What are the types of Criterion-Related Validity? | Concurrent Criterion-Related Validity -The degree to which the score relates to the criterion measure at that time (measure a new test against a gold standard) Predictive Criterion-Related Validity -Degree to which the score relates to a criterion measure in the future (i.e. uses regression to predict a person's future reading ability) |
What is Concurent Criterion-related Validity? | Concurrent Validity is an index of the degree to which a test score is related to some criterion masuree obtained at the same time |
What are the important considerations when assessing Criterion-Related Validity? | Is the criterion: -Relevant -Valid & Reliable -Uncontaminated We need to ensure the test we are comparing is relevant, valid, reliable & uncontaminated, hence we use gold standard tests rather than just random other tests |
How does one measure Concurrent Validity? | By performing a correlation and comparing how well the outcome of the new test compares with the outcome of a well-known, reliable, well-validated test |