Test Development

15 flashcardsby AdUvert
Study these flashcardsFree · spaced repetition · iPhone, Android, Mac & web

All cards

1
A psychometrician is designing a new scale to measure work-related burnout among healthcare workers. After reviewing existing tools, she notices that current inventories fail to capture stressors unique to telemedicine. At which stage of test development is she currently operating?
  • Test construction
  • Test conceptualization
  • Test tryout
  • Item analysis
2
An instructor creates a final exam for an advanced statistics course. The exam is structured so that students who have mastered the learning competencies pass, regardless of how their peers perform. This assessment is best classified as a:
  • Comparative scaling test
  • Criterion-referenced test
  • Ipsatively scored test
  • Norm-referenced test
3
A research team drafts the initial item pool for a 30-item standardized personality inventory. To ensure a comprehensive sampling of the construct domain and account for items that will be eliminated during tryout, how many initial items should they ideally write?
  • 15 items
  • 30 items
  • 60 items
  • 150 items
4
A test developer writes the following item for an employee engagement survey: "I feel valued by my supervisor and I am satisfied with my current salary." What error in item writing does this item exhibit?
  • Acquiescence bias
  • Double-barreled construction
  • Excessive reading difficulty
  • Redundant content
5
To prevent respondents from agreeing with statements indiscriminately without reading them carefully, a researcher includes both positively and negatively phrased items on a scale. What response bias is the researcher trying to counteract?
  • Acquiescence
  • Extreme responding
  • Faking good
  • Social desirability
6
A researcher presents participants with a list of 30 statements regarding ethical conduct and asks them to rank the statements from "most justifiable" (1) to "least justifiable" (30). What scaling method is being employed?
  • Categorical scaling
  • Comparative scaling
  • Guttman scaling
  • Method of paired comparisons
7
An attitude scale measuring stance on environmental policy includes statements ordered sequentially such that endorsement of an extreme statement (e.g., "All fossil fuel use should be banned immediately") implies agreement with all milder preceding statements. What scaling model is this?
  • Category scale
  • Guttman scale
  • Likert scale
  • Q-sort
8
A clinician presents a patient with 50 trait cards and instructs them to arrange the cards across 9 piles, placing the least characteristic traits in Pile 1 and the most characteristic traits in Pile 9. Which assessment format is being used?
  • Checklist
  • Method of paired comparisons
  • Q-sort
  • Visual analogue scale
9
An elementary school counselor administers a self-report mood assessment to 6-year-old students using three options represented by happy, neutral, and sad face illustrations. This format is appropriate because:
  • Graphic rating scales can be used with test-takers who have limited language skills.
  • Pictorial formats guarantee high criterion-related validity.
  • Pictures turn ordinal data into ratio data.
  • Rating scales with pictures eliminate ceiling effects.
10
A test bank presents items ordered from easiest to most difficult, alternating between vocabulary definitions and arithmetic word problems of increasing complexity. What item format is illustrated here?
  • Branching format
  • Class scoring
  • Cumulative scoring
  • Spiral omnibus format
11
A computerized adaptive test (CAT) terminates early for a high-ability candidate after presenting items tailored to her previous correct responses. Which of the following is a key advantage of CAT?
  • It eliminates the need for pilot testing.
  • It ensures all test-takers answer identical items.
  • It produces ipsative data instead of normative data.
  • It provides economy in testing time and reduces floor/ceiling effects.
12
An entry-level mathematics test was given to a group of advanced engineering students. Every single student achieved a perfect score of 100%. Psychometrically, the utility of this test was compromised by a:
  • Ceiling effect
  • Floor effect
  • Scoring drift
  • Validity shrinkage
13
A career orientation inventory compares an individual's score on the "Artistic" subscale directly against their own score on the "Investigative" subscale to determine relative area of interest. This scoring approach is termed:
  • Category scoring
  • Class scoring
  • Cumulative scoring
  • Ipsative scoring
14
A psychometrician is preparing to conduct a pilot study for a newly developed 20-item motivation inventory. What is the minimum recommended sample size for this test tryout phase?
  • 20 to 40 respondents
  • 50 to 100 respondents
  • 100 to 200 respondents
  • 500 or more respondents
15
On a 100-item multiple-choice exam administered to 100 students, 85 students answered Item #12 correctly. What is the item-difficulty index (p) for Item #12, and how is it interpreted?
  • p = 0.15; Very difficult
  • p = 0.85; Very easy
  • p = 0.85; Optimum
  • p = 1.17; Easy
Study all 15 cards for free