Module 1 Twiz

includes every single member of a specific group

varibale of interest measured in the population

a subset of the population that should genrally be representative of the population, often used when collecting data on the entire population is unrealistic

variable of interest measured in the sample

how well scores represent the variable they are measuring; are you measuring what you say you are?

refers to the consistency of the data; how repeatable is the measurement
time dependent
example) stepping on the scale twice, you should get the same weight

evidence that is collected by personal experiences and not in a systematic manner; considered a lower value in scientific occupations and may lead to error

evidence that is collected and documented by scientific experimentation

a research and scientific-based guess to a specific question or phenomenon

interpretation and judgement of a score

the act or process of assessing

instrument or tool used to mkae a particular measurement
consists of: equipment, procedures, rules, and scoring system

includes every single member of a specific group

may be considered a "holy grail", if you cna predict it, you can prevent it

set goals to help with motivation and progress tracking

helps in terms of performance, cna be both positive and negative

determines success in occupations and sports

motivation, evaluation of achievement and improvement, diagnosis, prescription, research, program evaluation, placement or classification, prediction, grading, development of norms or standards, public relations

create a question
examine previous research
finalize hypothesis
experiment
analyze results
draw conclusions
report results

measurents; validity and reliability

has a greater risk of bias
examples) essay, short answer tests, gynmastics judging, RPE, surveys

lower risk of bias
examples) HR (using monitor), VO2max, ventilatory threshold, height/weight, multiple choice tests

formative
this helps us to finish "forming" the program

summative feedback

examples) percentiles, ACT scores, GRE scores, averages

drivers license examination - C
How does your cholesterol compare to national distributions? - N
letter grades based on a percentage of points earned - C
board of certification examination - C
COVID diagnostic testing - C
SAT/ACT testing - N
Blood pressure - hypertension - C
BMI category - C
How does your weight compare to national weight distributions? - N

think, does this meet the criteria?
meets a certain pre-determined value

the underlying characteristic we wish to assess

X = t + e

x - score the person recieves
t - the persons true score if the test works properly
e - measurement error

sum of all the sources of error that affect the test-taker's score; can be negative or positive (does not signify "good" or "bad")

- should be easy to understand and specify...
- administration procedures
- instructions on performance
- scoring procedure and the policy on incorrect performance
- pointers on key techniques or aspects of performance to ensure trustworthy scores

- the tester (collecting, administering, judging)
- the test-taker
- the test
- the environoment (built/physical, atmospheric, social context of the day of testing)

- prepare participants for testing
- explain the test tasks clearly
- ensure that the testers are trained
- use a reliable instrument or test protocol
- ensure an optimal testing environment

based on practicality and feasibility
- think about group size, age range, time, equipment
- must be valid first (most important thing)

indoors; removes the enironmental variability and constraing (constant setting)

1. test selection
2. preparation
3. administration
4. data processing
5. decision-making and feedback

summative feedback

reliability - consistency
validity - reliability + relevance; "truthfulness"
discrimination - need to differentiate between people and constructs; not a bad thing in testing
practicality - feasibility within constrains of tester and environment (cost, time)
mass testability - ability to test many people at one time
documentation - test manual and other information

fairness
safety
privacy and confidentiality
data ownership and protection
"positve" experience