Assumptions of Parametric and Non-Parametric Statistics & Scales of Measurement
Introductionโ
Every statistical test rests on a set of assumptions โ conditions that must be satisfied for the test results to be valid and interpretable. Choosing the wrong test, or using a test when its assumptions are violated, can lead to incorrect conclusions โ even with perfectly collected data.
Two interrelated decisions guide statistical choice: (1) Do your data meet the assumptions of parametric tests? And (2) What scale of measurement were your variables measured on? These questions are inseparable: the scale of measurement often directly determines which assumptions can be met.
๐ Source PDF: Block-1/Unit-1.pdf
๐ MPC-006 Statistics in Psychology โ Block 1: Introduction to Statistics
The Four Scales of Measurementโ
S.S. Stevens (1946) proposed the foundational classification of measurement scales โ a framework so influential it remains standard in psychology and statistics textbooks worldwide.
1. Nominal Scaleโ
The nominal scale is the most basic level of measurement. It assigns numbers or labels to categories purely for identification โ not for any mathematical purpose.
- Nature: Classifies into mutually exclusive, exhaustive categories
- Operations: Can only determine equality or inequality
- Example: Gender (male/female), blood type (A/B/AB/O), religion, caste
- Labelling: Categories may be labelled 0/1, m/f, 1/2/3 โ but these numbers have no mathematical meaning
- Statistical use: Only frequency counts and percentages; modal category
- Non-parametric test appropriate: Chi-square test
Why it's called "nominal": From Latin nomen (name) โ it's a naming scale.
2. Ordinal Scaleโ
The ordinal scale ranks data in a meaningful order, but the intervals between ranks are not equal.
- Nature: Implies rank order but not the magnitude of differences
- Operations: Can determine greater than/less than relationships
- Example: Satisfaction scale (1=very dissatisfied to 5=very satisfied); academic rank (1st, 2nd, 3rd); pain severity (mild, moderate, severe)
- Key limitation: The difference between rank 1 and rank 2 may not equal the difference between rank 4 and rank 5
- Statistical use: Median, percentiles, rank correlations
- Non-parametric tests appropriate: Mann-Whitney U, Wilcoxon, Spearman's ฯ
3. Interval Scaleโ
The interval scale has equal intervals between values โ the distance between any two consecutive values is the same โ but has no true zero point.
- Nature: Equal intervals, but zero does not mean absence of the property
- Operations: Addition and subtraction meaningful; ratios are not
- Example: Temperature in Celsius or Fahrenheit (0ยฐC does not mean no temperature); calendar years; IQ scores (an IQ of 0 doesn't mean zero intelligence)
- Properties: Two of three key requirements โ magnitude and equal intervals โ but lacks the real/absolute zero
- Statistical use: Mean, standard deviation, correlation
- Parametric tests appropriate: t-test, ANOVA, Pearson's r
4. Ratio Scaleโ
The ratio scale has all the properties of the interval scale plus a true (absolute) zero, meaning zero represents complete absence of the quantity.
- Nature: Equal intervals + true zero; ratios between values are meaningful
- Operations: All arithmetic operations are valid
- Example: Height, weight, age, length, reaction time, income, number of correct answers
- Key property: A person who is 180cm is genuinely twice as tall as a 90cm person
- Statistical use: All parametric statistics
- Parametric tests appropriate: t-test, ANOVA, regression, Pearson's r
Comparison Summaryโ
| Scale | Order | Equal Intervals | True Zero | Example | Test Type |
|---|---|---|---|---|---|
| Nominal | โ | โ | โ | Gender, Religion | Non-parametric |
| Ordinal | โ | โ | โ | Likert scale, Rank | Non-parametric |
| Interval | โ | โ | โ | Temperature (ยฐC), IQ | Parametric |
| Ratio | โ | โ | โ | Height, Reaction time | Parametric |
Assumptions of Parametric Statisticsโ
Parametric tests (t-test, F-test, Pearson's r) operate under specific assumptions. Violating these can invalidate results.
Assumption 1: Normal Distributionโ
The population from which the sample is drawn should be normally distributed โ the classic bell-shaped frequency distribution that is:
- Symmetrical about the mean
- Unimodal (one peak)
- Infinite at both ends (theoretical)
- Mean = Median = Mode
However, parametric tests (especially t and F) are considered robust โ they remain valid even when the normality assumption is mildly violated, particularly with larger samples.
Assumption 2: Interval or Ratio Scaleโ
Variables must be measured on at least an interval scale. This ensures that arithmetic operations (computing means, standard deviations) are mathematically meaningful.
Assumption 3: Independence of Observationsโ
The inclusion or exclusion of any case should not unduly affect the results. Each observation must be independent of all others. Violations occur when:
- The same participants provide multiple responses that are treated as independent
- Participants influence each other (e.g., in group settings)
- Time-series data are treated as independent
Assumption 4: Homoscedasticity (Equality of Variances)โ
The populations from which samples are drawn must have the same variance (or a known ratio of variances). This is also called homogeneity of variances and is particularly important with small samples.
The F-max test is used to check this:
F-max = Largest Variance รท Smallest Variance
If the computed F-max does not meet or exceed the critical value at p = .05, variances are considered homogeneous.
Assumptions of Non-Parametric Statisticsโ
Non-parametric tests make fewer and weaker assumptions:
Situation 1: Small Sample Sizeโ
When N is as small as 5 or 6, parametric tests cannot be applied because the normal distribution of sample means (central limit theorem) does not hold. Non-parametric tests provide the only valid alternative.
Situation 2: Non-Normal Distributionโ
When the population distribution is unknown or known to be non-normal, parametric tests are inappropriate regardless of sample size.
Situation 3: Ordinal or Nominal Dataโ
When measurements are expressed as:
- Rankings or ordinal categories
- Plus/minus signs (direction of difference only)
- Classifications like "good-bad", "improved-not improved"
Situation 4: Unknown Population Distributionโ
When the nature of the population from which samples are drawn is simply not known.
Situation 5: Nominal Form of Variablesโ
When variables are expressed purely as categories (e.g., religion, caste, type of therapy).
Variables: Types and Definitionsโ
Understanding variables is inseparable from understanding scales and assumptions:
| Variable Type | Definition | Example |
|---|---|---|
| Independent Variable (IV) | The variable considered to be a cause; manipulated by the researcher | Teaching method (lecture vs. activity-based) |
| Dependent Variable (DV) | The variable considered to be an effect; what is measured | Test score, anxiety level |
| Characteristic | Any variable that can take different values across cases | Age, IQ, gender |
Homoscedasticity โ a key parametric assumption โ requires that the DV's variance is similar across levels of the IV. If anxiety scores have much greater variance in the control group than the experimental group, homoscedasticity is violated.
Practical Guidance: Selecting the Right Testโ
Real-world complication: Likert scales (1โ5, 1โ7) used extensively in psychology are technically ordinal โ but many researchers treat them as interval. This is a longstanding controversy. In India, where attitude and satisfaction scales are commonly used in health and educational research, this decision has practical consequences for statistical analysis.
๐ External Resourcesโ
Wikipediaโ
- Level of Measurement โ Wikipedia โ Stevens's four scales explained with examples
- Statistical Assumption โ Wikipedia โ What assumptions are and why they matter
Educational Videosโ
- ๐ฅ Levels of Measurement: Nominal, Ordinal, Interval, Ratio โ Dr. Todd Grande (YouTube)
- ๐ฅ Understanding Statistical Assumptions โ StatQuest (YouTube)
Research Papersโ
- ๐ Stevens, S.S. (1946). "On the Theory of Scales of Measurement." Science, 103(2684), 677โ680. โ The original paper proposing the four scales โ one of the most cited papers in measurement theory
- ๐ Field, A. (2018). Discovering Statistics Using IBM SPSS Statistics (5th ed.). Sage. โ Standard comprehensive statistics reference
- ๐ Norman, G. (2010). "Likert scales, levels of measurement and the 'laws' of statistics." Advances in Health Sciences Education, 15(5). โ Influential debate on treating Likert scales as interval
Additional Resourcesโ
- ๐ SPSS Statistics Tutorials โ IBM
- ๐ GraphPad Statistics Guide โ Free Online
- ๐ APA Style Statistics Reporting Guide
- ๐ NCERT Statistics Resources โ Indian context
๐ง Memory Aid: NOIR Scalesโ
N โ Nominal: Names/Categories only (gender, religion)
O โ Ordinal: Order matters (1st, 2nd, 3rd) but intervals don't
I โ Interval: Equal intervals, no true zero (temperature ยฐC, IQ)
R โ Ratio: Real zero + all operations valid (height, weight, age)
Parametric assumptions โ HINDI:
H โ Homoscedasticity (equal variances)
I โ Independence of observations
N โ Normal distribution
D โ Data on interval/ratio scale
I โ Inferential goal: estimating population parameters
โ Self-Assessment Questionsโ
Level 1 โ Recallโ
- Name the four scales of measurement in order from lowest to highest level.
- What is homoscedasticity and why is it important for parametric tests?
Level 2 โ Understandingโ
- A researcher measures "years of education" (0โ25 years). What scale of measurement is this? Is it appropriate for parametric tests? Explain.
- Why does an interval scale lack a true zero? Give two examples to illustrate this limitation.
Level 3 โ Application & Analysisโ
- A study in India measures participants on the following variables: (a) Caste category (SC/ST/OBC/General), (b) Self-reported stress level on a 1โ10 scale, (c) Systolic blood pressure in mmHg, (d) Rank in school class (1st to 40th). For each variable, identify the scale of measurement and state whether parametric or non-parametric analysis is appropriate, with justification.
Summaryโ
The four scales of measurement โ nominal, ordinal, interval, and ratio โ directly determine which statistical analyses are appropriate. Parametric tests require at least interval-scale data, normally distributed populations, independent observations, and homogeneous variances. Non-parametric tests apply when these conditions cannot be met: with small samples, ordinal or nominal data, non-normal distributions, or unknown population characteristics. Understanding these assumptions is not bureaucratic box-ticking โ it is the foundation of statistically sound and ethically responsible research.
Previous โ Parametric vs Non-Parametric Foundations
Next โ Parametric Statistical Tests: t-test, F-test, and Pearson's r