Skip to main content

Kendall's Tau (τ): Rank-Order Correlation

Overview​

Kendall's tau (τ), developed by Maurice Kendall (1938), is a non-parametric bivariate correlation coefficient that measures the degree of agreement between two sets of rankings. Unlike Spearman's Rho — which is essentially Pearson r applied to ranks — Kendall's tau operates on a fundamentally different logic: it counts concordant and discordant pairs and computes the proportion of agreement net of disagreement.

Kendall's tau is the preferred choice when:

  • Sample size is small (N ≤ 30)
  • Data involves judge/rater agreement
  • Ties are present in the rankings
  • The probabilistic interpretation of agreement matters more than magnitude of rank differences

4.4 Core Logic: Concordant and Discordant Pairs​

The engine of Kendall's tau is a count of pairs of observations:

  • Concordant pair: For subjects ii and jj, if the relative order on Variable X matches the relative order on Variable Y — i.e., (Rxi−Rxj)(R_{xi} - R_{xj}) and (Ryi−Ryj)(R_{yi} - R_{yj}) have the same sign → both agree on which subject ranks higher
  • Discordant pair: If the relative order on X disagrees with the relative order on Y — the two signs are opposite
  • Tied pair: When either difference equals zero — assigned a value of 0 in the S calculation

The S Statistic​

S represents the net agreement across all pairs:

S=(number of concordant pairs)−(number of discordant pairs)S = \text{(number of concordant pairs)} - \text{(number of discordant pairs)}

  • S = +N(N−1)/2 → all pairs concordant → τ = +1.00 (perfect positive agreement)
  • S = −N(N−1)/2 → all pairs discordant → τ = −1.00 (perfect negative agreement)
  • S = 0 → equal concordance and discordance → τ = 0 (no agreement)

4.4.1 Assumptions and Background​

  1. Both variables are at ordinal (rank-order) level — or have been converted to ranks
  2. N subjects/objects each have two observations (one on X, one on Y)
  3. Can be applied to judge agreement — e.g., two raters independently ranking N candidates
  4. Appropriate for N ≤ 30; for larger samples, a Z approximation is used

Null Hypothesis​

H0:τ=0(no correlation between ranks of X and Y in the population)H_0: \tau = 0 \quad \text{(no correlation between ranks of X and Y in the population)}


4.5 Step-by-Step Procedure: Kendall's Tau​

STEP 1: Rank observations on Variable X from 1 to N; rank observations on Variable Y from 1 to N.

STEP 2: Rearrange subjects so that X ranks are in natural order (1, 2, 3, ... N).

STEP 3: Observe the Y ranks in the order they occur when X is sorted.

STEP 4: For each Y rank, count how many ranks to its right are larger (agreements) and subtract those that are smaller (disagreements). Sum all these values to get S.

STEP 5: If no ties → apply the simple formula. If ties → apply the correction formula.

STEP 6: Test significance using the appropriate table or Z approximation.


Worked Example 1: Without Ties​

Setup​

Four objects (A, B, C, D) are rated by two judges (X and Y) out of 10.

ObjectJudge X ScoreJudge Y Score
A68
B84
C59
D26

Step 1: Convert to Ranks​

ObjectX RankY Rank
A33
B41
C24
D12

Step 2–3: Rearrange by X Rank and Extract Y Ranks​

X Rank1 (D)2 (C)3 (A)4 (B)
Y Rank2431

Step 4: Compute S​

Working left to right through the Y ranks (2, 4, 3, 1):

Y RankAgreements (larger to right)Disagreements (smaller to right)Net
22 (ranks 4 and 3 are both > 2)1 (rank 1 < 2)+1
40 (nothing > 4 to the right)2 (ranks 3 and 1 < 4)−2
30 (nothing > 3 to the right)1 (rank 1 < 3)−1
1——0
TotalS = −2

Step 5: Calculate τ​

τ=2SN(N−1)=2(−2)4(3)=−412=−0.33\tau = \frac{2S}{N(N-1)} = \frac{2(-2)}{4(3)} = \frac{-4}{12} = -0.33

Interpretation: τ = −0.33 indicates a weak negative agreement — the two judges tend to rank objects in somewhat opposite orders, but the agreement is not strong.


Worked Example 2: With Ties​

When tied ranks occur in either X or Y, a correction factor is applied.

The Tie Correction Formula​

τ=2S[N(N−1)−Tx][N(N−1)−Ty]\tau = \frac{2S}{\sqrt{[N(N-1) - T_x][N(N-1) - T_y]}}

Where:

  • Tx=∑t(t−1)T_x = \sum t(t-1) for each group of tied X observations, tt = number tied
  • Ty=∑t(t−1)T_y = \sum t(t-1) for each group of tied Y observations

Example with Social Status and Yielding Ranks (N = 12)​

Given: S = 25 (computed by the concordant/discordant counting method)

Tied ranks on Y: Three pairs of tied ranks:

  • Ranks 1.5 (2 subjects tied): t=2t = 2, t(t−1)=2t(t-1) = 2
  • Ranks 3.5 (2 subjects tied): t=2t = 2, t(t−1)=2t(t-1) = 2
  • Ranks 10.5 (2 subjects tied): t=2t = 2, t(t−1)=2t(t-1) = 2

Ty=2+2+2=6T_y = 2 + 2 + 2 = 6

No ties on X: Tx=0T_x = 0

τ=2×25[12(11)−0][12(11)−6]=50132×126=5016632=50128.97≈0.39\tau = \frac{2 \times 25}{\sqrt{[12(11) - 0][12(11) - 6]}} = \frac{50}{\sqrt{132 \times 126}} = \frac{50}{\sqrt{16632}} = \frac{50}{128.97} \approx 0.39

Without tie correction: τ = 0.38. The correction makes a small but principled adjustment.

When is the Tie Correction Important?

The correction is small unless ties are numerous or involve large groups. Always apply it when ties exist — it's the principled approach and SPSS/R do it automatically.


4.6 Significance Testing​

Sample SizeMethod
N ≤ 10Upper-tail probability table for τ
10 < N ≤ 30Critical value table for τ
N > 30Z approximation: z=3τN(N−1)2(2N+5)z = \frac{3\tau\sqrt{N(N-1)}}{\sqrt{2(2N+5)}}

For the Z approximation, use two-tailed α = .05 → reject H₀ if |Z| > 1.96.


4.6.1 Comparison of Kendall's Tau and Spearman's Rho​

FeatureSpearman Rho (ρ)Kendall Tau (τ)
LogicPearson r on ranks — uses rank differencesCounts concordant vs. discordant pairs
ScaleSame scale as Pearson rDifferent scale — numerically smaller
ComparabilityComparable to Pearson r interpretationCannot be directly compared to ρ
ComputationSimplerMore tedious (pair counting)
TiesSimple correctionPrincipled correction formula
Best forGeneral rank correlations; larger samplesJudge agreement; small N; probabilistic interpretation
Efficiency vs. Pearson r~91%~91%
Large-sample behaviourNormal approximationNormal approximation

The Mathematical Inequality​

While τ and ρ cannot be directly compared, they are bounded by:

−1≤3τ−2ρ≤1-1 \leq 3\tau - 2\rho \leq 1

This guarantees that very large discrepancies between τ and ρ on the same data are mathematically impossible — they measure related but distinct aspects of the same relationship.


Self-Assessment Questions​

Level 1 — Recall​

  1. What is the difference between a concordant pair and a discordant pair in Kendall's tau?

  2. What is the value of τ when all pairs are concordant? When all pairs are discordant?

  3. Under what condition should the tie-correction formula be used instead of the simple tau formula?

Level 2 — Application​

  1. Five candidates are ranked by two interviewers. Interviewer X ranks: 1, 2, 3, 4, 5. Interviewer Y ranks (after sorting by X): 2, 1, 4, 3, 5. Compute S (count concordant/discordant pairs) and then compute τ.

  2. In the tie-correction example, if TyT_y were 12 instead of 6, would τ increase or decrease? Compute the new τ (S = 25, N = 12, TxT_x = 0, TyT_y = 12) and explain the direction of change.

Level 3 — Critical Thinking​

  1. A researcher computes Spearman ρ = 0.62 and Kendall τ = 0.41 on the same data. A colleague says: "The Spearman result shows stronger correlation." Evaluate this statement. Can the two values be compared directly?

  2. Under what specific research scenario would you choose Kendall's tau over Spearman's Rho, even if both could technically be applied? What does Kendall's tau offer that Rho does not in terms of interpretation?


🧠 Memory Aid​

"CARD for Kendall's Tau":

  • Concordant pairs: same order on X and Y → contribute +1
  • Arrange X ranks in natural order (1 to N) first
  • Right-side counting: for each Y rank, count larger values to the right (agreements) minus smaller (disagreements)
  • Divide 2S by the total possible pairs: τ=2S/N(N−1)\tau = 2S / N(N-1)

Tie correction mnemonic: "Tx and Ty shrink the denominator" — ties reduce the maximum possible S, so the formula adjusts by subtracting TxT_x and TyT_y from the denominator terms.


📚 External Resources​

Foundational Reading​

Tutorials​

Videos​

Research Articles​

  • 📄 Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1/2), 81–93. (Original paper)
  • 📄 Gilpin, A. R. (1993). Table for conversion of Kendall's tau to Spearman's rho within the context of measures of magnitude of effect for meta-analysis. Educational and Psychological Measurement, 53(1), 87–92.
  • 📄 Croux, C., & Dehon, C. (2010). Influence functions of the Spearman and Kendall correlation measures. Statistical Methods & Applications, 19(4), 497–515.

Source PDFs: