Level of Significance — Previous Year Questions

📊 Topic Overview

Metric	Value
Papers Appeared	9 of 27 (33.3%)
Priority	🟡 MEDIUM
Section Distribution	Sec A: ~3
Most Repeated	"Describe steps in setting up the level of significance." / "Level of significance (short note)."

🎯 Must-Know Concepts

1. Level of significance (α): the probability of making a Type I error
2. Conventional levels: 0.05 and 0.01
3. Critical region and critical values
4. Steps in setting up the level of significance
5. One-tailed vs two-tailed critical regions

---

🔥 Most Repeated Question

Common phrasings:

• "Describe steps in setting up the level of significance."
• "Delineate the steps in setting up the level of significance."
• "Level of significance (short note)."
• "Discuss the concept of level of significance."

Answer (Section B or C — ~200 words):

Level of Significance (α) is the probability value at which the researcher decides to reject the null hypothesis. It defines the boundary between "statistically significant" and "not statistically significant" results.

Definition: The level of significance is the maximum probability of committing a Type I error (rejecting a true null hypothesis) that the researcher is willing to accept. Conventionally, α = 0.05 (5%) or α = 0.01 (1%).

Steps in Setting Up the Level of Significance:

1. State the null hypothesis (H₀): Clearly define what "no effect" or "no difference" means in the context of the study.

2. Choose the level of significance (α): Based on the consequences of Type I error. Use α = 0.01 when a false positive would be costly (medical research, legal contexts). Use α = 0.05 for most behavioural and social science research.

3. Determine whether the test is one-tailed or two-tailed: A directional prediction uses one-tailed test (entire α in one tail). A non-directional prediction uses two-tailed test (α/2 in each tail).

4. Identify degrees of freedom (df): df depends on sample size and the type of test.

5. Find the critical value: Using the appropriate statistical table (z, t, F, χ²) at the chosen α and df.

6. Define the critical region: The area beyond the critical value in the tail(s) of the sampling distribution. Any obtained statistic falling in this region leads to rejection of H₀.

Relationship with Type I Error: α directly equals the probability of Type I error. Lowering α (e.g., from 0.05 to 0.01) reduces the risk of falsely rejecting H₀, but increases the risk of Type II error.

Confidence Level: If α = 0.05, the confidence level = 1 − α = 0.95 (95%). This means we are 95% confident in retaining correct decisions.

---

🧠 Memory Aid

α = 0.05: In 100 hypothesis tests, we expect to commit a Type I error about 5 times by chance alone, even if H₀ is always true.

---

📚 Related Content

• Setting Up Significance: Steps and Critical Region
• Levels of Significance and Confidence Limits
• Hypothesis Testing: Logic and Process

✅ Self-Assessment

1. What does α = 0.05 mean?
2. List the six steps in setting up the level of significance.
3. What is the critical region?
4. How does α relate to Type I error?
5. What is the difference between significance level and confidence level?

💡 Exam Tips

• Section C (3 marks): Definition of α → Conventional values (0.05, 0.01) → Critical region → Relationship with Type I error.
• Level of significance is often a component within Hypothesis Testing answers — prepare it as a standalone topic AND within the 7-step procedure.
• Always mention both 0.05 and 0.01 levels and when each is appropriate.