All Revision Notes

COM6005 Statistical Modeling · Module 3a

One-sample & Two-sample t-tests

COM6005 · Module 3a · Source: Module3a_T-test-forMean_L02_complete.pdf (35 slides)

Contents · 13 sections

🎯 本講重點 (Learning outcomes)

  • 用 parametric test flowchart 揀啱 test:1-sample t / Z test、paired t、2-sample (independent) t、1-way ANOVA。
  • 理解點解用 t 而唔用 Z(σ\sigma 未知、n 細;t 有 heavier tails,df 越大越似 Z)。
  • One-sample t-test:寫 H0/H1H_0/H_1、計 T=(yˉ−μ0)/(s/n)T=(\bar y-\mu_0)/(s/\sqrt n)、查 t-table(df=n−1df = n - 1)、用 p-value 決定。
  • 識講三個等價 decision rule(T vs ppf、cdf、p-value)同 one-sided / two-sided 嘅 rejection rule。
  • 由 two-sided decision rule 推出 Confidence interval。
  • Two-sample:paired design(計差 W 再做 one-sample t)vs completely randomized design(pooled variance sps_p,df=n+m−2df = n + m - 2)。

⭐ 考試必溫 Top-5

  1. One-sample t:T=yˉ−μ0s/nT = \dfrac{\bar y - \mu_0}{s/\sqrt n},df=n−1df = n - 1;腫瘤例 T=2.076>1.833T = 2.076 > 1.833 → reject H0H_0(p=0.0339p = 0.0339)。
  2. 查 t-table:n=10n = 10、α=5%\alpha = 5\%(one-sided)→ 1.833 = t.ppf(0.95, 9);two-sided 用 α/2\alpha/2。
  3. Rejection rules:μ>μ0\mu > \mu_0 → T>tα,n−1T > t_{\alpha,n-1};μ<μ0\mu < \mu_0 → T<−tα,n−1T < -t_{\alpha,n-1};μ≠μ0\mu \ne \mu_0 → ∣T∣>tα/2,n−1|T| > t_{\alpha/2,n-1}。
  4. CI:yˉ±tα/2,n−1 s/n\bar y \pm t_{\alpha/2,n-1}\, s/\sqrt n。
  5. Paired(t=Wˉ/(S/n)t = \bar W/(S/\sqrt n),df = 對數 − 1)vs Independent(pooled sps_p,df=n+m−2df = n + m - 2);分辨題目屬邊種 design。

1. 揀邊個 test?Parametric Test Flowchart

Slide 2 嘅 flowchart(Test for Means, 1 Factor):

情況條件Test
1 Sample(同 target mean 比較)Sample size n<30n < 301 Sample t Test
1 Sample(同 target mean 比較)Sample size n>30n > 30Z Test
2 SamplesIndependent data2 Sample t Test(equal variance → pooled SD;unequal variance → unpooled SD)
2 SamplesPaired dataPaired t Test
> 2 Samples1-Way ANOVA
⭐ 考試重點

考題通常俾一個情境,要你講用邊個 test 同點解:幾多組?同一班人前後量(paired)定兩班唔相關嘅人(independent)?n 大定細?

2. Z-distribution vs t-distribution

Slide 3 嘅圖:Normal (Z) 同 t-distribution (df=5,10,30df = 5, 10, 30) 疊埋比較。t 都係對稱鐘形,但中間矮少少、兩邊 tails 厚啲;df 越大越貼近 Z,df=30df = 30 已經同 Z 幾乎重疊。

Z-testt-test
σ\sigma(population SD)已知(或 n 大,用 s 近似)未知,用 sample SD s 估計
Sample sizen>30n > 30n<30n < 30(細 sample)
DistributionN(0,1)N(0, 1)t with df=n−1df = n - 1
Critical value(one-sided α=0.05\alpha = 0.05)1.645例:df=9df = 9 → 1.833(較大)
💡 直覺理解

用 s 代替 σ\sigma 會帶多一層不確定性(s 本身都係估出嚟),所以 t 嘅 tails 厚啲,critical value 大啲——要更極端嘅證據先 reject H0H_0。n 越大,s 越準,t 就越接近 Z(t-table 最底 ∞ 行 = Z 值:1.645、1.960、2.326、2.576)。

3. One-sample t-test:設定

Slide 4:「病人接受治療後,情況整體有冇改善?」

Slide 5:

  • Situation:只有一欄數據 y1,y2,…,yny_1, y_2, \dots, y_n。
  • Objective:檢查治療後腫瘤大細。Variable = 腫瘤大細嘅變化(+ve 代表腫瘤縮細)。
  • H0:Population mean≤0H_0: \text{Population mean} \le 0(腫瘤增大或不變);H1:Population mean>0H_1: \text{Population mean} > 0(腫瘤縮細)。
  • H0H_0 同 H1H_1 必須 mutually exclusive(唔重疊)同 collectively exhaustive(包晒所有可能)。
  • 例:Y = the decrease in tumor size after treatment。問:有冇證據顯示治療有用?即 test H0:μ≤0H_0:\mu\le 0 against H1:μ>0H_1:\mu>0。
  • 因為量度有誤差,即使治療無效,sample mean 都唔會剛好 = 0。How large is large? → 要 t-test 去判斷。
⚠️ 留意

Slide 5 原文喺 H0/H1H_0/H_1 嘅括號入面有劃線修改(decrease / increases 對調過)。正確理解:Y = 縮細量(+ve 好);H0:μ≤0H_0: \mu \le 0(冇改善:腫瘤增大或不變);H1:μ>0H_1: \mu > 0(有改善)。

4. One-sample t-test:Procedure

Slide 6:

T=yˉs/n(當 μ0=0)一般:T=yˉ−μ0s/nT = \frac{\bar y}{s/\sqrt n} \quad(\text{當 } \mu_0 = 0)\qquad\text{一般:}\quad T = \frac{\bar y - \mu_0}{s/\sqrt n}
s2=(X1−Xˉ)2+⋯+(Xn−Xˉ)2n−1s^2 = \frac{(X_1-\bar X)^2 + \cdots + (X_n - \bar X)^2}{n-1}
  • 需要一個 critical value(取決於 significance level α\alpha)。如果 T 大過 critical value,就當 T 夠大、改善嘅證據夠強 → reject H0H_0。
  • 傳統上 critical value 喺 t-table 查。

4.1 查 t-table(slides 7–8)

Slide 7 嘅 t-table(“Percentage Points tα,νt_{\alpha,\nu} of the t Distribution”):column = α\alpha(significance level,右尾面積),row = ν=n−1\nu = n - 1(degree of freedom),格入面 = critical value(x 軸值)。

⭐ 查表步驟(slide 8)
  1. Degree of freedom:one-sample 問題 ν=n−1\nu = n - 1。
  2. Level of significance α\alpha:5%(較低標準 reject H0H_0)或 1%(較高標準)。
  3. 例:n=10n = 10、α=5%\alpha = 5\% → 行 ν=9\nu = 9、欄 .05 → critical value = 1.833。
  4. Python:scipy.stats.t.ppf(0.95, 9) = 1.833(t-distribution with ν=9\nu = 9 嘅 95% quantile)。

常用值(from table):

ν\nuα=.05\alpha = .05α=.025\alpha = .025α=.01\alpha = .01α=.005\alpha = .005
42.1322.7763.7474.604
61.9432.4473.1433.707
81.8602.3062.8963.355
91.8332.2622.8213.250
∞1.6451.9602.3262.576
⚠️ 常見錯誤

呢個 table 嘅 α\alpha 係單邊(右尾)面積。Two-sided test α=0.05\alpha = 0.05 要查 .025 欄(例如 ν=9\nu = 9 → 2.262),唔係 .05 欄。

5. Worked example:腫瘤數據(slides 9–12)

Changes:4.7, −2.4, 2.1, 1.9, −1.4, 5.7, −0.2, 0.3, 3.9, 2.8。Mean = 1.74 > 0。有冇證據顯示改善係正?α=0.05\alpha = 0.05。

⭐ 手計 5 步
  1. Hypotheses:H0:μ≤0H_0:\mu\le 0;H1:μ>0H_1:\mu>0(right-tailed;H1H_1 係 >> → H0H_0 係 ≤\le)。
  2. α=0.05\alpha = 0.05。
  3. Test statistic:
    • yˉ=17.4/10=1.74\bar y = 17.4/10 = 1.74
    • ∑(yi−yˉ)2=63.224\sum (y_i-\bar y)^2 = 63.224 → s2=63.224/9=7.025s^2 = 63.224/9 = 7.025 → s=2.6505s = 2.6505
    • s/n=2.6505/3.1623=0.8381s/\sqrt n = 2.6505/3.1623 = 0.8381
    • T=1.74/0.8381=2.076T = 1.74/0.8381 = \mathbf{2.076}
  4. Critical value:ν=9\nu = 9、α=0.05\alpha = 0.05 → 1.833。(p-value = 1 − t.cdf(2.076, 9) = 0.0339)
  5. Decision:2.076 > 1.833(p=0.0339<0.05p = 0.0339 < 0.05)→ reject H0H_0。結論:有證據顯示治療令腫瘤縮細(「腫瘤增大或不變」被 reject)。
import numpy as np
from scipy import stats
y = np.array([4.7, -2.4, 2.1, 1.9, -1.4, 5.7, -0.2, 0.3, 3.9, 2.8])
stats.ttest_1samp(y, 0, alternative='greater')     # H1 是 > → H0 是 <=
# TtestResult(statistic=2.0760103699294623, pvalue=0.03385076318199434, df=9)

# 另一種方法得到同一個 probability(slide 12)
T = y.mean() / (np.sqrt(y.var(ddof=1)) / np.sqrt(10))   # 2.0760(ddof=1 → 除 n-1)
p = 1 - stats.t.cdf(T, df=9)                              # 0.0339
crit = stats.t.ppf(0.95, 9)                               # 1.833

Slide 10 嘅解讀:p-value = 假設 H0H_0 正確下,得到觀察值(或更極端)嘅機會。p-value 細過 α=0.05\alpha = 0.05 → ‘H0H_0 is rejected’。H0:mean≤0H_0: \text{mean} \le 0;結論:H0H_0 被 reject,即「腫瘤增大或不變」被 reject。

5.1 三個等價嘅 decision rule(slide 11)

⭐ 以下三句意思一樣
T > t.ppf(0.95, 9)        # test statistic 大過 critical value
t.cdf(T, 9) > 0.95        # T 嘅 cumulative probability 大過 95%
1 - t.cdf(T, 9) < 0.05    # p-value 細過 α

1 - t.cdf(T, 9) 就係 p-value。Decision rule:比較 p-value 同你揀嘅 α\alpha。p-value 冇電腦好難計(所以以前用 t-table + critical value)。

5.2 Assumptions(slide 13)

  • n 個 unrelated 病人;佢哋嘅嚴重程度、性別、年齡等相近。
  • 需要假設:y1,…,yny_1, \dots, y_n 係 independent and identically-distributed (i.i.d.) normal random numbers。

6. Critical-value approach:三種 H1H_1(slide 14)

⭐ Rejection rules(T=yˉ−μ0s/nT = \frac{\bar y - \mu_0}{s/\sqrt n})
TypeHypothesesReject H0H_0 ifPython
One-sided (right)H0:μ≤μ0H_0:\mu\le\mu_0 vs H1:μ>μ0H_1:\mu>\mu_0T>tα,n−1T > t_{\alpha,n-1} = t.ppf(1-α, n-1)alternative='greater'
One-sided (left)H0:μ≥μ0H_0:\mu\ge\mu_0 vs H1:μ<μ0H_1:\mu<\mu_0T<−tα,n−1T < -t_{\alpha,n-1} = t.ppf(α, n-1)alternative='less'
Two-sidedH0:μ=μ0H_0:\mu=\mu_0 vs H1:μ≠μ0H_1:\mu\ne\mu_0∣T∣>tα/2,n−1|T| > t_{\alpha/2,n-1} = t.ppf(1-α/2, n-1)alternative='two-sided'

Slide 15 two-sided 例:stats.ttest_1samp(y, 50, alternative='two-sided'):H0H_0 “equal to 50”,H1H_1 “does not equal to 50”。

7. Worked example:牛油有冇呃秤?(slides 16–18)

牛油廠聲稱每包 50 g。抽 10 包:45.3, 52.4, 47.9, 48.1, 51.4, 44.3, 50.2, 49.7, 46.1, 47.2。Mean = 48.26 < 50。有冇證據顯示牛油一般輕過聲稱?Y i.i.d. normal,α=0.05\alpha = 0.05。

⭐ 手計 5 步
  1. H0:μ≥50H_0: \mu \ge 50;H1:μ<50H_1: \mu < 50(left-tailed)。
  2. α=0.05\alpha = 0.05。
  3. yˉ=48.26\bar y = 48.26,s=2.6505s = 2.6505,SE=0.8381SE = 0.8381;T=(48.26−50)/0.8381=−2.076T = (48.26-50)/0.8381 = \mathbf{-2.076}。
  4. Critical value:−t0.05,9=−1.833-t_{0.05,9} = -1.833;p-value = t.cdf(−2.076, 9) = 0.0339。
  5. −2.076 < −1.833(p=0.0339<0.05p = 0.0339 < 0.05)→ reject H0H_0:有證據顯示牛油平均輕過 50 g。
y = np.array([45.3, 52.4, 47.9, 48.1, 51.4, 44.3, 50.2, 49.7, 46.1, 47.2])
stats.ttest_1samp(y, 50, alternative='less')
# TtestResult(statistic=-2.0760103699294645, pvalue=0.03385076318199426, df=9)
💡 有趣觀察

牛油數據其實 = 50 − 腫瘤數據(50 − 4.7 = 45.3、50 + 2.4 = 52.4 …),所以 s 一樣、|T| 一樣、p-value 一樣(slide 18 output 同 slide 10 一樣係 0.03385)——只係方向相反。

8. Confidence interval(slides 19–20)

CI 通常由 two-sided problem 嘅 decision rule 定義。Two-sided 唔 reject 嘅條件係 ∣T∣<tα/2,n−1|T| < t_{\alpha/2,n-1},代入 T=(yˉ−μ0)/(s/n)T = (\bar y-\mu_0)/(s/\sqrt n) 整理:

yˉ−tα/2, n−1sn  <  μ0  <  yˉ+tα/2, n−1sn\bar y - t_{\alpha/2,\,n-1}\frac{s}{\sqrt n} \;<\; \mu_0 \;<\; \bar y + t_{\alpha/2,\,n-1}\frac{s}{\sqrt n}

呢個就係 μ0\mu_0 嘅 confidence interval——即係「所有唔會被 two-sided test reject 嘅 μ0\mu_0」嘅集合。

Meaning of 95% CI(slide 20):95% chance that the random confidence interval covers the true value(統計學家用 simulation 驗證 95%,初學者可略)。

⭐ Worked example:牛油 95% CI
  1. t0.025,9=2.262t_{0.025,9} = 2.262;SE=0.8381SE = 0.8381
  2. Margin = 2.262 × 0.8381 = 1.896
  3. 95% CI = 48.26 ± 1.896 = (46.36, 50.16)

注意:CI 包含 50!所以 two-sided test(H1:μ≠50H_1: \mu \ne 50)喺 α=0.05\alpha = 0.05 唔會 reject(two-sided p=2×0.0339=0.0677>0.05p = 2 \times 0.0339 = 0.0677 > 0.05);但 one-sided(H1:μ<50H_1: \mu < 50)就 reject。one-sided test 將 α\alpha 全放喺一邊,所以較易 reject——H1H_1 嘅方向要喺睇數據之前定好。

9. Two-sample t-test:兩種 design

Slide 21:比較兩個 sample X1,…,XnX_1,\dots,X_n(Treatment A)同 Y1,…,YmY_1,\dots,Y_m(Treatment B)。Slide 22:比較兩種教學法——用孿生兄弟姊妹(related)定唔相關嘅學生(unrelated)?

⭐ 兩種 design(slide 23)
Design描述例子(slides 24, 29)Test
Paired designtwo subjects similar to each other are paired up, then the comparison of the two treatments are made on the pairs5 對孿生子比較教學法;兩個歌手唱同樣 5 首歌;同一病人食藥 vs placeboPaired t-test
Completely randomized designunrelated subjects are randomly assigned to two treatments; the two samples are independent10 個唔相關嘅學生(statistically less accurate but easy to implement)Independent two-sample t-test(pooled variance)

10. Paired t-test

Slide 25 孿生子數據:

TwinMethod A (X)Method B (Y)Difference W=X−YW = X - Y
11181135
21449945
3102105−3
41111101
51349836

Slide 26:

  • Model assumptions:W1,…,Wn∼N(μ,σ2)W_1,\dots,W_n \sim N(\mu,\sigma^2) i.i.d.
  • Test:H0:μ≤0H_0:\mu\le 0 against H1:μ>0H_1:\mu>0
  • Decision rule:reject H0H_0 if t>tα,n−1t > t_{\alpha,n-1},n=n = number of pairs。
  • p-value:reject H0H_0 if p-value < α\alpha。
t=WˉS/n,S=sample s.d. of Wt = \frac{\bar W}{S/\sqrt n}, \qquad S = \text{sample s.d. of } W
💡 直覺理解

Paired t-test 其實就係對差值 W 做 one-sample t-test(μ0=0\mu_0 = 0)。配對抵消咗「人與人之間」嘅差異(例如孿生子天資相近),所以比 independent design 更準。

⭐ Worked example:Drug vs Placebo(slides 27–28,數值由本頁按公式計算)

x (Drug) = 120, 132, 100, 115, 143;y (Placebo) = 115, 95, 106, 108, 97。同一病人 → paired。α=0.05\alpha = 0.05。

  1. H0H_0:μW≤0\mu_W \le 0;H1H_1:μW>0\mu_W > 0(藥物較好)。
  2. W=x−y=5,37,−6,7,46W = x - y = 5, 37, -6, 7, 46 → Wˉ=89/5=17.8\bar W = 89/5 = 17.8
  3. ∑(W−Wˉ)2=2010.8\sum (W-\bar W)^2 = 2010.8 → S2=2010.8/4=502.7S^2 = 2010.8/4 = 502.7 → S=22.421S = 22.421
  4. t=17.8/(22.421/5)=17.8/10.027=1.775t = 17.8/(22.421/\sqrt5) = 17.8/10.027 = \mathbf{1.775}
  5. Critical value:df=5−1=4df = 5 - 1 = 4,α=0.05\alpha = 0.05 → 2.132(slide 28 t-table 圈住嘅值)
  6. 1.775 < 2.132 → do not reject H0H_0(p≈0.075p \approx 0.075)。冇足夠證據顯示藥物比 placebo 好。
x = np.array([120, 132, 100, 115, 143])   # Drug
y = np.array([115, 95, 106, 108, 97])     # Placebo
stats.ttest_rel(x, y, alternative='greater')        # paired t-test:t ≈ 1.775, p ≈ 0.075
stats.ttest_1samp(x - y, 0, alternative='greater')  # 完全一樣嘅結果
stats.t.ppf(0.95, 4)                                 # critical value 2.132
🖼️ 圖片內容

Slide 27–28 只顯示數據同 t-table(圈住 ν=4\nu = 4、α=.05\alpha = .05 嘅 2.132),冇顯示 Python output;上面嘅 t=1.775t = 1.775、p≈0.075p \approx 0.075 係按 slide 26 公式自行計算。Slide 22 係教學法比較嘅示意圖,冇額外文字。

孿生子數據(slide 25)同樣做法:Wˉ=16.8\bar W = 16.8,S=22.05S = 22.05,t=16.8/(22.05/5)=1.704<2.132t = 16.8/(22.05/\sqrt{5}) = 1.704 < 2.132 → do not reject。

11. Independent two-sample t-test(pooled variance)

Slides 29–30:10 個唔相關學生/病人,5 個用 A、5 個用 B(X1–X5=120,132,100,115,143X_1\text{–}X_5 = 120, 132, 100, 115, 143;Y1–Y5=115,95,106,108,97Y_1\text{–}Y_5 = 115, 95, 106, 108, 97)。

Slide 31 model assumptions:X1,…,Xn∼N(μX,σ2)X_1,\dots,X_n \sim N(\mu_X,\sigma^2) 同 Y1,…,Ym∼N(μY,σ2)Y_1,\dots,Y_m \sim N(\mu_Y,\sigma^2),兩個 independent i.i.d. samples,same population variance σ2\sigma^2。

Sp2=∑i=1n(Xi−Xˉ)2+∑j=1m(Yj−Yˉ)2n+m−2=(n−1)SX2+(m−1)SY2n+m−2S_p^2 = \frac{\sum_{i=1}^{n}(X_i-\bar X)^2 + \sum_{j=1}^{m}(Y_j-\bar Y)^2}{n+m-2} = \frac{(n-1)S_X^2 + (m-1)S_Y^2}{n+m-2}

Pooled variance 唔同於將 X、Y 合埋一齊計嘅 variance。

💡 Slide 32:Between-group vs Within-group variation

一個只有 8 個員工嘅虛構城市:Sector A (Education) 薪金 12534, 13290, 10326, 11973;Sector B (Medical) 76245, 79034, 73453, 77024。Overall variance 好大,但每組內部 variance 好細。合併計 variance ≈1.19×109\approx 1.19 \times 10^9,但 pooled variance 只係 ≈3.46×106\approx 3.46 \times 10^6。Pooled variance 只量度組內差異,兩組之間嘅差異留俾分子 Xˉ−Yˉ\bar X - \bar Y。同樣嘅 between-group / within-group 概念亦用喺 classification / clustering。

T=Xˉ−Yˉsp1n+1m,sp=(n−1)SX2+(m−1)SY2n+m−2,df=n+m−2T = \frac{\bar X - \bar Y}{s_p\sqrt{\dfrac1n + \dfrac1m}}, \qquad s_p = \sqrt{\frac{(n-1)S_X^2 + (m-1)S_Y^2}{n+m-2}}, \qquad df = n+m-2

Slide 33:Test H0:μX=μYH_0:\mu_X=\mu_Y against H1:μX≠μYH_1:\mu_X\ne\mu_Y;reject H0H_0 if ∣T∣>tα/2, n+m−2|T| > t_{\alpha/2,\,n+m-2}。

⭐ Worked example:薪金數據(slides 32–35,數值由本頁按公式計算)
  1. H0H_0:μX=μY\mu_X = \mu_Y;H1H_1:μX≠μY\mu_X \ne \mu_Y(two-sided),α=0.05\alpha = 0.05。
  2. Xˉ=12030.75, Yˉ=76439\bar X = 12030.75,\ \bar Y = 76439
  3. SX2=1,582,826.25, SY2=5,343,360.67S_X^2 = 1{,}582{,}826.25,\ S_Y^2 = 5{,}343{,}360.67
  4. Sp2=3(1582826.25)+3(5343360.67)4+4−2=3,463,093.5S_p^2 = \dfrac{3(1582826.25) + 3(5343360.67)}{4+4-2} = 3{,}463{,}093.5 → sp=1860.94s_p = 1860.94
  5. SE=1860.941/4+1/4=1860.94×0.7071=1315.88SE = 1860.94\sqrt{1/4+1/4} = 1860.94 \times 0.7071 = 1315.88
  6. T=(12030.75−76439)/1315.88=−48.95T = (12030.75 - 76439)/1315.88 = \mathbf{-48.95}
  7. df=4+4−2=6df = 4 + 4 - 2 = 6;two-sided α=0.05\alpha = 0.05 → 查 .025 欄 → 2.447(slide 35 圈住嘅值)
  8. |−48.95| > 2.447 → reject H0H_0:兩個 sector 平均薪金有顯著分別。
x = np.array([12534, 13290, 10326, 11973])
y = np.array([76245, 79034, 73453, 77024])
stats.ttest_ind(x, y, equal_var=True)      # pooled-variance t-test:T ≈ -48.95, df = 6
stats.t.ppf(0.975, 6)                      # two-sided critical value 2.447
# 如果兩組 variance 唔相等 → Welch's t-test(flowchart 嘅 unpooled):
stats.ttest_ind(x, y, equal_var=False)
⚠️ 常見錯誤
  • Slide 33 寫 “Reject H0H_0 if T>tα/2T > t_{\alpha/2}”,two-sided 應理解為 ∣T∣>tα/2,n+m−2|T| \gt t_{\alpha/2,n+m-2}(呢個例子 T 係負數)。
  • Paired df = 對數 − 1;Independent df=n+m−2df = n + m - 2。用錯 df 就查錯表。
  • 同一組數據(drug vs placebo)如果錯當 independent:T=2.168T = 2.168,df=8df = 8,two-sided critical 2.306 → 結論亦唔同。Design 決定 test,唔係數據樣子。

自我測驗 Self-test

Q1. n=16n = 16,yˉ=103\bar y = 103,s=8s = 8。Test H0:μ≤100H_0: \mu \le 100 vs H1:μ>100H_1: \mu > 100,α=0.05\alpha = 0.05。

T=(103−100)/(8/4)=1.5T = (103 - 100)/(8/4) = 1.5;df=15df = 15,t0.05,15=1.753t_{0.05,15} = 1.753。1.5 < 1.753 → do not reject H0H_0。冇足夠證據顯示 μ>100\mu > 100。

Q2. 同上數據,求 μ\mu 嘅 95% CI。

t0.025,15=2.131t_{0.025,15} = 2.131;margin = 2.131 × 2 = 4.262;CI = (98.74, 107.26)。

Q3. stats.t.ppf(0.95, 9)、stats.t.ppf(0.975, 9)、stats.t.ppf(0.05, 9) 分別係幾多?各用喺咩 test?

1.833(right-tailed α=0.05\alpha = 0.05);2.262(two-sided α=0.05\alpha = 0.05);−1.833(left-tailed α=0.05\alpha = 0.05)。

Q4. T=2.5T = 2.5,df=9df = 9,one-sided right。寫出三個等價嘅 decision rule 並判斷。

T > t.ppf(0.95, 9) ⇔ t.cdf(T, 9) > 0.95 ⇔ 1 − t.cdf(T, 9) < 0.05。2.5 > 1.833 → reject H0H_0(p≈0.017p \approx 0.017)。

Q5. 以下用邊個 test?(a) 同一班學生上堂前後測驗分數 (b) 隨機分 30 人做 A 組、30 人做 B 組比較減肥效果 (c) 比較 4 個品牌電池壽命 (d) 一批 15 個零件同規格 20 mm 比較

(a) Paired t-test;(b) Independent two-sample t-test;(c) 1-way ANOVA;(d) One-sample t-test(n<30n < 30)。

Q6. Paired 數據 W=3,5,−1,4,4W = 3, 5, -1, 4, 4。Test H0:μ≤0H_0: \mu \le 0 vs H1:μ>0H_1: \mu > 0,α=0.05\alpha = 0.05。

Wˉ=15/5=3\bar W = 15/5 = 3;偏差平方 0 + 4 + 16 + 1 + 1 = 22;S2=5.5S^2 = 5.5,S=2.345S = 2.345;t=3/(2.345/5)=3/1.049=2.86t = 3/(2.345/\sqrt{5}) = 3/1.049 = 2.86;df=4df = 4 → 2.132。2.86 > 2.132 → reject H0H_0。

Q7. 兩組 independent:n=m=6n = m = 6,Xˉ=20, Yˉ=15, SX2=9, SY2=16\bar X = 20,\ \bar Y = 15,\ S_X^2 = 9,\ S_Y^2 = 16。Two-sided α=0.05\alpha = 0.05。

Sp2=(5⋅9+5⋅16)/10=12.5S_p^2 = (5 \cdot 9 + 5 \cdot 16)/10 = 12.5 → sp=3.536s_p = 3.536;SE=3.536×1/6+1/6=3.536×0.5774=2.041SE = 3.536 \times \sqrt{1/6 + 1/6} = 3.536 \times 0.5774 = 2.041;T=5/2.041=2.45T = 5/2.041 = 2.45;df=10df = 10,t0.025,10=2.228t_{0.025,10} = 2.228。2.45 > 2.228 → reject H0H_0。

Q8. 點解 pooled variance 唔等於將兩組數據合埋計 variance?用 slide 32 解釋。

合併 variance 包含組與組之間嘅差距(between-group),薪金例子兩組差 6 萬幾,令合併 variance 極大;pooled variance 只計每組圍繞自己 mean 嘅離散(within-group),反映純 noise。t-test 要嘅係 within-group noise 做分母。

Q9. 牛油例子 one-sided reject 但 95% CI (46.36, 50.16) 包含 50,矛盾嗎?

唔矛盾。95% CI 對應 two-sided α=0.05\alpha = 0.05 test(p=0.0677p = 0.0677,不 reject);one-sided α=0.05\alpha = 0.05 test 將 5% 全放左尾,p=0.0339p = 0.0339 → reject。對應 one-sided 嘅應該係 90% two-sided CI(或 one-sided upper bound)。

一頁總結 Cheat sheet

⭐ 考前速記
  • Flowchart:1 sample n<30n < 30 → t;n>30n > 30 → Z;2 samples independent → 2-sample t(pooled / unpooled);paired → paired t;> 2 → ANOVA。
  • t vs Z:σ\sigma 未知用 s → t,tails 較厚;df→∞df \to \infty 時 t→Zt \to Z。
  • One-sample:T=yˉ−μ0s/nT=\frac{\bar y-\mu_0}{s/\sqrt n},df=n−1df = n - 1,s2=∑(y−yˉ)2n−1s^2=\frac{\sum(y-\bar y)^2}{n-1}(ddof=1)。
  • Table:row = df,column = α\alpha(右尾);n=10n = 10、α=.05\alpha = .05 → 1.833 = t.ppf(0.95, 9);two-sided 查 α/2\alpha/2。
  • Right:T>tαT > t_{\alpha}|Left:T<−tαT < -t_\alpha|Two:∣T∣>tα/2|T| > t_{\alpha/2}。
  • p-value = 1 − t.cdf(T, df)(right-tailed);p<αp < \alpha → reject。
  • 腫瘤:T=2.076T = 2.076,p=0.0339p = 0.0339 → reject;牛油:T=−2.076T = -2.076,p=0.0339p = 0.0339 → reject。
  • CI:yˉ±tα/2,n−1 s/n\bar y \pm t_{\alpha/2,n-1}\,s/\sqrt n;牛油 95% CI (46.36, 50.16)。
  • Assumption:i.i.d. normal。
  • Paired:W=X−YW = X - Y,t=Wˉ/(S/n)t=\bar W/(S/\sqrt n),df=pairs−1df = \text{pairs} - 1;drug/placebo t=1.775<2.132t = 1.775 < 2.132 → not reject。
  • Independent:sp2=(n−1)SX2+(m−1)SY2n+m−2s_p^2=\frac{(n-1)S_X^2+(m-1)S_Y^2}{n+m-2},T=Xˉ−Yˉsp1/n+1/mT=\frac{\bar X-\bar Y}{s_p\sqrt{1/n+1/m}},df=n+m−2df = n + m - 2;薪金 T=−48.95T = -48.95,∣T∣>2.447|T| > 2.447 → reject。
  • Python:ttest_1samp、ttest_rel、ttest_ind(equal_var=True)、alternative='greater'/'less'/'two-sided'。