Mean, Median, Mode, Standard Deviation & Skewness
Understand how measures of central tendency behave under different distribution shapes and extreme outliers.
Central Tendency Measures
-
Mean (均值):
/miːn/
The arithmetic average. Highly sensitive to outliers.
$$\bar{x} = \frac{1}{n}\sum_{i=1}^n x_i$$
- Median (中位数): /ˈmiːdiən/ The 50th percentile value. Robust to extreme outliers.
- Mode (众数): /moʊd/ The most frequently occurring value in the distribution dataset.
Dispersion & Skewness
-
Standard Deviation (标准差):
/ˈstændərd ˌdiːviˈeɪʃn/
Measures average distance of observations from the mean.
$$s = \sqrt{\frac{1}{n-1}\sum_{i=1}^n (x_i - \bar{x})^2}$$
-
Skewness (偏度):
/ˈskjuːnəs/
Measures asymmetry of probability distribution.
$$\gamma_1 = \text{E}\left[\left(\frac{X-\mu}{\sigma}\right)^3\right]$$
- Kurtosis (峰度): /kɜːrˈtoʊsɪs/ Measures tail-heaviness and peak sharpness relative to normal distribution.
Limit Theorems & Core Distributions
Explore Law of Large Numbers (LLN), Central Limit Theorem (CLT), and Normal vs. Lognormal transformations.
Law of Large Numbers (LLN) 大数定律 /lɔː əv lɑːrdʒ ˈnʌmbərz/
As the sample size $n$ increases, the sample mean $\bar{X}_n$ converges towards the true population mean $\mu$ with probability 1 (Strong LLN).
Central Limit Theorem (CLT) 中心极限定理 /ˈsɛntrəl ˈlɪmɪt ˈθɪərəm/
Regardless of the underlying population distribution shape (Uniform, Exponential, Bimodal), the distribution of sample means $\bar{X}$ approaches a Normal distribution with Asymptotic Normality /ˌæsɪmˈptɑːtɪk/ as sample size $n \ge 30$.
Normal vs. Lognormal Distributions 正态与对数正态 /ˈlɔːɡnɔːrməl/
If random variable $X \sim \mathcal{N}(\mu, \sigma^2)$, then $Y = e^X$ follows a Lognormal distribution. Lognormal variables are non-negative and right-skewed, common in financial stock prices, income distributions, and biological sizes.
Hypothesis Testing: Z-test, T-test, Chi-Square & F-test
Visualizing Null Hypotheses $H_0$, Significance Levels $\alpha$, Critical Values, and P-values.
Hypothesis Test Selector Matrix
| Test Type | Primary Purpose | Assumptions & Sample Size | Test Statistic Formula |
|---|---|---|---|
| Z-Test /ziː test/ | Compare sample mean to population mean when variance is known. | Known $\sigma$, Normal distribution or large sample size ($n \ge 30$). | $$Z = \frac{\bar{X} - \mu_0}{\sigma / \sqrt{n}}$$ |
| t-Test /tiː test/ | Compare mean(s) when population variance is unknown. | Unknown $\sigma$, normally distributed population, small sample ($n < 30$). | $$t = \frac{\bar{X} - \mu_0}{s / \sqrt{n}}, \quad df = n-1$$ |
| Chi-Square ($\chi^2$) /ˈkaɪ skwer/ | Goodness of fit test or test of independence between categorical variables. | Categorical data, expected frequency per cell $\ge 5$. Right-skewed. | $$\chi^2 = \sum \frac{(O_i - E_i)^2}{E_i}, \quad df = k-1$$ |
| F-Test (ANOVA) /əˈnoʊvə/ | Compare two population variances or test overall equality of 3+ means (ANOVA). | Independent normally distributed samples. Ratio of sample variances. | $$F = \frac{s_1^2}{s_2^2}, \quad df_1 = n_1-1, \; df_2 = n_2-1$$ |
Interactive Knowledge Check & Quiz
Test your understanding of CLT, LLN, Distributions, Descriptive Stats, and Hypothesis Tests.
Loading question...
Probability & Statistics Formula Sheet
Essential mathematical formulas, properties, and key statistical concepts.
1. Central Tendency & Dispersion
2. Common Probability Distributions
3. Hypothesis Test Statistics
⚡ Key Rules & Concepts
- P-value Definition: P-value is the probability of obtaining test results at least as extreme as observed, assuming $H_0$ is TRUE. It is NOT the probability that $H_0$ is true!
- Type I vs Type II Error:
• Type I ($\alpha$): Reject $H_0$ when $H_0$ is actually true (False Positive).
• Type II ($\beta$): Fail to reject $H_0$ when $H_0$ is false (False Negative). - Skewness Order:
• Right-Skewed (正偏态): $\text{Mean} > \text{Median} > \text{Mode}$
• Left-Skewed (负偏态): $\text{Mean} < \text{Median} < \text{Mode}$