Skip to main content

Appendix C. Symbols, formulas, statistics and parameters

Section C.1 Symbols and standard errors

  • Table Table C.1 lists the statistics used to estimate unknown population parameters.
  • When the sampling distribution is approximately normally distributed, under appropriate statistical validity conditions, this is indicated by ✔.
  • The value of the mean of the sampling distribution (the sampling mean) is:
    • unknown, for confidence intervals.
    • assumed to be the value given in the null hypothesis, for hypothesis tests.
Table C.1. Sample statistics used to estimate population parameters. Some statistics have approximately normally-distributed sampling distributions under appropriate (statistical validity) conditions, as indicated using ✔.
Statistic Parameter Standard error Normal? Reference
Proportion CI: \(\hat{p}\) \(p\) \(\displaystyle \sqrt{\frac{\hat{p}\times(1-\hat{p})}{n}}\) ✔ Sect. Section 22.1
Proportion Test: \(\hat{p}\) \(p\) \(\displaystyle \sqrt{\frac{p\times(1-p)}{n}}\) ✔ Sect. Section 26.1
Mean CI: \(\bar{x}\) \(\mu\) \(\displaystyle \frac{s}{\sqrt{n}}\) ✔ Sect. Section 23.1; Chap. Chapter 27
Mean Test: \(\bar{x}\) \(\mu\) \(\displaystyle \frac{s}{\sqrt{n}}\) ✔ Chap. Chapter 27
Mean difference CI: \(\bar{d}\) \(\mu_d\) \(\displaystyle \frac{s_d}{\sqrt{n}}\) ✔ Chap. Chapter 29
Mean difference Test: \(\bar{d}\) \(\mu_d\) \(\displaystyle \frac{s_d}{\sqrt{n}}\) ✔ Chap. Chapter 29
Difference between means CI: \(\bar{x}_1 - \bar{x}_2\) \(\mu_1 - \mu_2\) \(\displaystyle \sqrt{\text{s.e.}(\bar{x}_1)^2 + \text{s.e.}(\bar{x}_2)^2}\) ✔ Chap. Chapter 30
Difference between means Test: \(\bar{x}_1 - \bar{x}_2\) \(\mu_1 - \mu_2\) \(\displaystyle \sqrt{\text{s.e.}(\bar{x}_1)^2 + \text{s.e.}(\bar{x}_2)^2}\) ✔ Chap. Chapter 30
Difference between proportions CI: \(\hat{p}_1 - \hat{p}_2\) \(p_1 - p_2\) \(\displaystyle \sqrt{\text{s.e.}(\hat{p}_1)^2 + \text{s.e.}(\hat{p}_2)^2}\) ✔ Chap. Chapter 31
Difference between proportions Test: \(\hat{p}_1 - \hat{p}_2\) \(p_1 - p_2\) \(\displaystyle \sqrt{\text{s.e.}(\hat{p}_1)^2 + \text{s.e.}(\hat{p}_2)^2}\) using common proportion \(\hat{p}\) ✔ Chap. Chapter 31
Odds ratio (OR) CI: Sample OR Pop. OR (Not given) ✘ Chap. Chapter 31
Odds ratio (OR) Test: Sample OR Pop. OR (Not given) ✘ Chap. Chapter 31
Correlation CI: \(r\) \(\rho\) (Not given) ✘ Sect. Subsection 33.2.1
Correlation Test: \(r\) \(\rho\) (Not given) ✘ Sect. Subsection 33.2.2
Regression: slope CI: \(b_1\) \(\beta_1\) \(\text{s.e.}(b_1)\) (value from software) ✔ Sect. Subsection 33.4.2
Regression: slope Test: \(b_1\) \(\beta_1\) \(\text{s.e.}(b_1)\) (value from software) ✔ Sect. Subsection 33.4.3
Regression: intercept CI: \(b_0\) \(\beta_0\) \(\text{s.e.}(b_0)\) (value from software) ✔ Sect. Subsection 33.4.2
Regression: intercept Test: \(b_0\) \(\beta_0\) \(\text{s.e.}(b_0)\) (value from software) ✔ Sect. Subsection 33.4.3

Section C.2 Confidence intervals

For statistics whose sampling distribution has an approximate normal distribution, confidence intervals (CIs) have the form
\begin{equation} \text{statistic} \pm \big( \text{multiplier} \times \text{s.e.}(\text{statistic})\big).\tag{C.1} \end{equation}
Notes:
  • The multiplier is approximately \(2\) to create an approximate \(95\)% CI (based on the \(68\)–\(95\)–\(99.7\) rule).
  • The quantity ’\(\text{multiplier} \times \text{s.e.}(\text{statistic})\)’ is called the margin of error.
  • Software uses exact multipliers to form exact confidence intervals.
  • When the sampling distribution for the statistic does not have an approximate normal distribution (e.g., for ORs and correlation coefficients), this formula does not apply and the CIs are taken directly from software output when available.

Section C.3 Hypothesis testing

For statistics whose sampling distribution has an approximate normal distribution, the test statistic has the form:
\begin{equation} \text{test statistic} = \frac{\text{statistic} - \text{parameter}}{\text{s.e.}(\text{statistic})},\tag{C.2} \end{equation}
where \(\text{s.e.}(\text{statistic})\) is the standard error of the statistic. The test-statistic is a \(t\)-score for most hypothesis tests in this book when the sampling distribution is described by a normal distribution, but is a \(z\)-score for a hypothesis test involving one or two proportions.
Notes:
  • If the test-statistic is a \(z\)-score, the \(P\)-value can be found using tables (Appendix Section B.3), or approximated using the \(68\)–\(95\)–\(99.7\) rule.
  • If the test-statistic is a \(t\)-score, the \(P\)-value can be approximated using tables (Appendix Section B.3), or approximated using the \(68\)–\(95\)–\(99.7\) rule (since \(t\)-scores are similar to \(z\)-scores; Sect. Section 20.4).
  • When the sampling distribution for the statistic does not have an approximate normal distribution (e.g., for ORs and correlation coefficients), this formula does not apply and \(P\)-values are taken from software when available.
  • A hypothesis test about ORs uses a \(\chi^2\) test statistic. For \(2\times 2\) tables only, the \(\chi^2\)-value is equivalent to a \(z\)-score with a value of \(\sqrt{\chi^2}\text{.}\)

Section C.4 Sample size estimation

The following formulas compute the approximate minimum (i.e., conservative) sample size needed to produce a \(95\)% CI with a specified margin of error (i.e., the ’give-or-take’ amount).
  • To estimate the sample size needed for estimating a proportion (Sect. Section 32.3), use:
    \begin{equation} n = \frac{1}{(\text{Margin of error})^2}.\tag{C.3} \end{equation}
  • To estimate the sample size needed for estimating a mean (Sect. Section 32.4) use:
    \begin{equation} n = \left( \frac{2\times s}{\text{Margin of error}}\right)^2\tag{C.4} \end{equation}
    for some estimate \(s\) of the standard deviation of the data.
  • To estimate the sample size needed for estimating a mean difference (Sect. Section 32.5) use:
    \begin{equation} n = \left( \frac{2 \times s_d}{\text{Margin of error}}\right)^2\tag{C.5} \end{equation}
    for some estimate \(s_d\) of the standard deviation of the differences.
  • To estimate the sample size needed for estimating the difference between two means (Sect. Section 32.6) use:
    \begin{equation} n = 2\times \left( \frac{2 \times s}{\text{Margin of error}}\right)^2\tag{C.6} \end{equation}
    for each group being compared, where \(s\) is an estimate of the common standard deviation in the population for both groups. This formula assumes:
    • the sample size for each group will be the same; and
    • the standard deviation in each group is the same.
  • To estimate the sample size needed for estimating the difference between two proportions (Sect. Section 32.7) use:
    \begin{equation} n = \frac{2}{(\text{Margin of error})^2}\tag{C.7} \end{equation}
    for each group being compared. This formula assumes the sample size in each group will be the same.
Notes:
  • In sample size calculations, round up the sample size found from the above formulas.

Section C.5 Other formulas

  • To calculate \(z\)-scores (Sect. Section 20.4), use
    \begin{equation} z = \frac{\text{value of variable} - \text{mean of the distribution of the variable}}{\text{standard deviation of the distribution of the variable}}.\tag{C.8} \end{equation}
    \(t\)-scores are like \(z\)-scores. When the ’variable’ is a sample estimate (such as \(\bar{x}\)), the ’standard deviation of the distribution’ is a standard error (such as \(\text{s.e.}(\bar{x})\)).
  • The unstandardising formula (Sect. Section 20.8) is \(x = \mu + (z\times \sigma)\text{.}\)
  • The interquartile range (IQR) is \(Q_3 - Q_1\text{,}\) where \(Q_1\) and \(Q_3\) are the first and third quartiles respectively (or, equivalently, the \(25\)th and \(75\)th percentiles).
  • The smallest expected value (for assessing statistical validity when forming CIs and conducting hypothesis tests with proportions or ORs) is
    \begin{equation} \frac{(\text{Smallest row total})\times(\text{Smallest column total})}{\text{Overall total}}.\tag{C.9} \end{equation}
  • The regression equation in the sample is \(\hat{y} = b_0 + b_1 x\text{,}\) where \(b_0\) is the sample intercept and \(b_1\) is the sample slope.

Section C.6 Other symbols and abbreviations used

Table C.2. Some symbols and abbreviations used in this book.
Symbol or abbreviation Meaning Reference
RQ Research question Chap. Chapter 2
\(s\) Sample standard deviation Sect. Subsection 11.7.2
\(\sigma\) Population standard deviation Sect. Subsection 11.7.2
\(s_d\) Sample standard deviation of differences Sect. Subsection 11.7.2
\(\sigma_d\) Population standard deviation of differences Sect. Subsection 11.7.2
\(R^2\) R-squared Sect. Subsection 16.4.2
\(H_0\) Null hypothesis Sect. Section 28.2
\(H_1\) Alternative hypothesis Sect. Section 28.2
CI Confidence interval Chap. Chapter 24
s.e. Standard error Def. Definition 19.11
\(n\) Sample size Def. Definition 2.55
\(\chi^2\) The chi-squared test statistic Sect. Subsection 31.6.3
\(\pm\) Plus-or-minus (give-or-take) Sect. Section 22.3