Definition:P-Value

From ProofWiki
Jump to navigation Jump to search

Definition

Let $\delta$ be a hypothesis test.

Let $H_0$ and $H_1$ be the null hypothesis and alternative hypothesis of $\delta$ respectively.

Let $T$ be the test statistic which is being used to determine whether $H_0$ or $H_1$ holds.


Let $C$ be the critical region of $\delta$.

Let $\alpha$ be the significance level of $\delta$.


The $p$-value of $\delta$ is the probability that $T$ takes a value greater than or equal to a calculated value when $H_0$ is true.


Examples

Arbitrary Example

Consider a $t$-test performed on a sample of $10$ observations from a normal distribution with unknown expectation $\mu$.

To test the null hypothesus that $\mu = 0$ against the alternative hypothesis that $\mu \ne 0$, the statistic $t$ has $9$ degrees of freedom.

Suppose $t = 2.41$.

Then:

$\map \Pr {\size t \ge 2.41} = 0.0392$

which indicates a significance at the exact $0.0392$ level.

A result is significant at a pre-chosen level $\alpha$ if and only if $p \le a$.


Also known as

If a $p$-value is less than a given significance level $\alpha$, the term exact significance level is often used for $p$-value.


Also see

  • Results about $p$-values can be found here.


Historical Note

In this moderm era, computer software routinely gives exact $p$-values in output.


Sources