Which statement best describes how statistical power changes with sample size and effect size?

Prepare for the Anthropic Fellows Program Test with multiple choice questions and in-depth explanations. Our quiz covers AI Safety, Economics, and Research Methods. Master the skills needed for success!

Multiple Choice

Which statement best describes how statistical power changes with sample size and effect size?

Explanation:
Power is the probability that a statistical test will detect a true effect when it exists. It grows when the true effect size is larger and when you have more data. Why this happens: a bigger sample reduces sampling variability, so the observed difference is less likely to be swamped by random noise and more likely to cross the significance threshold. A larger true effect makes the difference you’re trying to detect bigger relative to the noise, also making it easier to declare significance. So the statement that increasing either the sample size or the true effect size increases power is the best description. The other views don’t fit. Increasing sample size does affect power, so saying it has no effect is incorrect. Power depends on both effect size and sample size, not on effect size alone. And power is not maximized when the true effect is zero; with no real effect, there’s nothing to detect and the chance of a false positive is just the chosen alpha, not a high power.

Power is the probability that a statistical test will detect a true effect when it exists. It grows when the true effect size is larger and when you have more data. Why this happens: a bigger sample reduces sampling variability, so the observed difference is less likely to be swamped by random noise and more likely to cross the significance threshold. A larger true effect makes the difference you’re trying to detect bigger relative to the noise, also making it easier to declare significance. So the statement that increasing either the sample size or the true effect size increases power is the best description.

The other views don’t fit. Increasing sample size does affect power, so saying it has no effect is incorrect. Power depends on both effect size and sample size, not on effect size alone. And power is not maximized when the true effect is zero; with no real effect, there’s nothing to detect and the chance of a false positive is just the chosen alpha, not a high power.

Subscribe

Get the latest from Passetra

You can unsubscribe at any time. Read our privacy policy