Chapter 1. The Reasoning of a Statistical Test

Introduction

Statistical Applets

Ask a State University player to shoot free throws by clicking SHOOT. You can get more data by clicking Shoot repeatedly. Do the data appear to agree with the 80% claim or to give evidence against it? When you are satisfied, click "Show true probability" to see the truth for this player. Click NEW SHOOTER to test a different player, who may have a different free throw percent.

Click the "Quiz Me" button to complete the activity.

A statistical test assesses the evidence provided by data against some claim (the null hypothesis H₀). This applet allows you to gather data until you are ready to reach a conclusion about the truth of a null hypothesis. It illustrates the reasoning of tests: are the data compatible with a claim, or do they give evidence against it?

The basketball team at State University claims that each of their players makes 80% of his free throws. That's a null hypothesis, and is represented by the blue horizontal line on the graph. Have players try shooting free throws and see whether or not you think this null hypothesis can be rejected.

Question 1.1

YnNN1aL4s8CEj9nYB50XDJJ720+iRV7Gi+T6XVJFPe9jYNv9F+faIFT8HWkQMkXI/lzxUUEbwx43fFFbly7nZEWLY8HOduC1JJ0rGlBnRdGBvN4fq6xXORwIQDjRwL3c4JRh8wm4yUAAOL8AkVR4v3xXhtXY9j3rjwZOMOMjSSKq6GM0YueYlabTVd6qygemH4xP/SILHICXWufLcA8OxtRALI4P6iffZ1H9rvuMNKNEmFK6cvX/Rhur6deBj7y1

Correct.

To answer this question correctly, you must have a shooter take exactly 5 shots, then enter the percentage of shots the shooter has made ("hits"). You can click NEW SHOOTER and start over if necessary.

Incorrect.

Question 1.2

BG+OPA7Ees2v4wlhbBPjd5Ztd4yP+ZNGwIYwbU78kfQwN3kgiS2aNhhvlEHmLsMB7J/C7qnbiWJenc8X+7D5qvD0FujPYmUAo3k2SzcK+HMqNdHhslyxYDVcpnfUxbJgQ92VeYVv+J9KUtaPqbHuUjafBhNhaTngtpcxR1OGi+ovDubOSnp0QEGlzMncB2yaMT0kVUwG2qW90OBkixjfqa5TjEaLQPOBbKFsOE1EnWsEcwNsjca2jre21UyA+iHBnKwXRg==

Correct.

To answer this question correctly, you must have a shooter take exactly 15 shots, then enter the percentage of shots the shooter has made ("hits"). You can click NEW SHOOTER and start over if necessary.

Incorrect.

Question 1.3

rJwDL0EkFa+0zn6bIr+OBj7IFw1lCCU2fDEqDAW+tWndlY+TQL50IbZaFA5Zdc7oIWW7WdFg82VhNMZ2Twt6PJZex55Nse3jNOggE8a412eSnS5YtOBdUbS1N38wvLAYnW89Px0QXT/Zd04cu0r6YBwamxQYvObaaFUZtM5l8uPOPXFwmGpPmqHQnF/ZbymB3sCJu2LpGXKum12l6kNUXih1c06jfEWFjpXsd8LcbZZuuiRIB0A0V9esc7/2VoF7dlRHCK7tjOR7ZKRA9n3l+92HSaY=

Correct.

To answer this question correctly, you must have a shooter take at least 50 shots, then enter the percentage of shots the shooter has made ("hits"). You can click NEW SHOOTER and start over if necessary.

Incorrect.

Question 1.4

fFjJI/kSNjIbYU9yVBkQYPveq1aW/b3K/Y5Bi7hB9KCXrdlEyv6DA6WbpCLXvIFZnIJwEITRuGAcLVkxd98X9VY2IiGl0yAsEs+7GDk4jbbd1yxlJ6EPAstwepNtuCdccmDy/nK/+Xzapr2UnpO0INIzey3pHH27CTpLHcArFLGykT4gfYkYxWcFnrFDlXVnwREen6aixAi1T/Y7ZDNkKTZbBpEUDEgWsvJERf9Nx6DM5XkyzBZd955UQKF6peVIwrW6iyDiNOEBdMiXhnpCh1TFUURbuRa2ojpAj3fHRWeSCR0ZQ7nlkGty0wB6FIvzLY0oDMqQY45CJXrAGKbijbmu6GzPl2vIN+MdnGs9ZZ7U6yG5KcO/njWPYWBjLzzpMNJ7fX60m0zehvOhrGuBzxotE+ghq/vzV/uhbs+daKpqfP2yJjjBH+JTfdpSOGtKYsljkILa6OVXAKXSNbvfQlDBoqnGR4/2I0YnYm1nLsh8P9FeWecOzhgHc68L4BmqmwdIZmtKYrkYR1nisHv3Uq+bWdJCSmCtI5C2yMq7Bm7SAjP86s5kxYUlwe4pwjnj/kkHCkRS3/TwzEsyrN6bcg==

The more shots we see the shooter take, the larger the sample size we have to estimate the shooter's true underlying probability of making a shot. So it is certainly better to make a decision after seeing 50 shots than after seeing just 5 shots. However, one thing this applet demonstrates is that even after many, many observations, it's still impossible to know for sure whether or not a null hypothesis should be rejected. For instance, say that after 50 shots the shooter's hit percentage is exactly .80. That would seem to count as perfect evidence for the null hypothesis that his true underlying ability is that he hits exactly 4 out of every 5 shots. But note that if the shooter takes one more shot, he will either hit it or miss it, pushing his hit rate to either .804 or .784, neither of which is exactly .80. Practically speaking, .804 and .784 are both close enough to .80 that there is really no appreciable difference between them; nevertheless, it is good to remember that null hypotheses can never be completely ruled out or accepted.