§ 5. After these general remarks on the nature of chance, we are prepared to consider in what manner assurance may be obtained that a conjunction between two phenomena, which has been observed a certain number of times, is not casual, but a result of causation, and to be received, therefore, as one of the uniformities of nature, though (until accounted for a priori) only as an empirical law.
We will suppose the strongest case, namely, that the phenomenon B has never been observed except in conjunction with A. Even then, the probability that they are connected is not measured by the total number of instances in which they have been found together, but by the excess of that number above the number due to the absolutely frequency of A. If, for example, A exists always, and therefore co-exists with every thing, no number of instances of its co-existence with B would prove a connection; as in our example of the fixed stars. If A be a fact of such common occurrence that it may be presumed to be present in half of all the cases that occur, and therefore in half the cases in which B occurs, it is only the proportional excess above half that is to be reckoned as evidence toward proving a connection between A and B.
In addition to the question, What is the number of coincidences which, on an average of a great multitude of trials, may be expected to arise from chance alone? there is also another question, namely, Of what extent of deviation from that average is the occurrence credible, from chance alone, in some number of instances smaller than that required for striking a fair average? It is not only to be considered what is the general result of the chances in the long run, but also what are the extreme limits of variation from the general result, which may occasionally be expected as the result of some smaller number of instances.
The consideration of the latter question, and any consideration of the former beyond that already given to it, belong to what mathematicians term the doctrine of chances, or, in a phrase of greater pretension, the Theory of Probabilities.