What is not Statistics
A complementary way of defining something is by stating what it is not. This method in Philosophy is called "apophatic".
1.Statistics is not the formulas that almost always look like the the nests of migratory birds on top of chimneys. First, the apparent complexity does not justify the very simple calculations they denote; and secondly, formulas are algorithms that allow us to perform calculations, Formulas do not touch on the logic or technique nor of the mathematics involved.
2. Statistics is not the step-by-step guides of how to perform a statistical operation such as a t-test. Like formulas they do not touch on underlying logic. Why, for example the F ration is to be trusted for measuring differences among the groups of an experiment?
3. Statistics is not the statistical calculators that indeed perform a marvelous service of analyzing data in seconds, a task that would take hours . These calculators do not shed any light on the logic and mathematics involved. The very important issue of choice of a legitimate test of significance is bypassed by statistical calculators. The consequence of this is probable misuse of Statistics as well as insecurity of experimenters when confronted with challenge in live presentations such as thesis oral defense as well as conferences.
On the acknowledgement that Statistics is that part of Mathematics that allows Science to determine whether a finding is reliable ("is true" in layman language), we are obliged to confer on Statistics a more important and serious role than that of preliminary shuffling around of data such as averages and frequency graphs. The mathematical essence and analytic techniques have largely escaped the attention they deserve among the natural scientists and philosophers.