What is the relationship between statistical inference and probability theory and how do I support it with examples?

Probability theory is the field of mathematics that enables statistical inferences to be made. All equations used in statistical inferences must be based on mathematics (theorems and proofs) of probability theory. An example to illustrate this. Given a normal probability curve with a mean = 0 and variance of 1, 68% of the area under the curve is in the range of -1 to 1, as calculated from probability theory. Since it is proved by mathematics, we can state it as a fact. If we collect data, and the average of the data is zero, and the standard deviation is 1, then we can infer that we are 68% certain that the population mean lies between -1 to 1. Our conclusion is inferred based on our limited and imperfect sample and the assumption that our population is normally distributed.