Quotes from George E. P. Box

Just as the ability to devise simple but evocative models is the signature of the great scientist so overelaboration and overparameterization is often the mark of mediocrity.

The business of the statistician is to catalyze the scientific learning process.

All models are wrong, but some are useful.

All models are approximations. Essentially, all models are wrong, but some are useful. However, the approximate nature of the model must always be borne in mind.

Remember that all models are wrong; the practical question is how wrong do they have to be to not be useful.

To find out what happens to a system when you interfere with it you have to interfere with it (not just passively observe it).

Statisticians, like artists, have the bad habit of falling in love with their models.