Most optimization you do as a software engineer is about figuring out what you do not need to do, no math involved.

You aren't going around applying novel techniques of numerical linear algebra.