Oh yes, some outstanding thinkers have gone into mind boggling depth on the meanings of fundamental maths concepts. This started getting a proper treatment in the early 20c. (see https://en.wikipedia.org/wiki/Principia_Mathematica ) and presumably has come a long way since then.

Edit: Of course one has to take a different approach for pedagogical purposes.