Formal mathematics is a cultural and historical invention, passed from adults to most children through extensive formal instruction. Nevertheless, mathematics builds on systems of knowledge that emerge independently of instruction or culture. Studies of human infants and nonhuman primates can tell us about the properties of those "core systems" and their interactions. Studies of children at the brink of formal schooling suggest how those systems are harnessed to permit learning of symbolic mathematics.