Do bones undergo decay over time?

Since bones tens of millions of years old have been unearthed, I am wondering if they decay at all. If not, then huge amounts of calcium and phosphorus are being removed from the environment and deposited in the skeletons of animals and humans, from where they are never returned to the environment. Wouldn't such a thing cause some kind of ecological imbalance?