Why Most People Fail at Building Long-Term Wealth?

I think that most people fail at building long-term wealth because they do not start investing in the right kind of product or asset at the right time. Billionaires like warren Buffett started investing money at a very young age. Many people never do that. So, what are some other reasons people do not build wealth?