I'm presuming you are talking about a generic "you", and not referring to me personally, because I've been working in (mostly) mission-driven companies for a decade. I do take a hit on my compensation and wealth for it, with my spouse and children by my side the whole time.
But granted, mission-driven people are less common. To the point that many people who are not fundamentally mission-driven truly do not comprehend that some of us are. We all have our own motivations.
Bonus points if you can do it with your spouse and children by your side.