I guess it depends on what you are trying to accomplish. Many people start a business because they have a purpose or mission they are trying to accomplish and they can't get there remaining small.

That said, I'm inclined to agree that granting yourself and family financial independence gives you a lot of freedom and flexibility to do anything you want at that point.