It's not dumbing down, it's simplifying. By designing mobile first, you force yourself to think about the priorities in your UX. You can still add all kind of things on top in the full web interface, but that's on top of the core experience.