That hasn't been my experience with Mastodon. The servers most of the big servers block are overwhelmingly sources of harassment, extreme hate content, and media that might be legally classed as child pornography where those servers are hosted. The servers I've noticed being really picky about who they federate with tend to be smaller.