Our upside-down city hall and the plaza wasteland around it are described as brutalist, and yet I would not call City Hall "non-distracting" or the plaza "clean".
I think a lot of people ITT may be confusing Brutalism and modernist architecture in general. "Clean," "unobtrusive" and so on are not adjectives I'd use to describe it (Brutalist architecture).
