> This is somewhat contrary to what I've said before an area where I struggle to see why people don't engineer it into their architecture from the beginning

Exactly. It's very tough knowing what is "you won't need this" and what is "it won't cost a lot to add this now, you'll need this and it will save you a lot of money and pain for later".