Any speculation with any shared hardware is a no-no from a security standpoint.

You can either separate your hardware (physically or virtually) or do no speculation.