First, I would still challenge the idea that there is a fundemantal difference for us between picturing an experience and actually experiencing it. It will probably vary by experience, but at least things like "how would it feel to watch my loved ones die" can be experienced even if it doesn't happen, with enough introspection.

And this very much does matter for certain arguments about consciousness. If qualia are separate from thoughts but only through an accident of our own human minds' construction, then all arguments that rely on qualia to argue consciousness must be un physical (Chalmers likes these a lot) are obviously invalid.