That's rather my point. If the phone was sufficiently powerful, you wouldn't lose any performance gains. I'm implicitly defining sufficiently powerful to be however powerful the iPhone would need to be to see no performance drop.

Once we assume the CPU and memory of the iPhone can handle it, doing it that way would be faster since there would be less latency involved.