Yes, but for a remote for a TV device you want something one-handed and hand-held, which creates an inherent problem with the pinch action. Trackpads are a desktop/laptop experience.

Once you're using a trackpad, you may as well go with the Chromecast approach of using a full phone-like device. Sad that Android is so bloated, otherwise I'd think a small 3.5" barebones full Android device would be good as a bundled "remote".

Have you seen the new Apple TV Remote? I haven't done a lot with it, but it's got a touch pad on it for gestures. Maybe these remote / trackpad devices would do the trick.