Edit: about 15 minutes into a set, it stopped playing with no explanation, although the time elapsed changed to NaN:NaN:NaN. Changing tracks or fiddling with the controls couldn't get it going again, but reloading the page did.
Love the concept, and I'm going to keep using it, but it seems to need a bit more QA :p
Why are you using a streaming server? Stream over http, save on a little infrastructure since the files are generally going to be easily consumable by most broadband connections due to their small sizes.