A linear model should always be compared to these DNNs.
There was a paper last year or so that compared correctly tuned linear models to various deep belief net papers and found that the performance "gains" suddenly evaporated or were not nearly as great as originally published.
I'd be really interested to see how well a baseline linear model using those features would perform - it seems like it could do pretty well.