I've done a bit with deep learning and medical images (brain, lung, skin). One thing that surprised me, but kind of makes sense, is the net seemed to perform well without a ton of training data. I think it might actually be easier for the model because the images are much more similar than in a "natural image" setting where there are more degrees of freedom in the subject itself.