Fascinating question. I suppose it depends on the size of the rock? Anything big "enough" would cause real problems, but a single molecule of rock would probably not matter too much. Presumably cosmic rays are triggering single neuron molecules all the time, but because there is a lot of redundancy this does not propagate into real activity.