Rabbit holes are only a problem if you desperately have to get something finished and get stuck doing other things that seem more interesting. Otherwise, you can learn interesting things that widen your world view. Or maybe even find something that is a better use of your time than what you were doing in the first place. There is more to life than being productive.