I often wonder about super-intelligence, mostly in terms of what one would actually want, but the chatbots of today often make me wonder what it is that people want of them. I doubt that LLMs are this today, and perhaps they never will be, but what if there was such a system that you could ask any question of, and it would give you an absolute and true answer? What would people want to know from it? Would you really want to know if there is some sort of life after death? Would you want to know if humanity is bound for extinction?

I don't think that we humans deal too well with the realities of our existence, and if one thinks minor issues like bad words or pictures of humans without clothing on are objectionable, I wonder how that same one will do with meaningful, existential questions.