Just consider that everything you come in contact with, including the assertion of the sense-data that led you to the conclusion of "billions of years", is contaminated by the fact that is utterly impossible to disprove consciousness. Everything else that comes in through the senses can be doubted, but consciousness is the only thing you are in direct contact with. But I agree partially with you that there may be a form of consciousness that is more primary than our subjective consciousness (I think we agree that reality is a "real" logical system, probably infinite, and possibly intelligent itself). But we have a relationship with reality, in fact we may be a kind of accelerated rotation of it with reincarnative compartmentalization.
> Everything else that comes in through the senses can be doubted, but consciousness is the only thing you are in direct contact with.
Every functioning human learns relatively early in life that certain experiences they have are simply fake - dreams, at the very least. Many people who suffer from hallucinations can also learn to trust that their own internal experiences are less valid than what others tell them is true.
Just as much, we may one day come to learn that our internal experience of consciousness is an illusion and that reality is we are all p-zombies. Of course, a physical theory of consciousness has to explain why and how we have this false subjective experience, but it's certainly conceivable that this might happen one day.
I've only read the first couple of chapters, yet, but this book lay out the philosophical problems with physicalism: https://www.amazon.com/gp/product/B0CGNXWTBN