I think what seems to be regularly forgetten is that the original purpose for GPT, and by extension pretty much all of these generative AI, is to make a storyteller. It was designed for to be able to carry conversation. It was never worried about the accuracy of the things it said.