I follow a YouTube channel, AI explained, that has some pretty grounded analysis of the latest models and capabilities. He compared LLMs to the creative writing center of the brain, as in they’re really nice to interact with, output things that sound correct, but ultimately are missing the capabilities of reasoning and factuality that are needed for AGI
He’s really good. I’m torn on the subject because the current AI hype is most certainly a bubble and a grift, but I find the technology fascinating. I do think there’s potential for great things there, but the technology is almost exclusively in the hands of 3 companies and will have a terrible impact on everyone else. I enjoy just focusing on the technical details every once in a while