DreamDrifter@lemmynsfw.comtoFree Open-Source Artificial Intelligence@lemmy.world•Llama 3.1 MegathreadEnglish
3·
4 months agoAgreed - 8b has enough magic to hold a conversation and do small tasks, such as breaking up a large task or picking out key details, which can then be fed into more small models (maybe even more narrowly fine-tuned ones)
180b isn’t enough to replace all the other pieces of a system that you need for autonomous action or memory
I think 8b models are enough to make AGI possible if we stack them just right. They’re enough to fill in most of the gaps to make practical things too, and they’re not that far off for everything else
That was due to additives to ethanol cleaning agents - it was a thing done on purpose