MasterNerd@lemm.eetoSelfhosted@lemmy.world•Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?English
31·
5 months agoI don’t have any experience with them honestly so I can’t help you there
I don’t have any experience with them honestly so I can’t help you there
Look into ollama. It shouldn’t be an issue if you stick to 7b parameter models
Hmm sounds like the parents are still jumping around on the bed
The bigger issue is that if your can have your AI assistant do your job while you’re in vacation, you’ll end up on unpaid vacation permanently
Kinda weird that they’re calling it an OS, but ig they’re just trying to cater to the windows audience
For those wondering what the fuck a monad is, it’s simply is just a monoid in the category of endofunctors
I mean you could always hack the firmware…