minus-squarekill_dash_nine@lemm.eetoTechnology@lemmy.world•Everything Apple iOS 18 Will Do, Android Already DoeslinkfedilinkEnglisharrow-up8·22 days agoYou would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size. linkfedilink
You would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.