Michael Ten @lemmy.world to Technology@lemmy.worldEnglish · 8 months agoOpera is testing letting you download LLMs for local use, a first for a major browserwww.zdnet.comexternal-linkmessage-square26fedilinkarrow-up1134cross-posted to: aicompanions@lemmy.worldartificial_intel@lemmy.ml
arrow-up1134external-linkOpera is testing letting you download LLMs for local use, a first for a major browserwww.zdnet.comMichael Ten @lemmy.world to Technology@lemmy.worldEnglish · 8 months agomessage-square26fedilinkcross-posted to: aicompanions@lemmy.worldartificial_intel@lemmy.ml
minus-squareBandicoot_Academic@lemmy.onelinkfedilinkEnglisharrow-up14·8 months agoIntresting. But I’m curious about the performance. A bigger LLM (mixtral) already struggles to run on my mid-range gaming PC. Trying to run an LLM that isn’t terrible on a standard laptop wouldn’t be a good experience.
Intresting. But I’m curious about the performance.
A bigger LLM (mixtral) already struggles to run on my mid-range gaming PC. Trying to run an LLM that isn’t terrible on a standard laptop wouldn’t be a good experience.