Stamets@lemmy.world to People Twitter@sh.itjust.works · 11 months agoThe dreamlemmy.worldimagemessage-square157fedilinkarrow-up11.92K
arrow-up11.92KimageThe dreamlemmy.worldStamets@lemmy.world to People Twitter@sh.itjust.works · 11 months agomessage-square157fedilink
minus-squarearthurpizza@lemmy.worldlinkfedilinkEnglisharrow-up2·11 months agoThose server farms are because the needs of corporations might just be different from the needs of regular users. I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago. It’s almost as if technology can get better and more efficient over time.
Those server farms are because the needs of corporations might just be different from the needs of regular users.
I’m running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.
It’s almost as if technology can get better and more efficient over time.