Wilshire@lemmy.world to Technology@lemmy.worldEnglish · 7 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square38fedilinkarrow-up1209cross-posted to: tech@programming.dev
arrow-up1209external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comWilshire@lemmy.world to Technology@lemmy.worldEnglish · 7 months agomessage-square38fedilinkcross-posted to: tech@programming.dev
minus-squarecheddar@programming.devlinkfedilinkEnglisharrow-up22·7 months ago Typically you need about 1GB graphics RAM for each billion parameters (i.e. one byte per parameter). This is a 405B parameter model.