cyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social · 1 day agoProposed bill to make it a crime to download DeepSeek in the USwww.congress.govexternal-linkmessage-square32fedilinkarrow-up1195
arrow-up1195external-linkProposed bill to make it a crime to download DeepSeek in the USwww.congress.govcyrano@lemmy.dbzer0.com to United States | News & Politics@midwest.social · 1 day agomessage-square32fedilink
minus-squaretrevorlinkfedilinkEnglisharrow-up2·10 hours agoNo worries. I’ve got some 20TB drives i can throw these on 😁 Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
minus-squarePup Biru@aussie.zonelinkfedilinkEnglisharrow-up1·5 hours agoyou can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)
No worries. I’ve got some 20TB drives i can throw these on 😁
Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.
you can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)