FWIW I work in the field and agree with this. LLMs in the current state are not so dangerous they can’t be released to public. Generative image and video models are a much bigger threat, but that was largely something which came from open source.
If we really want to pearl clutch, it is NVIDIA which is really propping open this Pandora’s box in terms of putting the capability in irresponsible hands
Definitely. An A100 system is around $10k which is expensive, but definitely in reach, and you need two of them to run a 70B parameter model. Possibly one if you are clever about it.
And you can still do plenty of damage with a $1000 consumer grade GPU. Most deepfake videos are trained on these platforms.
FWIW I work in the field and agree with this. LLMs in the current state are not so dangerous they can’t be released to public. Generative image and video models are a much bigger threat, but that was largely something which came from open source.
If we really want to pearl clutch, it is NVIDIA which is really propping open this Pandora’s box in terms of putting the capability in irresponsible hands
Are the cards really powerful enough for so much fuss?
Definitely. An A100 system is around $10k which is expensive, but definitely in reach, and you need two of them to run a 70B parameter model. Possibly one if you are clever about it.
And you can still do plenty of damage with a $1000 consumer grade GPU. Most deepfake videos are trained on these platforms.