⊥ᵒᵚ Cᵸᵎᶺᵋᶫ∸ᵒᵘ ☑️
Lead dev @extravision for ☁️,📱 & 💻. Views own.
Likes : 🐕, 🧱, 🐧,🚀, sci-fi, whisky, electronic 🎶.
Dislikes : Long bios
He/him
- 0 Posts
- 1 Comment
Joined 9 months ago
Cake day: February 11th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
@noroute@lemmy.world @yoasif@fedia.io local LLM execution times can be very fast on recent consumer hardware. No need to send anywhere, just like their translation - do it all on-device.
As an example, with no optimization or GPU support, my @frameworkcomputer@fosstodon.org (AMD) generates around 5 characters/sec from a 4 gigabyte pre-quantized model.