That’s where it does the voice processing.

Yes that’s the stupid part.

Doing that on-device would not only make the devices significantly more expensive, but they would also rapidly become outdated.

Uhhhh no. For one that technology already exists on home assistant and can run on a raspberry pi. For another, Android devices already do that with apps like GBoard and Google Recorder.