The massive computer clusters powering artificial intelligence consume vast quantities to answer the world’s queries, but how is Big Tech redressing the balance?

Writing a 100-word email using ChatGPT (GPT-4, latest model) consumes 1 x 500ml bottle of water It uses 140Wh of energy, enough for 7 full charges of an iPhone Pro Max

  • bandwidthcrisis@lemmy.worldEnglish
    22·
    7 hours ago

    140Wh seems off.

    It’s possible to run an LLM on a moderately-powered gaming PC (even a Steam Deck).

    Those consume power in the range of a few hundred watts and they can generate replies in a seconds, or maybe a minute or so. Power use throttles down when not actually working.

    That means a home pc could generate dozens of email-sized texts an hour using a few hundred watt-hours.

    I think that the article is missing some factor, such as how many parallel users the racks they’re discussing can support.