• 0 Posts
  • 363 Comments
Joined 1 year ago
cake
Cake day: June 22nd, 2023

help-circle









  • You’re really trying yourself in knots to try and blame the big bad corpos and no one else.

    Yes they are shoving it in people’s faces, and when the average person uses their default browser with a default search engine and searches on Bing and it uses AI in addition to a search index they are to blame, but every single user who intentionally seeks out ChatGPT or Copilot is also to blame.

    It’s a new technology, people are going to use it and burn energy with it and then eventually we will make a more efficient version of it as it matures, similar to everything else, including traditional search.








  • Sure, a lot of computing power goes into, say, console gaming, but that’s not what I originally talked about. I talked about data centers training AI models and requiring ever more power and hardware as compared to what we expend on gaming, first of all.

    But they don’t. Right now the GPU powering every console, gaming PC, developer PC, graphic artist, twitch streamer, YouTube recap, etc. consumer far far more power than LLM training.

    And LLM training is still largely being done on GPUs which aren’t designed for it, as opposed to NPUs that can do so more efficiently at the chip level.

    I understand the idea that AI training will always inherently consumer power because you can always train a model on bigger or more data, or train more parameters, but most uses of AI are not training, they’re just users using an existing trained model. Google’s base search infrastructure also took a lot more carbon to build initially than is accounted for when they calculate the carbon cost of an individual search.