Tech Tip #19: Make AI pay for itself in energy

Can your AI save more energy than it uses?

Video created by explainapaper.com

The problem

Projects that use AI to optimise things rarely count the AI's own energy. Without that number, a 'green' AI project can be net negative.

The fix you can use today

  • Estimate the AI's energy per run from published provider figures.
  • Set it against the saving, over the years the result is deployed.
  • Skip runs where the return doesn't justify the inference.

GreenCode worked out the energy cost of its own AI, and it turns down work that would not pay that back.

Tools that help

  • CodeCarbon: a Python package that estimates the energy and CO2 of a run from hardware power and regional grid intensity
  • AI Energy Score (Hugging Face): comparable energy ratings for AI models on common tasks

How GreenCode helps

GreenCode helps tackle this by setting its own AI footprint against the saving it makes, in its climate case. It measures reductions in absolute terms and shows owners where capacity can be retired, so a saving is banked rather than spent. More on this.

Tags

#llm#esg#governance

Sources

Transcript

Can your AI save more energy than it uses? Many projects use AI to make things more efficient. But they rarely count the energy the AI itself uses. Without that number, you cannot tell if you are ahead. A green AI project can end up using more than it saves. Here is the fix you can use today. Estimate the AI's energy for each run, from the provider's published figures. Tools like CodeCarbon and the AI Energy Score help you put a number on it. Set that against the saving, over the years the result is in use. Skip runs where the return does not justify the AI's energy. GreenCode worked out the energy cost of its own AI. It turns down work that would not pay that back. GreenCode helps tackle this by measuring each saving in absolute terms, in its climate case. It shows where capacity can be retired, so the saving is kept, not spent. That was GreenCode Tech Tip number nineteen. Follow for the next tip, and find more on greencode.ai/tech-tips.

All GreenCode Tech Tips · All GreenCode videos

  • Tip #19
  • For CTOs and technical leads
  • Length 1:02
  • Category AI and machine learning
GreenCode

Want this checked on your own system? Talk to the GreenCode team.

Get in touch