greenai.guide

Home › Articles › Energy-efficient AI: how to make AI use less

Article

Energy-efficient AI: how to make AI use less

Updated · 10 min read

In short

Energy-efficient AI means getting the same useful result for less electricity. The biggest savings usually come from choosing a smaller or task-specific model, switching off long reasoning when it isn't needed, and running in an efficient data centre on a clean grid; techniques such as quantisation, distillation, routing, caching and batching then reduce AI energy further. Published studies report savings from tens of per cent up to 90% or more for individual levers, and far larger when they are combined.

Key points

  • UNESCO and UCL found that small task-specific models can cut energy use by up to 90%, and that shorter prompts and responses can cut it by over 50%.
  • Reasoning models used on average 30 times more energy than standard models in Hugging Face's AI Energy Score tests; switching reasoning on raised one model's energy 150 to 700 times.
  • In a 2024 study, generating 1,000 images used about 2.9 kWh, against 0.002 kWh for 1,000 text classifications.
  • Google researchers estimated that the choice of model, data centre and processor together can reduce the carbon footprint of training by up to around 100 to 1,000 times.
  • Efficient serving matters: vLLM's memory management gave 2 to 4 times the throughput at the same latency, and speculative decoding made one model 2 to 3 times faster with identical outputs.
  • Starting short training jobs at low-carbon times cut emissions by up to 80% in one study, but by less than 1.5% for a long job.

Energy-efficient AI is AI that gets you the result you need for less electricity. This page sets out the main ways to reduce AI energy, roughly in order of how much they usually save, with the published figures behind each one.

What is the quickest way to make AI use less energy?

Use the smallest suitable model, and don't switch on heavy modes you don't need. Model choice usually outweighs every other lever because energy scales with how much computation each answer takes. A 2025 report by UNESCO and University College London (UCL) found that small task-specific models can cut energy use by up to 90%, and that shorter prompts and responses can cut it by over 50%. Used together, the report says, such measures can reduce energy consumption by up to 90%.

The second big lever is location. Google researchers estimated in 2021 that the choice of model, data centre and processor together can reduce the carbon footprint of training by up to around 100 to 1,000 times. Efficient AI models, run in efficient places, are where most of the gain lies.

Which levers save the most? A ranked list

The order below reflects the typical size of the saving in published studies, largest first. Your own results will depend on the task, the quality you need and where the work runs, so measure before and after (see how to measure the energy and carbon of AI).

1. Don't use generative AI for jobs it isn't needed for

Generation is far more expensive than simpler tasks. In a 2024 study, Sasha Luccioni, Yacine Jernite and Emma Strubell measured image generation at a mean of about 2.9 kWh per 1,000 images, against 0.002 kWh per 1,000 text classifications: well over a thousand times as much per request. They also found that general-purpose generative models are orders of magnitude more expensive than task-specific systems for the same task.

Video is heavier still. A 2025 study of open text-to-video models measured nearly 90 Wh for a short clip from one model and over 415 Wh from a larger one, with energy growing quadratically with the size and length of the video. See how to decide if you need AI for a task and how to choose classical machine learning instead of an LLM.

2. Right-size the model

Pick the smallest model that meets your quality bar. Beyond the UNESCO–UCL finding, research on cascades shows how much headroom there is: FrugalGPT, which tries cheaper models first and escalates only when needed, matched GPT-4's performance with up to 98% lower cost. Cost is not energy, but for hosted models it is a reasonable rough guide to computation. See choose the right model for the job, how to choose a smaller AI model and how to find a task-specific model.

3. Use reasoning modes only when needed

"Thinking" modes multiply energy. Hugging Face's AI Energy Score tests in late 2025 found that reasoning models used, on average, 30 times more energy than standard ones, and that the same model used between 150 and 700 times more energy with reasoning on than off. Agents, which make many calls in a loop, can add up the same way. See how to use reasoning modes only when needed and agentic AI and token waste.

4. Choose efficient hardware, data centres and low-carbon locations

Where and on what the work runs can change its carbon by several times. Jesse Dodge and colleagues found that training the same BERT model emitted about 7 kg of CO₂ in the most efficient cloud region and about 26 kg in the least efficient, almost four times as much. Hardware keeps improving too: Epoch AI estimates that leading machine learning chips become about 40% more energy-efficient each year. See green AI hosting and data centres, how to pick a low-carbon cloud region and how to choose energy-efficient hardware for AI.

5. Shorten prompts, context and outputs

Energy rises with how much the model reads and writes. Epoch AI estimates a typical ChatGPT query at about 0.3 Wh, rising to about 2.5 Wh with a 10,000-token input and almost 40 Wh with a 100,000-token input. Resending long conversations and asking for long answers are the everyday causes. See how to write prompts that use less energy, how to limit how much an LLM writes and how to stop resending the whole conversation.

6. Route requests to the right model

Send easy requests to a small model and hard ones to a large one. Routing research reports large savings: Hybrid LLM made up to 40% fewer calls to the large model with no drop in response quality, and RouteLLM reduced costs by over two times in some cases without compromising quality. See how to set up model routing and orchestration over generation.

7. Quantise the model

Store and compute with fewer bits per number. Quantisation reduces memory and data movement, which dominate energy in large models. LLM.int8() cut the memory needed for inference by half while keeping full-precision performance, and the UNESCO–UCL report found compression such as quantisation saved up to 44% of energy. See how to quantise a model.

8. Distil a large model into a small one

Train a small "student" model to copy a large "teacher". Distillation is how many efficient AI models are made. DistilBERT was 40% smaller and 60% faster than BERT while keeping 97% of its language-understanding ability. See how to distil a large model into a small one.

9. Prune and exploit sparsity

Remove weights the model doesn't need. SparseGPT showed that very large language models can be pruned to at least 50% sparsity in one shot, without retraining, at minimal loss of accuracy. Energy savings depend on whether the software and hardware can skip the zeros, so pruning saves less in practice than the headline sparsity suggests. See how to prune a neural network.

10. Cache, batch and serve efficiently

Avoid repeating work and keep the hardware busy. Serving software matters: vLLM's paged KV cache management improved throughput 2 to 4 times at the same latency, and speculative decoding made T5-XXL 2 to 3 times faster with identical outputs. Providers price reuse accordingly: OpenAI's Batch API costs 50% less than standard requests, and Anthropic charges 10% of the normal input price for cached prompt reads. See how to cache LLM calls, how to batch AI requests, how to use speculative decoding and how to cut the energy of serving a model.

11. Schedule flexible work for cleaner times

Carbon-aware scheduling cuts emissions, not energy, and works best for short, flexible jobs. In Dodge and colleagues' study, delaying the start of a short training job to a low-carbon time cut emissions by up to 80% in one US region, but by less than 1.5% for a long job; pausing and resuming a long job saved up to about 25%. See how to schedule training when the grid is greener and carbon-aware computing.

Energy-efficient AI levers at a glance

This table summarises the levers, who can use them and the savings reported in the sources. Figures are from different studies with different baselines, so read them as indications of scale, not as additive totals.

Lever Who can use it Typical saving reported Source
Use a task-specific model instead of a generative one Developers, organisations Orders of magnitude for tasks such as classification Luccioni, Jernite and Strubell, 2024
Smaller, task-specific model Users, developers Up to 90% energy UNESCO and UCL, 2025
Reasoning off unless needed Users, developers 150–700 times less for one model; 30 times on average across models Hugging Face AI Energy Score, 2025
Model, data centre and processor together Developers, organisations Up to about 100–1,000 times less carbon (training) Patterson et al., Google, 2021
Low-carbon cloud region Developers, organisations About 3.7 times between best and worst region Dodge et al., 2022
Shorter prompts and responses Users, developers Over 50% energy UNESCO and UCL, 2025
Routing Developers Up to 40% fewer large-model calls Ding et al., 2024
Quantisation Developers Up to 44% energy; half the memory UNESCO and UCL, 2025; Dettmers et al., 2022
Distillation Developers 40% smaller, 60% faster, 97% of ability kept Sanh et al., 2019
Pruning Developers At least 50% of weights removed Frantar and Alistarh, 2023
Efficient serving and batching Developers 2–4 times the throughput Kwon et al., 2023
Speculative decoding Developers 2–3 times faster, same outputs Leviathan et al., 2022
Carbon-aware start time Developers, researchers Up to 80% (short jobs); under 1.5% (long jobs) Dodge et al., 2022
Parameter-efficient fine-tuning (LoRA) Developers, researchers 10,000 times fewer trainable parameters, 3 times less GPU memory Hu et al., 2021

How can users reduce AI energy?

Choose lighter options and ask for less. Most people can't change the data centre, but they can change what they ask for:

For scale, Google reported in 2025 that a median Gemini text prompt used 0.24 Wh. Individual text prompts are small; the totals come from very high volumes and from the heavier tasks above. See the guide for the public.

How can developers build efficient AI models and systems?

Right-size first, then optimise serving, then measure. A practical order:

  1. Set a quality bar on your own data and test the smallest candidate models against it.
  2. Add routing or a cascade so the large model handles only what the small one can't.
  3. Quantise, and consider distillation if volumes are high.
  4. Serve with an efficient runtime: batching, paged KV cache, prompt caching and speculative decoding.
  5. Cap output length and agent loops; see how to stop AI agents wasting tokens.
  6. Fine-tune with LoRA rather than training from scratch; see how to avoid training a model from scratch.
  7. Measure energy per task before and after; see how to track AI energy per task.

More detail is in efficient AI training and inference and maths for efficient AI.

How can organisations reduce AI energy at scale?

Set defaults, buy well and measure. The biggest organisational levers are which model is the default, which features are on by default, and where workloads run:

Does energy-efficient AI reduce total energy use?

Only if total use doesn't grow faster than efficiency improves. Google reported that the energy of its median Gemini prompt fell 33-fold in a year, yet data-centre electricity use keeps rising worldwide because use is growing faster. This is the rebound effect. Efficiency lowers the cost of each task; sufficiency asks whether the task needs doing. Both are needed, as efficiency is not sufficiency explains, and how to stop efficiency gains being cancelled out gives practical steps. For the wider picture, see AI and data centre electricity demand and AI energy statistics.

What to do next

  • Test whether a smaller model meets your quality bar, and switch to it if it does.
  • Turn off reasoning, image and video modes by default where they aren't needed.
  • Add caching, batching and routing to any AI feature with real volume.
  • Choose a low-carbon region and an efficient provider for new workloads.
  • Measure energy per task before and after each change, and report the result.
  • Find help in the consultants directory or learn more through courses.

Frequently asked questions

What is energy-efficient AI?

It is AI that delivers the result you need for less electricity, through smaller or more suitable models, leaner software, efficient hardware and data centres, and using AI only where it adds value. It is part of green AI, which also asks whether the total use is sensible.

How can I reduce AI energy use?

As a user, choose a smaller or faster model, keep prompts and requested answers short, avoid regenerating and use reasoning or image and video modes only when needed. As a developer, right-size the model, then add quantisation, routing, caching and batching, and run in a low-carbon region.

Are smaller AI models more energy efficient?

Usually, for the tasks they can do well. UNESCO and UCL report that small task-specific models can cut energy use by up to 90% on suitable tasks. Check quality on your own work: a small model that has to be re-run several times may save nothing.

Does quantisation save energy?

Usually yes, because the model moves less data and needs less memory. UNESCO and UCL report savings of up to 44% from model compression such as quantisation, and LLM.int8() halved the memory needed for inference. The saving depends on whether the hardware supports the lower precision.

Which AI uses the most energy?

Video generation, then image generation and long reasoning or agent tasks. In a 2025 study, one open model used nearly 90 Wh for a short video clip and a larger one over 415 Wh, and reasoning models used about 30 times more energy than standard ones on average.

Does efficiency actually reduce AI's total energy use?

Not automatically. Cheaper, faster AI tends to be used more, the rebound effect. Efficiency reduces energy per task; keeping totals down also needs sufficiency, meaning using AI where it is worth it.

Do AI providers save energy with prompt caching and batch processing?

They avoid repeated work, which is why they charge less for it: OpenAI discounts batch jobs by 50%, and cached input on several providers costs around a tenth of the normal rate. Prices are a rough guide to compute saved, not a measurement of energy.

Sources

  1. AI large language models: new report shows small changes can reduce energy use by 90%, UNESCO and University College London (2025)
  2. AI Energy Score v2: refreshed leaderboard, now with reasoning, Hugging Face (Luccioni and Gamazaychikov) (2025)
  3. Power hungry processing: watts driving the cost of AI deployment?, Luccioni, Jernite and Strubell (FAccT 2024) (2024)
  4. Video killed the energy budget: characterizing the latency and power regimes of open text-to-video models, Delavande, Pierrard and Luccioni (2025)
  5. How much energy does ChatGPT use?, Epoch AI (2025)
  6. Carbon emissions and large neural network training, Patterson et al., Google (2021)
  7. Good news about the carbon footprint of machine learning training, Google Research (2022)
  8. Measuring the carbon intensity of AI in cloud instances, Dodge et al. (FAccT 2022) (2022)
  9. Measuring the environmental impact of delivering AI at Google scale, Elsworth et al., Google (2025)
  10. DistilBERT, a distilled version of BERT, Sanh et al., Hugging Face (2019)
  11. LLM.int8(): 8-bit matrix multiplication for transformers at scale, Dettmers et al. (2022)
  12. SparseGPT: massive language models can be accurately pruned in one-shot, Frantar and Alistarh (2023)
  13. FrugalGPT: how to use large language models while reducing cost and improving performance, Chen, Zaharia and Zou (2023)
  14. Hybrid LLM: cost-efficient and quality-aware query routing, Ding et al. (2024)
  15. RouteLLM: learning to route LLMs with preference data, Ong et al. (2024)
  16. Efficient memory management for large language model serving with PagedAttention, Kwon et al. (2023)
  17. Fast inference from transformers via speculative decoding, Leviathan, Kalman and Matias (2022)
  18. LoRA: low-rank adaptation of large language models, Hu et al. (2021)
  19. Batch API, OpenAI (2026)
  20. Prompt caching, Anthropic (2026)
  21. Leading ML hardware becomes 40% more energy-efficient each year, Epoch AI (2024)

Join us

Help cut AI's impact on the planet

Get new guides, funding calls and directory listings by email, about once a month. Or add your product, course, PhD or research to the directories.

No tracking. Unsubscribe in one click. Other ways to join · Privacy