Vibeleaderboard
← All Intel
Intel / article

How Do Prompt Variations Affect Energy Consumption in On-Device LLMs?

Source
arxiv.org
Author
Wei Hu, Xiaolong Tu, Dawei Chen, Yitao Chen, Kyungtae Han, Haoxin Wang
Date

Context

How a request is worded can change the energy consumed by an AI model running on a mobile device. This study separates energy spent processing the prompt from energy spent generating the response. It finds that phrasing changes mainly affect how many text units the model processes or produces, while changes in reasoning demands also affect the measured energy per unit.

The best balance between answer quality and energy use varies by model. For developers building battery-powered assistants, the finding makes prompt choice something to measure alongside model choice: a wording change that improves one model's efficiency may produce a different trade-off in another.

Terms in this piece · Glossary
  • token — The chunk of text a model reads and writes in — roughly three-quarters of a word — and the unit AI usage is billed in.
Recommended reads
Comments

Checking sign-in…

Loading comments…