What AI really costs
Many AI apps feel free. Running them uses expensive chips, electricity and people. Someone pays, and it helps to know who.
In 60 seconds
What AI really costs
Many AI apps feel free. Running them uses expensive chips, electricity and people. Someone pays, and it helps to know who.
Where the costs come from
| Cost | Simple meaning |
|---|---|
| Training | Teaching the model at the start. It needs huge amounts of data, many specialised chips and a long time. |
| Running (inference) | Producing answers for users. Smaller per question, but it happens millions of times. |
| Chips and hardware | Specialised processors are expensive and in high demand. |
| Electricity and cooling | Computers use power and get hot, so data centres must be cooled. |
| People | Researchers, engineers, safety teams, support staff and content reviewers. |
Tokens: how AI use is often measured
- 1
You send a message
Your words, plus any attached document and earlier chat, are counted as input tokens. - 2
The model works
Chips calculate the reply, one token at a time. - 3
The reply comes back
The reply is counted as output tokens. - 4
Someone pays
A business pays per token, or you pay through a subscription, adverts or your data.
Why “free” apps need a business model
- Freemium: basic use is free, and people pay for more features or more use.
- Subscriptions: a monthly fee.
- Advertising: the app shows adverts, sometimes based on what it knows about you.
- Data: some services may use what you type to improve their products, depending on their terms and settings.
- Bundling: AI is included to make you buy or keep another product.
- Pasting a 100-page document to ask one simple question
- Assuming a free app has no privacy trade-off
- Paying for three AI subscriptions you rarely use
- Sharing only the part of the document you need
- Checking the app's settings and privacy terms
- Paying only for the tool that clearly saves you time
Watch and read more
Lab
A comparison table of how three AI apps make money and treat your data.
The problem
Choose three AI apps or services you have heard of.
- For each, find the official pricing page and the privacy policy.
- Fill a table: free tier (yes/no, limits), paid price, how it earns money, whether your chats may be used for training, whether you can turn that off.
- Write down anything you could not find clearly.
- Write three sentences: which one gives the clearest deal, and why.
Use only information from the companies' own pages. Note the date you checked, because prices change.
You are done when
Hard questions
Try to answer before you reveal. If you can answer these, you understood the lesson.
Q1Why might an AI company choose to lose money on each free user?Reveal
Because users today can become paying customers later, and a large user base can attract investment, partners and feedback that improves the product. It is a bet on the future. The risk is that if the company cannot find a way to earn enough, it may raise prices, add adverts, change its data terms or close.
Q2Two answers are equally correct, but one is three times longer. Why can the shorter one be better for a business?Reveal
It costs less to produce, is faster to read and is often clearer. Across millions of answers, the saving in cost and time is large. Good design asks for the length the reader needs, not the most words possible.
Questions people ask
If AI is so expensive, why do companies give it away?
To attract users, learn what people want, build habits, and later sell paid plans or other services. Some companies also accept losses for a while, hoping to lead the market.
Does a longer answer really cost more?
For services that charge by tokens, yes. More words out means more calculation. That is why businesses often ask for shorter answers when detail is not needed.
Will AI get cheaper?
The cost of a given level of AI ability has often fallen as chips and methods improve. At the same time, newer and larger models can be expensive. It is hard to predict exactly how prices will move.
Does using AI use a lot of energy?
Each answer uses some electricity, and data centres use a lot in total. The amount per question depends on the model and the task. The lesson “AI and the environment” in the AI rules and society track looks at this more closely.
Lesson test
5 questions. Get 3 right (60%) to pass and complete this lesson.