AI for Indian languagesMiddleLesson 2386 min read

Text-to-speech and voice for Indian languages

Making a computer speak an Indian language naturally is about more than sound quality. Names, numbers, consent for voices and misuse of voice clones all matter.

Lesson in motion

In 60 seconds

Text-to-speech and voice for Indian languages

Making a computer speak an Indian language naturally is about more than sound quality. Names, numbers, consent for voices and misuse of voice clones all matter.

1/6
In simple words
Think of a new announcer at a railway station reading a list of trains. If they read "12627" as one huge number, or say the name of your town wrongly, everyone gets confused. A computer voice must learn to read like a good local announcer.
Text-to-speech (TTS) turns written text into spoken audio. In India it can read out messages for people who find reading hard, help people with low vision, speak answers from a helpline bot, or read lessons aloud in a learner's own language.

What makes a voice good

QualityWhat it meansAn example to test
IntelligibilityPeople can understand every wordPlay it to listeners and ask them to write what they heard
NaturalnessIt sounds like a person, with natural rhythm and stressDoes a question sound like a question?
PronunciationWords, names and borrowed English words are said correctlyNames of districts, rivers, people and schemes
Text normalisationNumbers, dates, money and short forms are read the right way"₹1,250", "12/08", "Dr.", a train number, a PIN code
Right registerThe voice fits the setting: warm for a helpline, clear for an announcementThe same sentence in formal and friendly style

Numbers and names are the hardest part

Before audio is made, the text is usually normalised: numbers and symbols are turned into words. This step needs local rules. A phone number is read digit by digit. A train number may be read in groups. An amount of money is read as a number. Indian numbering uses lakh and crore, and people may say amounts in English or in their own language, sometimes mixed.
  • Build a pronunciation list (a lexicon) for names that matter to your users: places, crops, medicines, schemes, people.
  • Test code-mixed sentences. Does the voice say English words naturally inside an Indian-language sentence?
  • Test scripts. Can it read the language when written in its own script, and does it do something sensible with Roman letters?

Judging a voice with people

  1. 1

    Pick sentences

    Real sentences from your app, including names, numbers and mixed language.
  2. 2

    Choose listeners

    Native speakers from the regions and age groups you serve.
  3. 3

    Ask simple questions

    "Write what you heard", and "How natural was it, 1 to 5?" (a mean opinion score).
  4. 4

    Collect problems

    List every mispronounced word and wrong number reading.
  5. 5

    Fix and retest

    Update the lexicon and rules, then test again with new listeners.

Voices belong to people

Some modern systems can copy a person's voice from a short recording. This is called voice cloning. It can help: for example, someone who is losing their voice to illness may want a synthetic voice that sounds like them. It can also hurt badly.
Danger
Voice clones are used in scams: a fake call "from your son" asking for money on UPI, or a fake "boss" asking for an urgent transfer. Never build a feature that lets someone clone a voice without strong proof that the voice owner agreed.
Careless voice product
  • Anyone can upload any recording and clone the voice
  • Voice actors sign a vague form once, forever
  • No way to tell the audio is synthetic
Responsible voice product
  • Clear, recorded consent from the voice owner, checked before cloning
  • Contracts that say where, how long and for what the voice is used, with fair pay
  • Disclosure that the voice is AI-made, and content credentials or watermarking where possible
Note
Consent should be informed (the person understands what will happen), specific (for this use), and revocable (they can withdraw it later, and you have a plan to stop using the voice). Laws on personal data and on using a person's voice or likeness apply too; take legal advice for a real product.
Try this. Write ten sentences that would trip up a TTS voice in a language you know: a price in lakh, a date, a PIN code, a place name, and a Hinglish sentence. This list is the start of a real test set.

Watch and read more

Lab

A 20-sentence TTS test sheet for one language, with a listening plan.

~30 min

The problem

Pick one Indian language you know well.

  1. Write 20 test sentences: 5 with numbers (money in lakh or crore, dates, phone numbers, PIN codes), 5 with names of places or people, 5 code-mixed sentences, and 5 everyday sentences in natural style.
  2. For each, write how it should be spoken, in words.
  3. If you can, try a free TTS tool on 5 of them. Do not upload anyone else's voice. Note any errors.
  4. Write a short plan: who will listen, how many listeners, and the two questions you will ask them.

You are done when

Hard questions

Try to answer before you reveal. If you can answer these, you understood the lesson.

Q1A voice sounds very natural but often says place names wrongly. Is it ready to ship for a railway app?Reveal

Probably not. In that app, place names carry the key information. A natural voice that says the wrong station is worse than a plain one that is correct. Quality must be judged on the words that matter for the task, not only on general naturalness.

Q2A user says they want to clone their late grandfather's voice from old family videos. What should a responsible product do?Reveal

This is a sensitive case. The grandfather cannot consent, and other family members may disagree. A careful product would have a clear policy, require proof of the right to use the recordings and agreement from the family members who hold those rights, keep the result private, mark it as synthetic, and allow it to be deleted. Many teams choose not to offer this at all. Where laws apply, take legal advice.

Please sign in to continue.

Questions people ask

What is a mean opinion score (MOS)?

Listeners rate audio, usually from 1 (bad) to 5 (excellent), and you average the ratings. It is simple and widely used, but it depends on who listens and what they compare against. Use native speakers and report how many listened.

Should an AI voice say it is an AI?

Yes, people should not be tricked into thinking they are talking to a human. A short disclosure at the start of a call or on the screen is a good habit, and rules in some places may require it.

Can I use a film actor's voice from YouTube to train a voice?

No. The voice belongs to the person, and the recording is usually copyrighted too. Use your own voice, a voice actor who has signed a clear paid agreement, or an openly licensed voice dataset that allows your use.

How do I stop my voice product from being misused?

Check consent before creating any cloned voice, limit who can create voices, log what is made, add disclosure and watermarks where possible, block known misuse, and give people a way to report abuse. No single step is enough on its own.

Lesson test

5 questions. Get 3 right (60%) to pass and complete this lesson.

Sign in to take the test and save your progress