How does UTF-8 handle languages like Hindi or Chinese?

In one line

The rule

UTF-8 is a variable-length character encoding for Unicode, using 1 to 4 bytes to represent each character.

A byte is 8 bits (like 8 on/off switches). A character encoding is a way to turn letters and symbols into numbers so computers can store and share them.

Let's understand it simply

Imagine you have a big box of crayons. For English, you only need a few basic colors (like red, blue, green). But for Hindi or Chinese, you need many more colors to draw all the letters and symbols. UTF-8 is like a smart crayon box. For simple letters (A, B, C), it uses just one slot. For more complex letters (like 'अ' in Hindi or '你' in Chinese), it uses extra slots. This way, it can fit every language in the world into one box!

How it works

1. Every character in every language is given a unique number, called a Unicode code point.
2. UTF-8 takes this number and stores it using 1, 2, 3, or 4 bytes.
3. Simple English letters (like 'A') use just 1 byte.
4. Hindi letters (like 'क') or Chinese characters (like '你') use 2, 3, or 4 bytes, depending on their code point.
5. When you type or read a file, the computer reads these bytes and knows how to turn them back into the right letter or symbol.

The story behind it

In the 1980s and 1990s, computers mostly used English. Other languages had trouble because their letters didn't fit in the old systems. Unicode was created to give every letter in every language a unique number. UTF-8 was invented by Ken Thompson and Rob Pike in 1992 to store these numbers efficiently. One fun fact: UTF-8 was designed so that English text would look the same as before, but now you could add any language without breaking old files.

Where you see it in real life

• WhatsApp messages: When you send a message in Hindi or Chinese, UTF-8 makes sure the right letters appear on your friend's phone.
• Websites: Websites use UTF-8 so people can read them in any language, from Tamil to Russian.
• File names: You can save a file as 'मेरा_डॉक्युमेंट.txt' or '我的文件.txt' because UTF-8 supports these letters.
• Programming: When you write code that handles text, UTF-8 lets your program work with any language.
• SMS and emails: Modern phones and email apps use UTF-8 so you can send messages in any script.
• Government forms: Online forms in India use UTF-8 so you can fill them in Hindi, Bengali, or any other language.

Why it matters

• Universal communication: Lets people from different countries share information without errors.
• Saves space: English text stays small, but other languages fit too.
• No more confusion: Old systems would mix up letters; UTF-8 avoids this.
• Needed for modern apps: Almost every website, app, and phone uses UTF-8 today.

Worked example

Let's see how UTF-8 stores the Hindi letter 'क' and the Chinese character '你'.

Given: 'A' (English), 'क' (Hindi), '你' (Chinese)
Step 1: Find Unicode code points
  'A' = U+0041
  'क' = U+0915
  '你' = U+4F60
Step 2: Encode in UTF-8
  'A': U+0041 → 1 byte: 01000001 (hex: 41)
  'क': U+0915 → 3 bytes: E0 A4 95
  '你': U+4F60 → 3 bytes: E4 BD A0
Step 3: Result
  'A' uses 1 byte, 'क' and '你' use 3 bytes each in UTF-8.

Common mistakes

• Thinking UTF-8 can only handle English: It can handle every language in the world.
• Believing every character uses the same space: Hindi and Chinese letters use more bytes than English letters.
• Mixing up Unicode and UTF-8: Unicode is the list of all characters; UTF-8 is one way to store them.
• Assuming older systems always work with UTF-8: Some old apps may not display Hindi or Chinese correctly if they don't support UTF-8.

Remember it

UTF-8 is like a stretchy bag: small for English, bigger for Hindi or Chinese, but fits every letter in the world.