How do other encodings like UTF-16 work?

In one line

The rule

UTF-16 is a character encoding that uses 16 bits (2 bytes) for most characters, but can use 32 bits (4 bytes) for some special symbols.

• Each character is stored as one or two 16-bit units.
• Basic characters: 1 unit (2 bytes)
• Rare/special characters: 2 units (4 bytes)

Let's understand it simply

Imagine you want to send a letter to your friend, but you both only understand numbers. You decide to give every letter, number, and symbol a special number. This is what encoding means.

In UTF-16, most common letters (like A, B, क, 你) get a number that fits in 2 bytes (16 bits). But if you want to send a rare emoji or an ancient script, you might need 4 bytes (32 bits). It's like using one envelope for most letters, but sometimes you need two envelopes for a big card!

How it works

1. Every character is given a unique code number (called a code point).
2. If the code point is less than 65,536 (hex 0xFFFF), it fits in one 16-bit unit.
3. If the code point is bigger (like some emojis), it uses two 16-bit units (called a surrogate pair).
4. The computer stores or sends these numbers, not the actual letters.
5. When reading, the computer changes the numbers back to letters or symbols.

The story behind it

Before UTF-16, computers used different encodings for different languages (like ASCII for English, ISCII for Indian scripts), which made sharing files hard. Unicode was created to give every symbol in every language a unique number. UTF-16 was made in the 1990s as a way to store these numbers efficiently, especially for Asian languages where most characters fit in 16 bits.

Where you see it in real life

• Windows computers often use UTF-16 for text files and system messages.
• Many programming languages (like Java and JavaScript) use UTF-16 for storing strings.
• When you see emojis on your phone, they are often stored using UTF-16.
• Some web pages use UTF-16 to handle many languages at once.
• Text in Microsoft Word or Notepad can be saved as UTF-16.

Why it matters

• Lets computers show and share text in any language, including Hindi, Tamil, Chinese, and emojis.
• Helps programmers write apps that work worldwide.
• Used in exams and coding interviews (like CBSE Computer Science).
• Needed for safe data sharing between different devices and platforms.

Common mistakes

• Thinking every character always takes 2 bytes: Some need 4 bytes in UTF-16.
• Mixing up UTF-8 and UTF-16: UTF-8 uses 1–4 bytes per character, UTF-16 uses 2 or 4 bytes.
• Forgetting that not all software supports UTF-16 (some use UTF-8 or others).

Remember it

UTF-16: Most letters = 2 bytes, rare ones (like some emojis) = 4 bytes.