---
title: "What are Arabic diacritics (tashkeel)? Harakat explained"
description: "Arabic diacritics (tashkeel) are optional vowel and shadda marks. What the Unicode marks are, why text omits them, and what that means for LLMs, search and tokens."
url: https://broadrouter.com/glossary/arabic-diacritics/
lang: en
updated: 2026-11-15
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# Arabic diacritics (tashkeel)

Updated 2026-11-15

Arabic diacritics, or tashkeel, are small marks written above or below letters to show short vowels, doubled consonants and the absence of a vowel. They are optional: most Arabic text, including news, omits them, so readers and software infer the vowels from context.

Also called: tashkeel, tashkil, harakat, diacritization, Arabic diacritization, diacritics, vowel marks

The same three Arabic letters can mean “he wrote”, “books” or “it was written”. Diacritics are what tell them apart, and most text leaves them out.

## How it works

The Unicode Standard calls these marks tashkil and says they “may be written as combining marks”, then adds: “In normal writing, however, these marks are omitted.” Harakat is the name for the short-vowel subset. Each mark is its own combining character that follows the letter it sits on. The main ones are in the range U+064B to U+0652:

| Code point | Name | Role |
| --- | --- | --- |
| U+064E | FATHA | short a |
| U+064F | DAMMA | short u |
| U+0650 | KASRA | short i |
| U+064B to U+064D | FATHATAN, DAMMATAN, KASRATAN | tanween (-an, -un, -in endings) |
| U+0651 | SHADDA | doubled consonant |
| U+0652 | SUKUN | no vowel |

A worked example with the bare word كتب:

-   كَتَبَ (kataba), “he wrote”
-   كُتُب (kutub), “books”
-   كُتِبَ (kutiba), “it was written”

Without marks, all three are the same string. A reader picks the meaning from the sentence. Software has to do the same, which is the job of a diacritizer. Zerrouki and Balla (2017) built the Tashkeela corpus, about 75.6 million words, mostly Classical Arabic, because fully vowelled text is scarce and diacritizers need it for training. Fadel et al. (2019) report neural diacritization models that match or beat earlier work on a public benchmark, and show that diacritics can help machine translation.

Libraries treat these marks as one set. CAMeL Tools’ `AR_DIAC_CHARSET` holds U+064B to U+0652 plus U+0670 (superscript alef), and its `dediac_ar` function removes them.

## Why it matters

-   **Search and matching.** The same word typed with and without marks is a different string. Strip them from the search key as part of [Arabic text normalization](https://broadrouter.com/glossary/arabic-text-normalization/), or exact matches fail.
-   **Tokens.** Every mark is an extra character for the [tokenizer](https://broadrouter.com/glossary/tokenizer/). Fully vowelled text uses noticeably more tokens than bare text; see [the diacritization guide](https://broadrouter.com/blog/arabic-diacritization-llm/) for measured ratios and [Arabic tokens per word](https://broadrouter.com/blog/tokens-per-word-arabic-english/) for the baseline.
-   **Speech and evaluation.** Transcripts usually come back without marks. Score [word error rate](https://broadrouter.com/glossary/word-error-rate/) after removing diacritics from both texts, or a correct word with an extra fatha counts as an error.
-   **When you need them.** Text-to-speech, language teaching, Quranic and poetic text, and names that are ambiguous without vowels.

## On BroadNet Inference

BroadNet has no diacritization endpoint. The chat models receive tashkeel as ordinary text through POST /v1/chat/completions, so you can ask a model such as [Qwen3.8 27B](https://broadrouter.com/models/qwen3.8-27b/) to add or remove marks. The safe pattern is to check the reply in code: remove the diacritics and compare with your input, letter for letter. The [LLM diacritization post](https://broadrouter.com/blog/arabic-diacritization-llm/) has the prompt and the check.

For removal, do not use a model at all. A short regex over U+064B to U+0652 is faster, free and exact. The [Arabic text normalizer](https://broadrouter.com/tools/arabic-text-normalizer/) shows the effect in the browser.

## Questions

### Should I strip diacritics before indexing Arabic text?

For keyword search, usually yes, on the search key only. Tashkeela's authors note that most search engines ignore diacritics. Keep the original text for display and for the LLM.

### Why does diacritized Arabic cost more tokens?

Each mark is a separate Unicode character, so a fully vowelled word has more characters for the tokenizer to split. Count your own text with a token counter before and after adding tashkeel.

### Can an LLM add diacritics reliably?

It can add them, but it may also change letters. Strip the marks from the reply and compare with the input; reject any reply where a letter changed.

## See also

-   [Arabic text normalization](https://broadrouter.com/glossary/arabic-text-normalization/) (term)
-   [Hamza](https://broadrouter.com/glossary/hamza/) (term)
-   [Unicode normalization](https://broadrouter.com/glossary/unicode-normalization/) (term)
-   [Tokenizer](https://broadrouter.com/glossary/tokenizer/) (term)
-   [Word error rate](https://broadrouter.com/glossary/word-error-rate/) (term)
-   [Modern Standard Arabic (MSA)](https://broadrouter.com/glossary/msa/) (term)
-   [Add diacritics to Arabic text with an LLM: prompt, checks, DER](https://broadrouter.com/blog/arabic-diacritization-llm/) (article)
-   [Arabic text normalization for search and RAG: what to change, what not](https://broadrouter.com/blog/arabic-text-normalization-search/) (article)
-   [Tokens per word in Arabic vs English: why Arabic costs more](https://broadrouter.com/blog/tokens-per-word-arabic-english/) (article)

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=glossary-arabic-diacritics&utm_content=page-cta) ·

**Sources**

-   [The Unicode Standard 18.0, Chapter 9 Middle East-I, Arabic (tashkil, combining marks) (checked 2026-11-15)](https://www.unicode.org/versions/Unicode18.0.0/core-spec/chapter-9/)
-   [Fadel, Tuffaha, Al-Jawarneh and Al-Ayyoub, Neural Arabic Text Diacritization: State of the Art Results and a Novel Approach for Machine Translation (WAT 2019, ACL Anthology) (checked 2026-11-15)](https://aclanthology.org/D19-5229/)
-   [Zerrouki and Balla, Tashkeela: Novel corpus of Arabic vocalized texts (Data in Brief, 2017) (checked 2026-11-15)](https://pmc.ncbi.nlm.nih.gov/articles/PMC5310197/)
-   [CAMeL Tools source, camel\_tools.utils.charsets (AR\_DIAC\_CHARSET) (checked 2026-11-15)](https://raw.githubusercontent.com/CAMeL-Lab/camel_tools/master/camel_tools/utils/charsets.py)
