Back to home

Accuracy & Performance

This page states what has actually been measured, with the raw method behind each number - not marketing claims. Right now that is one feature: the maths-equation engine. Other features are listed below with an honest "not yet measured" note rather than an invented figure.

Azadi Math - equation dictation accuracy

96.3%
Correct
1348/1400 cases
99.6%
Valid in Word
1395/1400
70
Languages tested
35 perfect (20/20)
2026-08-19
Test date
live production run

Bangla itself scored 20/20 - perfect, one of 35 languages with a flawless result.

Methodology

A text-door test: 20 real equations (calculus, integrals, quantum mechanics, matrices, chemistry, series and limits) were sent as written spoken-form transcripts, in 70 languages, through the live production endpoint (azadi24.com/api/ai/complete) and checked by the actual shipped OMML converter - not a mock. It measures language understanding and equation accuracy; it does not include the audio/speech-recognition step. Raw per-language and per-equation results are committed in the source repository.

This was a text-door test: it sent written spoken-form transcripts (what someone would say out loud), not real audio - so it measures language understanding and mathematical accuracy, but excludes the speech-recognition step itself (accent, background noise, microphone quality). It ran against the real, live production endpoint and the exact converter shipped in the app - never a lab-only mock.

Result by equation

Each of these 20 equations was tested in all 70 languages (max 70 correct per row). The hardest cases involve deeply nested notation - the Schrodinger equation and a chemistry reaction were the two lowest scores, both still above 70%.

EquationCorrect
Quadratic formula70/70
Gaussian integral70/70
Basel problem70/70
Standard limit70/70
Mass-energy equivalence70/70
Euler's identity70/70
Pythagorean theorem70/70
Derivative definition70/70
Binomial coefficient67/70
Cube root70/70
Schrodinger equation55/70
1D wave equation68/70
Gauss's law64/70
Newton's law of gravitation66/70
Water formation (chemistry)50/70
2x2 determinant68/70
Exponential series70/70
Integration by parts70/70
Log product rule70/70
Trig identity70/70

Result by language

All 70 tested languages, out of 20 equations each. "Minor" means a small, cosmetically-off but mathematically-readable result; "wrong" means a genuinely incorrect equation.

LanguageCorrectMinorWrong
Afrikaans20/20--
Bangla (বাংলা)20/20--
Burmese20/20--
Chinese20/20--
Czech20/20--
Danish20/20--
Dutch20/20--
English20/20--
Finnish20/20--
French20/20--
German20/20--
Gujarati20/20--
Hebrew20/20--
Hindi20/20--
Indonesian20/20--
Japanese20/20--
Kannada20/20--
Malay20/20--
Marathi20/20--
Norwegian20/20--
Persian20/20--
Polish20/20--
Portuguese20/20--
Punjabi20/20--
Romanian20/20--
Russian20/20--
Sinhala20/20--
Slovak20/20--
Spanish20/20--
Swahili20/20--
Swedish20/20--
Tamil20/20--
Thai20/20--
Turkish20/20--
Vietnamese20/20--
Arabic19/201-
Azerbaijani19/201-
Bulgarian19/201-
Croatian19/20-1
Estonian19/201-
Filipino19/201-
Georgian19/201-
Hungarian19/201-
Italian19/20-1
Kazakh19/201-
Khmer19/20-1
Korean19/201-
Lao19/20-1
Lithuanian19/20-1
Macedonian19/201-
Malayalam19/201-
Mongolian19/201-
Nepali19/201-
Serbian19/20-1
Telugu19/201-
Ukrainian19/201-
Urdu19/201-
Yoruba19/201-
Zulu19/201-
Albanian18/2011
Amharic18/202-
Bosnian18/2011
Galician18/202-
Hausa18/202-
Uzbek18/2011
Armenian17/2012
Greek17/2021
Latvian17/2021
Slovenian17/2021
Catalan16/2022

Voice typing: two modes, two accuracy profiles

Free and Pro voice typing are not the same experience, and stating one accuracy number for both would be misleading. There are two distinct modes:

  • Polish mode - hold the shortcut, speak, release: the whole utterance is cleaned up by our AI (punctuation, grammar, mixed Bangla-English handled together) before it is typed. This is Azadi 24's most accurate mode. Pro accounts get it unlimited; a free account gets 15 polish-mode dictations every day - past the 15th a notification appears, and holding the shortcut falls back to the mode below until the next day (or a Pro upgrade).
  • Standard streaming mode - the default tap/click typing: words appear in real time as you speak, free and unlimited for everyone, forever - it is what makes Bangla voice typing free-forever possible at all. It does not run the AI cleanup pass, so punctuation and mixed-language handling are lighter-touch than polish mode.

A real, controlled accuracy benchmark for both modes - using known test sentences dictated on the actual product, not a lab mock - is in progress and will be published here with the same methodology and raw-data standard as the maths benchmark above, once complete.

Not yet measured

These features are real and shipped, but do not yet have a published accuracy figure - re-testing them rigorously needs new measurement tooling and real paid API calls, which has not been done yet. We would rather say this plainly than publish an invented number.

  • Voice-typing recognition accuracy for both modes (word/character error rate) - benchmark in progress, see above
  • AI-polish output quality (grammar, cleanup)
  • Translation accuracy
  • Per-feature latency percentiles

Read more about how equation dictation works on the feature documentation page.