Benchmark run

2026 09 v2 hviske v5 tiny q4 k

benchmark-v2 publication batch 2026-09-v2; codictate hviske-v5-tiny-q4_k; clips [0, 400) of the consumable range; hotkey option+z

Sep 5, 2026

Models
1
Samples per dataset
400
Warmup runs
3
Hardware
Apple M4 Max / 36 GB / macOS 26.6.2

Full results

Accuracy is the share of words transcribed correctly per language condition, so higher is better; speed is milliseconds per second of audio, so lower is better. The best value in each column is emphasised, and a cell reading a dash says on hover why there is no figure in it.

Accuracy (%) per language, and speed in ms per second of audio, so lower is better. A cell reading a dash was never measured, and hovering any cell says what is behind it.

Hviske v5 Tiny Q4_K400153 MB295 MB19 ms88.8%Every word from every language counted together, not an average of per-language scores.Not scored on any benchmark language.88.8%Every word from every language counted together, not an average of per-language scores.88.8%

At a glance

Ratings computed from benchmark data, scaled 1 to 10, and written with their scale in every cell. Accuracy is based on Word Error Rate (WER) and does not include punctuation yet.

Ratings run 1 to 10, higher is better. A cell reading a dash was never measured, and hovering any cell says what is behind it.

Hviske v5 Tiny Q4_KDanish onlyNo10/109/10Every word from every language counted together, not an average of per-language scores.

Charts

The plots generated alongside this run. Select a chart to open it full size.

Bar chart comparing model accuracy across English, Spanish, Danish, and Hungarian benchmark conditions.
Accuracy by model and test condition
Bar chart comparing transcription speed across models and test conditions.
Speed comparison across conditions
Bar chart showing average English, multilingual, and overall accuracy per model.
Average accuracy by language group