- Source value
- 85.11
- Metric
- Dose / unit matches; source row gives 80 / 94 reference events
- Unit
- %
- Benchmark version
- Omi realtime transcription, edition 2026-10-18.1
- Category
- audio
- Direction
- Higher is better
- Sample
- 94
- Source type
- community-reported
- Evaluator
- Omi Health Medical Speech-to-Text Benchmark
- Status
- active
- Retrieved at
- 2026-10-19
- Methodology
- Community-reported result. Exact realtime-table row label Microsoft MAI-Transcribe-2 Streaming. The source describes a shared set of 1,513 English recordings (7.2 hours); every model uses the same audio and scorer. Medical WER covers 2,872 medical words, drug errors 442 occurrences, and dose/unit matching 94 reference events. The source says the MAI streaming row was added in October 2026 but does not state its exact accuracy-run date or immutable serving revision. For speed, the page reports a 19 October 2026 US AWS Ohio client, Azure Sweden Central deployment, shared end-of-speech signal, 200 short clips under 30 seconds, one pass, and timing n=199 after exclusions.
- Context
- Omi runs and publishes this benchmark while operating its own competing medical transcription product, so retain sourceType community-reported rather than treating it as a neutral independent replication. The source says other providers' accuracy comes from September 2026 and this MAI row was added in October, but it does not give this row's exact accuracy run date. No confidence interval or immutable MAI serving revision is published; the source warns that small differences do not establish statistical significance and scores do not establish clinical safety. Overall WER's reference-word denominator is not stated; 1,513 is the recording count. Precision/F1 denominators are not separately stated.