Mercury 2.5, Inception: 576 tokens per second · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06576
Gemini 3.1 Flash-Lite, Google: 336 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06336
Gemini 3.5 Flash-Lite, Google: 299 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06299
Nemotron 3.5 Lightning, NVIDIA: 245 tokens per second · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06245
Claude Haiku 5.5, Anthropic: 236 tokens per second · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06236
o3-mini, OpenAI: 230 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06230
Ling 3.0 Flash, inclusionAI: 199 tokens per second · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06199
DeepSeek-V3 0324, DeepSeek: 195 tokens per second · Configuration Non-reasoning · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06195
GPT-5.4 mini, OpenAI: 191 tokens per second · Configuration Xhigh effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06191
Gemini 3 Flash Preview, Google: 191 tokens per second · Configuration Non-reasoning · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06191
Gemini 3.5 Flash, Google: 184 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06184
Gemini 3.6 Flash, Google: 182 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06182
Command A Plus, Cohere: 177 tokens per second · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06177
DeepSeek-V4.1-Flash, DeepSeek: 176 tokens per second · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06176
DeepSeek V4.1 Flash 1017, DeepSeek: 172 tokens per second · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06172
Qwen 3.7 Max, Alibaba: 165 tokens per second · Configuration Reasoning enabled; effort unspecified · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06165
GPT-5.4 nano, OpenAI: 153 tokens per second · Configuration Xhigh effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06153
GPT OSS 20B, OpenAI: 152 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06152
GPT OSS 120B, OpenAI: 151 tokens per second · Configuration High effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06151
Claude Sonnet 5.5, Anthropic: 151 tokens per second · Configuration Max effort · AA 3.0.0, including time to first token, averaged across available workloads and five days · Retrieved 2026-11-06151