Language modelActive

Kimi K3

Moonshot AI

Released: July 16, 2026
Data date: September 8, 2026
Predecessor: Kimi K2.6

Benchmark-Meta-Score: 75.2 / 100
Provisional, 59.9 % panel coverage
Speed: 41.3 tokens/s
Output throughput
Price: $3 · $15
Input · Output / 1M tokens
Input: Text, Image, Video
Output: Text

What is distinctive about Kimi K3 is its native visual architecture with KDA and AttnRes. Moonshot describes 2.8 trillion total parameters, 104 billion active parameters, 896 experts with 16 selected per step, and a 1,048,576-token context window. Text, images, and video belong to the same model.

Reasoning is always enabled and can be controlled with Low, High, and Max. Moonshot places K3 alongside Kimi K2.6. Local use and redistribution remain subject to the Kimi K3 license and the conditions of the released weights.

Specifications and access

Specification	Value and source
Weights	Open weightsSource
Access	API, LocalSource
Parameters	2.8TSource
Active parameters	104BSource
Context window	1,048,576 tokensSource
Notes	2.8T total, 104B active, 896 experts with 16 active experts per token, KDA hybrid linear attention, native vision, and a 1,048,576-token context window. Model weights are published.Source
License	Kimi K3 LicenseSource
Parameters	2,800 BSource
Active parameters	104 BSource
Architecture	MoE with KDA, gated MLA, 896 experts/16 selected, MoonViT V2Source
Output	TextSource
Tool calling	YesSource
Quantization	MXFP4 weights / MXFP8 activationsSource
Input	Text, Image, VideoSource
Reasoning mode	Always enabled; reasoning effort: low, high, max (default max).Source

Benchmark meta-analysis

Overall and area scores

These Gradually indexes place selected published measurements on a 0 to 100 scale. They are not accuracy percentages and do not guarantee results in your application.

Retrieval dates of the sources used 2026-10-15 - 2026-10-19

Overall index

Index 75.2 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 60 %
Test families: 46 / 71
Sources: 4
Mathematical bounds with missing values: 45.1-85.2 / 100

Coding

Index 57.5 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 72 %
Test families: 12 / 15
Sources: 3
Mathematical bounds with missing values: 41.6-69.3 / 100

Reasoning

Index 71.1 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 64 %
Test families: 5 / 7
Sources: 3
Mathematical bounds with missing values: 45.7-81.4 / 100

Mathematics

Index 58.7 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 60 %
Test families: 3 / 5
Sources: 2
Mathematical bounds with missing values: 35.2-75.2 / 100

Knowledge

Index 66.4 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 100 %
Test families: 3 / 3
Sources: 3
Mathematical bounds with missing values: 66.4-66.4 / 100

Agents

Index 77.2 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 50 %
Test families: 6 / 12
Sources: 1
Mathematical bounds with missing values: 38.6-88.6 / 100

General

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 40 %
Test families: 2 / 5
Sources: 2
Mathematical bounds with missing values: 28.7-88.7 / 100

Finance

Index 75.9 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 86 %
Test families: 6 / 7
Sources: 1
Mathematical bounds with missing values: 65.1-79.4 / 100

Legal

Index 85.2 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 75 %
Test families: 3 / 4
Sources: 1
Mathematical bounds with missing values: 63.9-88.9 / 100

Health

Index 80.0 / 100

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 67 %
Test families: 2 / 3
Sources: 1
Mathematical bounds with missing values: 53.3-86.6 / 100

Cybersecurity

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 100 %
Test families: 1 / 1
Sources: 1
Mathematical bounds with missing values: 84.8-84.8 / 100

Multimodal

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 25 %
Test families: 1 / 4
Sources: 2
Mathematical bounds with missing values: 19.4-94.4 / 100

Productivity

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 50 %
Test families: 1 / 2
Sources: 1
Mathematical bounds with missing values: 40.8-90.8 / 100

Education

Not enough coverage for a score yet

provisional

Published configurations differ within this comparison cohort. Treat the index as provisional.

Panel-weight coverage: 50 %
Test families: 1 / 2
Sources: 1
Mathematical bounds with missing values: 47.4-97.4 / 100

Documented method · Included test families and measurements

Method version: benchmark-meta-score-v1

The index includes active measurements from reviewed primary sources when at least five models are compared in the same documented comparison slice across dataset, harness, agent, tools, and trial count. Each benchmark series and evaluator contributes one shared setup slice from the newest capture; when dates match, the wider slice is used. When one source and series include several explicitly documented reasoning tiers, the highest documented tier (none through max) is selected, never the best result value. The explicit source label “Non-reasoning” is treated as none. When selecting between multiple results, unknown or ambiguous tiers exclude the model from that series. Unambiguous single configurations do not require a tier ordering. The best individual result for each model is not selected. Equal raw values share the same rank percentile. Multiple series from the same evaluator within a family receive equal weight; evaluators within a family, families within an area, and areas in the overall index then receive equal weight. Unmeasured series remain visible in coverage and bounds. An overall score requires at least four areas, six test families, and two sources. An area score requires at least two test families. Every overall and area score also requires at least 50% of its panel weight.

Published model-specific parameters can differ. This is not a controlled experiment; comparisons with such differences are marked provisional.

Unmeasured portions are not entered as zero. They reduce coverage and contribute only to the displayed bounds. Scores with different coverage are therefore not equally complete.

The bounds hold observed percentiles fixed and allow missing contributions anywhere from 0 to 100. They are not confidence intervals or predictions of future recalculations.

The source count is not a count of independent experiments.

OECD handbook on composite indicators

All 46 test families and 12 of 51 raw measurements are listed here. The complete calculation for every model is available in the JSON export.

Test family: AIME
Mathematics · Family index: 38.6 / 100
Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
  Published configurations differ within this cohort.
  Measurement:
  epoch-otis-mock-aime-2024-2025
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.43 %
  Raw value:
  0.9722222222222222 ratio
  Metric:
  model_extracted_exact_match
  Version:
  1.1.6
  Participating models:
  23
  Rank percentile within the cohort:
  38.6 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  epoch-score-design-v1:["OTIS Mock AIME 2024-2025","OTIS Mock AIME 2024-2025","1.1.6","model_extracted_exact_match"]
  Reasoning tier:
  max
  Documented comparison setup
  Publication cohort:
  epoch-score-design-v1:["OTIS Mock AIME 2024-2025","OTIS Mock AIME 2024-2025","1.1.6","model_extracted_exact_match"]
  Dataset type:
  not-reported-in-captured-run-csv
  Setup and model parameters
  Published reasoning tier: max. The capture does not report other inference parameters or a compute budget.
  Independent evaluation. Epoch run alias: kimi-k3_max; Epoch model label: Kimi K3; Display label field: Kimi K3 (max); Reasoning setting encoded in the alias: max. Task ID: OTIS Mock AIME 2024-2025. Task version: 1.1.6. Run ID: A33om9MTYMC7xYeLv9X7Ha. Started at 2026-07-16T21:59:40.000Z. Original task label: OTIS Mock AIME 2024-2025. The published row reports mean_score=0.9722222222222222 and stderr=0.011158359139033182. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: max.
Test family: AA-AnalystAgent
Agents · Family index: 43.4 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-analyst-agent
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  38.75 %
  Metric:
  pass^5 reliability
  Version:
  AA cohort: 80 questions
  Participating models:
  39
  Rank percentile within the cohort:
  43.4 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-analyst-agent:AA cohort: 80 questions:standalone:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-analyst-agent","AA cohort: 80 questions","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Harness:
  Artificial Analysis Stirrup
  Agent:
  Stirrup analyst agent
  Tool policy:
  100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission
  Attempts:
  pass^5, 5 independent attempts per question
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 80 quantitative questions across 14 domains are run five independent times. pass^5 counts only questions answered correctly in all five attempts.. Harness: Artificial Analysis Stirrup. Agent: Stirrup analyst agent. Tool policy: 100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission. Attempts: pass^5, 5 independent attempts per question. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 80 quantitative questions across 14 domains are run five independent times. pass^5 counts only questions answered correctly in all five attempts.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup analyst agent. Tool policy: 100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission. Attempts: pass^5, 5 independent attempts per question. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 38.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-Briefcase
Agents · Family index: 85.4 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-briefcase
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  1,499.38 Elo
  Metric:
  AA-Briefcase Elo
  Version:
  v1.1
  Participating models:
  83
  Rank percentile within the cohort:
  85.4 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-briefcase:v1.1:v4.3.2:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-briefcase","v1.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-LCR
Reasoning · Family index: 100.0 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-aa-lcr
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.02 %
  Raw value:
  88.6666666666667 %
  Metric:
  Pass rate
  Version:
  v1.1
  Participating models:
  83
  Rank percentile within the cohort:
  100.0 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-aa-lcr:v1.1:v4.3.2:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-aa-lcr","v1.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 88.7%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: APEX-Agents-AA
Agents · Family index: 92.3 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-apex-agents-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  41.2979351032448 %
  Metric:
  Pass@1 success rate
  Version:
  AA public cohort: 452 tasks
  Participating models:
  27
  Rank percentile within the cohort:
  92.3 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-apex-agents-aa:AA public cohort: 452 tasks:standalone:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-apex-agents-aa","AA public cohort: 452 tasks","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Harness:
  Artificial Analysis Stirrup
  Agent:
  Stirrup agent
  Tool policy:
  200-turn cap; MCP-backed workplace tools in Archipelago
  Attempts:
  pass@1, averaged over 3 repeats per task
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 452 tasks from the public 480-task release, with three repeats per task. A run passes only if every rubric criterion is satisfied; the leaderboard averages pass@1 across repeats.. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: 200-turn cap; MCP-backed workplace tools in Archipelago. Attempts: pass@1, averaged over 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 452 tasks from the public 480-task release, with three repeats per task. A run passes only if every rubric criterion is satisfied; the leaderboard averages pass@1 across repeats.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: 200-turn cap; MCP-backed workplace tools in Archipelago. Attempts: pass@1, averaged over 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 41.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AutomationBench-AA
Agents · Family index: 81.7 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-automationbench-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  58.272977800152034 %
  Metric:
  Objectives completed without guardrail violations
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  81.7 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-automationbench-aa:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-automationbench-aa","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 58.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: FrontierCode 1.1 Main
Coding · Family index: 73.3 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-frontiercode
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.48 %
  Raw value:
  43.6099333333333 %
  Metric:
  Mean score over three attempts per task
  Version:
  1.1 Main
  Participating models:
  16
  Rank percentile within the cohort:
  73.3 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-frontiercode:1.1 Main:standalone:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-frontiercode","1.1 Main","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Harness:
  Artificial Analysis Stirrup
  Agent:
  Stirrup coding agent
  Tool policy:
  250-turn cap; repository worktree graded as left by the agent
  Attempts:
  Mean score, 3 attempts per task
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. The primary 100-task FrontierCode 1.1 set is run three times per task, with equal task weights. Failing any blocking check or being flagged by the trajectory scanner scores zero; runs passing every blocking check score 70 to 100 percent.. Harness: Artificial Analysis Stirrup. Agent: Stirrup coding agent. Tool policy: 250-turn cap; repository worktree graded as left by the agent. Attempts: Mean score, 3 attempts per task. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. The primary 100-task FrontierCode 1.1 set is run three times per task, with equal task weights. Failing any blocking check or being flagged by the trajectory scanner scores zero; runs passing every blocking check score 70 to 100 percent.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup coding agent. Tool policy: 250-turn cap; repository worktree graded as left by the agent. Attempts: Mean score, 3 attempts per task. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 43.6%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GDP.pdf
Reasoning · Family index: 82.9 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-gdp-pdf
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.02 %
  Raw value:
  22 %
  Metric:
  All-pass rate
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  82.9 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-gdp-pdf:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-gdp-pdf","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 22.0%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: GDPval-AA
Agents · Family index: 80.5 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-gdpval-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  1,532.59 Elo
  Metric:
  GDPval-AA Elo
  Version:
  v2.1
  Participating models:
  83
  Rank percentile within the cohort:
  80.5 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-gdpval-aa:v2.1:v4.3.2:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-gdpval-aa","v2.1","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: ITBench-AA (SRE)
Agents · Family index: 80.0 / 100
Nominal family weight in the overall panel: 0.6 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-itbench-aa
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  0.6 %
  Raw value:
  47.6930320150659 %
  Metric:
  Average precision at full recall
  Version:
  AA cohort: 59 tasks
  Participating models:
  36
  Rank percentile within the cohort:
  80.0 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-itbench-aa:AA cohort: 59 tasks:standalone:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-itbench-aa","AA cohort: 59 tasks","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Harness:
  Artificial Analysis Stirrup
  Agent:
  Stirrup agent
  Tool policy:
  Shell access to an offline Kubernetes incident snapshot
  Attempts:
  Average precision at full recall, 3 repeats per task
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 59 Kubernetes incident tasks, 40 public and 19 private, with three repeats per task. A run scores zero if it misses any true root cause; otherwise it receives its precision at full recall. This is the SRE slice of ITBench.. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: Shell access to an offline Kubernetes incident snapshot. Attempts: Average precision at full recall, 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 59 Kubernetes incident tasks, 40 public and 19 private, with three repeats per task. A run scores zero if it misses any true root cause; otherwise it receives its precision at full recall. This is the SRE slice of ITBench.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: Shell access to an offline Kubernetes incident snapshot. Attempts: Average precision at full recall, 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 47.7%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: AA-Omniscience
Knowledge · Family index: 76.8 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
- Artificial Analysis
  Published configurations differ within this cohort.
  Measurement:
  artificial-analysis-omniscience
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  2.38 %
  Raw value:
  19.7 points
  Metric:
  AA-Omniscience Index
  Version:
  unspecified
  Participating models:
  83
  Rank percentile within the cohort:
  76.8 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  artificial-analysis-omniscience:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Max
  Reasoning tier:
  Max
  Documented comparison setup
  Publication cohort:
  ["artificial-analysis-omniscience","unspecified","aa-model-page-2026-10-19-8a022369738c"]
  Dataset type:
  artificial-analysis-evaluation
  Setup and model parameters
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
  Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Test family: Chess Puzzles
Reasoning · Family index: 26.2 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
- Epoch AI benchmark run dataset snapshot
  Published configurations differ within this cohort.
  Measurement:
  epoch-chess-puzzles
  Series weight within the test family:
  100 %
  Nominal contribution to the overall panel:
  1.02 %
  Raw value:
  0.36 ratio
  Metric:
  exact
  Version:
  2.0.0
  Participating models:
  22
  Rank percentile within the cohort:
  26.2 %
  Retrieved:
  2026-10-19
  Comparison cohort:
  epoch-score-design-v1:["Chess Puzzles","Chess Puzzles","2.0.0","exact"]
  Reasoning tier:
  max
  Documented comparison setup
  Publication cohort:
  epoch-score-design-v1:["Chess Puzzles","Chess Puzzles","2.0.0","exact"]
  Dataset type:
  not-reported-in-captured-run-csv
  Setup and model parameters
  Published reasoning tier: max. The capture does not report other inference parameters or a compute budget.
  Independent evaluation. Epoch run alias: kimi-k3_max; Epoch model label: Kimi K3; Display label field: Kimi K3 (max); Reasoning setting encoded in the alias: max. Task ID: Chess Puzzles. Task version: 2.0.0. Run ID: nzQV9YvictnDF2EwxqTJQs. Started at 2026-10-13T17:13:35.000Z. Original task label: Chess Puzzles. The published row reports mean_score=0.36 and stderr=0.048241815132442176. The CSV has no sample-count column, so none is inferred. Standard error is not presented as a confidence interval. Meta-score selection: Per model, the highest documented reasoning tier is selected within the same Epoch source test design, original task, version, and scorer, independently of the measured value. This derived score copy does not claim matched compute budgets; the capture publishes neither a common budget nor all inference parameters. The raw model-profile observation remains unchanged. Selected reasoning tier: max.
Test family: SimpleQA Verified
Knowledge · Family index: 44.4 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: FrontierMath
Mathematics · Family index: 60.6 / 100
Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: GPQA Diamond
Reasoning · Family index: 68.6 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Humanity’s Last Exam
Reasoning · Family index: 84.1 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 50 %
Test family: LMArena Code Arena WebDev
Coding · Family index: 75.0 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: LMArena Text, Style Control
General · Family index: 80.6 / 100
Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: MMMU-Pro
Multimodal · Family index: 77.8 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: SWE-bench Verified
Coding · Family index: 89.8 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: Terminal-Bench
Coding · Family index: 67.6 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 83 %
Test family: Terminal-Bench Science
Coding · Family index: 14.5 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 50 %
Test family: BioMysteryBench
General · Family index: 63.2 / 100
Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: Code Migration
Coding · Family index: 32.3 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: CorpFin v2
Finance · Family index: 97.3 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: CyberBench v1.1
Cybersecurity · Family index: 84.8 / 100
Nominal family weight in the overall panel: 7.14 % · Coverage of this test family: 100 %
Test family: EMB
Finance · Family index: 71.2 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Finance Agent (v2)
Finance · Family index: 60.0 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: IOI
Coding · Family index: 36.4 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: LiveCodeBench v6
Coding · Family index: 81.8 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Harvey's Legal Agent Benchmark
Legal · Family index: 91.0 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: LegalBench
Legal · Family index: 84.6 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: Legal Research Bench
Legal · Family index: 80.0 / 100
Nominal family weight in the overall panel: 1.79 % · Coverage of this test family: 100 %
Test family: MedCode
Health · Family index: 74.6 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MedScribe
Health · Family index: 85.3 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MMLU-Pro
Knowledge · Family index: 77.9 / 100
Nominal family weight in the overall panel: 2.38 % · Coverage of this test family: 100 %
Test family: MortgageTax
Finance · Family index: 51.9 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: ProgramBench
Coding · Family index: 83.7 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: ProofBench
Mathematics · Family index: 76.9 / 100
Nominal family weight in the overall panel: 1.43 % · Coverage of this test family: 100 %
Test family: SAGE
Education · Family index: 94.8 / 100
Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: Public Benefits Bench v1.1
Productivity · Family index: 81.6 / 100
Nominal family weight in the overall panel: 3.57 % · Coverage of this test family: 100 %
Test family: SWE-bench Multimodal
Coding · Family index: 0.0 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Tax Agent Bench
Finance · Family index: 81.8 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: TaxEval v2
Finance · Family index: 93.4 / 100
Nominal family weight in the overall panel: 1.02 % · Coverage of this test family: 100 %
Test family: Vibe Code Bench 1-100
Coding · Family index: 47.6 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %
Test family: Vibe Code Bench v1.1
Coding · Family index: 84.7 / 100
Nominal family weight in the overall panel: 0.48 % · Coverage of this test family: 100 %

Benchmark sources at a glance

Each evaluator measures different capabilities under its own conditions. Test series, composite indices and their components stay separate. The detailed results below retain their scales, configurations and source dates.

Evaluator	Test series	Composite indices	Recorded active measurements
Artificial Analysis	13	1	28
Vals AI	31	2	228
LMArena	2	0	34
Epoch AI	6	0	12

Coverage is not a quality ranking. Overlapping tests and multiple settings do not count as independent experiments. Vendor claims, historical and disputed results are excluded from this overview and remain labelled in the detailed evidence.

Published benchmarks

AlmanBench v0.1

Accepted cases

1,029 German tasks test conversion from standard German into a defined simplified-language specification. It measures the Alman specification, not general German writing quality.

1.GPT-5.595.43%

2.GPT-5.6 Sol95.14%

3.Claude Opus 594.95%

4.DeepSeek-V4-Flash93%

5.Kimi K390.96%

higher is betterAs of August 9, 2026Scale: 0% - 100%

Source: Alman Institut

|

gradually.ai

Methodology and context

Comparison cohort: almanbench-v0-1:official:overall
Metric: accepted cases
Scale: 0-100
Participants: 5
Methodology and context: 1,029 public tasks with one direct run per row. The target is the Alman language specification.. Source model ID: curated/kimi-k3. Source model name: Kimi K3. Provider reported by source: Moonshot AI. Evaluator: Alman Institut. Dataset type: public. Leaderboard date: 2026-08-05. Reasoning effort: max. Standard error: 0.893833. Source ID: alman-institut. Evidence capture ID: curated-alman-institut-2026-08-09-b5b769c9e870. Source payload hash: b5b769c9e870d769fb78c01a834af36d6c2cf156bb7a17f0a1f272eb70517156. Parser version: curated-v1. Imported at: 2026-10-15

Source: Alman Institut

SWE-Marathon v1.1

Overall

Long-horizon software engineering tasks with executable project tests. The model, reasoning effort and agent jointly define a result. The vendor table reports different values.

Note (Kimi K3): The score evaluates the named model, reasoning effort, and agent configuration together, not an isolated model-only run.

1.Claude Sonnet 5.551.3%

Note: The score evaluates the named model, reasoning effort, and agent configuration together, not an isolated model-only run.

2.Kimi K348.1%

3.Claude Opus 5.546.3%

Note: The score evaluates the named model, reasoning effort, and agent configuration together, not an isolated model-only run.

4.Claude Fable 5.145.6%

Note: The score evaluates the named model, reasoning effort, and agent configuration together, not an isolated model-only run.

higher is betterAs of October 15, 2026Scale: 0% - 100%

Source: SWE-Marathon

|

gradually.ai

Methodology and context

Comparison cohort: swe-marathon-v1-1-2026-10-15-claude-code-max
Metric: pass@1
Scale: 0-100
Participants: 4
Methodology and context: SWE-Marathon v1.1 overall resolution rate, pass@1. Claude Code agent, max reasoning. 20 realistic, multi-hour software-engineering tasks with k=8 trials per task. Binary reward is 1.0 only when every verifier test passes, otherwise 0.0.. Source model ID: curated/kimi-k3. Source model name: Kimi K3. Provider reported by source: Moonshot AI. Evaluator: SWE-Marathon. Dataset type: public. Agent: Claude Code. Attempts: 20 tasks; k=8 trials per task. Reasoning effort: max. Source ID: swe-marathon. Evidence capture ID: curated-swe-marathon-2026-10-15-0a96f6d270c5. Source payload hash: 0a96f6d270c551f3b8b614cca8ade6c8e05edd254cb33f3da499cc6cc5148db0. Parser version: curated-v1. Imported at: 2026-10-15

Source: SWE-Marathon

Other tasks

Vals Index

SWE-bench

1.GPT-5.6 Sol99.02%

2.Claude Fable 597.06%

3.Claude Opus 595.1%

3.Kimi K395.1%

5.GPT-5.6 Luna93.14%

6.Grok 4.586.28%

7.GLM-5.283.33%

8.GPT-5.582.6%

9.Gemini 3.6 Flash77.45%

10.Claude Sonnet 575.49%

10.DeepSeek-V4-Pro75.49%

10.Gemini 3.5 Flash75.49%

13.Kimi K2.674.51%

14.GPT-5.6 Terra73.53%

15.Gemini 3.1 Pro Preview72.55%

15.GLM-5.172.55%

17.Grok 4.370.59%

18.Gemini 3 Flash Preview68.63%

18.Gemini 3.5 Flash-Lite68.63%

20.GPT-5.4 mini67.65%

20.GPT-5.4 nano67.65%

22.MiMo-V2.5-Pro66.67%

23.MiMo-V2.564.71%

24.Gemini 3.1 Flash-Lite57.84%

higher is betterAs of August 11, 2026Scale: 0% - 100%

Source: Vals AI

|

gradually.ai

Methodology and context

Comparison cohort: vals-vals-index:1.2:swebench
Metric: benchmark score
Scale: 0-100
Participants: 24
Methodology and context: Source model ID: kimi/kimi-k3. Source model name: Kimi K3. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-09. Latency in seconds: 611.386. Standard error: 2.138. Cost per task in USD: 0.879924. Source ID: vals-ai. Evidence capture ID: vals-vals_index-2026-08-11-e79d08d59249. Source payload hash: e79d08d5924964d8c5c590ec13203e07e902ed1f2b6d2b1c7fc7f911c6e3b82c. Parser version: vals-astro-v2. Imported at: 2026-08-11

Source: Vals AI

Vals Multimodal Index

SWE-bench

1.GPT-5.6 Sol99.02%

2.Claude Fable 597.06%

3.Claude Opus 595.1%

3.Kimi K395.1%

5.GPT-5.6 Luna93.14%

6.Claude Opus 4.889.22%

7.Qwen 3.8 Max 090287.26%

8.Grok 4.586.28%

9.GPT-5.582.6%

10.Claude Opus 4.782.35%

11.Claude Sonnet 4.677.45%

11.Gemini 3.6 Flash77.45%

13.Claude Sonnet 575.49%

13.Gemini 3.5 Flash75.49%

13.Inkling75.49%

13.Inkling Small75.49%

17.Kimi K2.674.51%

18.GPT-5.6 Terra73.53%

19.Gemini 3.1 Pro Preview72.55%

20.Grok 4.370.59%

21.MiniMax M369.61%

22.Gemini 3 Flash Preview68.63%

23.GPT-5.4 mini67.65%

23.GPT-5.4 nano67.65%

25.Grok 4.20 Reasoning66.67%

25.Qwen 3.7 Plus66.67%

27.MiMo-V2.564.71%

27.Mistral Medium 3.564.71%

29.Gemini 3.1 Flash-Lite57.84%

higher is betterAs of October 15, 2026Scale: 0% - 100%

Source: Vals AI

|

gradually.ai

Methodology and context

Comparison cohort: vals-vals-multimodal-index:1.2:swebench
Metric: benchmark score
Scale: 0-100
Participants: 29
Methodology and context: Source model ID: kimi/kimi-k3. Source model name: Kimi K3. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-11. Latency in seconds: 611.386. Standard error: 2.138. Cost per task in USD: 0.879924. Source ID: vals-ai. Evidence capture ID: vals-vals_multimodal_index-2026-10-15-077b22575f6e. Source payload hash: 077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d. Parser version: vals-astro-v3. Imported at: 2026-10-15

Source: Vals AI

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

AA-AnalystAgent: Overall (Show measurement, test conditions, and source)

Source value: 38.75
Score: 38.75
Metric: pass^5 reliability
Unit: %
Benchmark version: AA cohort: 80 questions
Category: agentic
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-aa-analyst-agent:AA cohort: 80 questions:standalone:reasoning:tokens=2000:suffix=Max
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 80 quantitative questions across 14 domains are run five independent times. pass^5 counts only questions answered correctly in all five attempts.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup analyst agent. Tool policy: 100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission. Attempts: pass^5, 5 independent attempts per question. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 38.8%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 80 quantitative questions across 14 domains are run five independent times. pass^5 counts only questions answered correctly in all five attempts.. Harness: Artificial Analysis Stirrup. Agent: Stirrup analyst agent. Tool policy: 100-turn cap; Python sandbox with source files, URL fetch, image viewing, and answer submission. Attempts: pass^5, 5 independent attempts per question. Reasoning: reasoning enabled. Reasoning effort: Max
Context: Questions, source files, and reference answers are private. pass^5 measures reliability across all five attempts, not pass@1.

Source Artificial Analysis

AA-LCR: Overall (Show measurement, test conditions, and source)

Source value: 79.3333333333333
Score: 79.3333333333333
Metric: Pass rate
Unit: %
Benchmark version: v1.1
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-aa-lcr:v1.1:v4.3.2:reasoning:tokens=2000:suffix=Low
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Low) (release kimi-k3, row kimi-k3-low, UUID 512d17ef-13d2-4f65-bf9b-154b0dec7e8d, reasoning=true, source reasoning-token configuration budget=2000, suffix=Low). This configured value is not measured token consumption.. Source model ID: artificial-analysis/512d17ef-13d2-4f65-bf9b-154b0dec7e8d/kimi-k3/kimi-k3-low. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Low). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Low. Score display: 79.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Low) (release kimi-k3, row kimi-k3-low, UUID 512d17ef-13d2-4f65-bf9b-154b0dec7e8d, reasoning=true, source reasoning-token configuration budget=2000, suffix=Low). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Low

Source Artificial Analysis

AA-LCR: Overall (Show measurement, test conditions, and source)

Source value: 88.6666666666667
Score: 88.6666666666667
Metric: Pass rate
Unit: %
Benchmark version: v1.1
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-aa-lcr:v1.1:v4.3.2:reasoning:tokens=2000:suffix=Max
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 88.7%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max

Source Artificial Analysis

APEX-Agents-AA: Overall (Show measurement, test conditions, and source)

Source value: 41.2979351032448
Score: 41.2979351032448
Metric: Pass@1 success rate
Unit: %
Benchmark version: AA public cohort: 452 tasks
Category: agentic
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-apex-agents-aa:AA public cohort: 452 tasks:standalone:reasoning:tokens=2000:suffix=Max
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 452 tasks from the public 480-task release, with three repeats per task. A run passes only if every rubric criterion is satisfied; the leaderboard averages pass@1 across repeats.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: 200-turn cap; MCP-backed workplace tools in Archipelago. Attempts: pass@1, averaged over 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 41.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption. 452 tasks from the public 480-task release, with three repeats per task. A run passes only if every rubric criterion is satisfied; the leaderboard averages pass@1 across repeats.. Harness: Artificial Analysis Stirrup. Agent: Stirrup agent. Tool policy: 200-turn cap; MCP-backed workplace tools in Archipelago. Attempts: pass@1, averaged over 3 repeats per task. Reasoning: reasoning enabled. Reasoning effort: Max
Context: Two Investment Banking worlds are excluded because they depend on external runtime APIs.

Source Artificial Analysis

AutomationBench-AA: Overall (Show measurement, test conditions, and source)

Source value: 49.2568024921068
Score: 49.2568024921068
Metric: Objectives completed without guardrail violations
Unit: %
Benchmark version: unspecified
Category: agentic
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-automationbench-aa:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Low
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Low) (release kimi-k3, row kimi-k3-low, UUID 512d17ef-13d2-4f65-bf9b-154b0dec7e8d, reasoning=true, source reasoning-token configuration budget=2000, suffix=Low). This configured value is not measured token consumption.. Source model ID: artificial-analysis/512d17ef-13d2-4f65-bf9b-154b0dec7e8d/kimi-k3/kimi-k3-low. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Low). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Low. Score display: 49.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Low) (release kimi-k3, row kimi-k3-low, UUID 512d17ef-13d2-4f65-bf9b-154b0dec7e8d, reasoning=true, source reasoning-token configuration budget=2000, suffix=Low). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Low

Source Artificial Analysis

AutomationBench-AA: Overall (Show measurement, test conditions, and source)

Source value: 58.272977800152034
Score: 58.272977800152034
Metric: Objectives completed without guardrail violations
Unit: %
Benchmark version: unspecified
Category: agentic
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-automationbench-aa:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Max
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: active
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 58.3%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max

Source Artificial Analysis

CritPt: Overall (Show measurement, test conditions, and source)

Source value: 3.14285714285714
Score: 3.14285714285714
Metric: Score
Unit: %
Benchmark version: unspecified
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-critpt:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Low
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: disputed
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Low) (release kimi-k3, row kimi-k3-low, UUID 512d17ef-13d2-4f65-bf9b-154b0dec7e8d, reasoning=true, source reasoning-token configuration budget=2000, suffix=Low). This configured value is not measured token consumption.. Source model ID: artificial-analysis/512d17ef-13d2-4f65-bf9b-154b0dec7e8d/kimi-k3/kimi-k3-low. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Low). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Low. Score display: 3.1%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Low) (release kimi-k3, row kimi-k3-low, UUID 512d17ef-13d2-4f65-bf9b-154b0dec7e8d, reasoning=true, source reasoning-token configuration budget=2000, suffix=Low). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Low
Context: Artificial Analysis marks CritPt as under review; dataset revisions may change results.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.

Source Artificial Analysis

CritPt: Overall (Show measurement, test conditions, and source)

Source value: 23.4285714285714
Score: 23.4285714285714
Metric: Score
Unit: %
Benchmark version: unspecified
Category: reasoning
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: artificial-analysis-critpt:unspecified:v4.3.2:reasoning:tokens=2000:suffix=Max
Source type: independent-evaluator
Evaluator: Artificial Analysis
Status: disputed
Retrieved at: 2026-10-19
Methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Source model ID: artificial-analysis/f7d2fc3e-1f7b-405f-818c-07952a4af78f/kimi-k3/kimi-k3. Source model name: Kimi K3. Provider reported by source: Kimi. Model snapshot: Kimi K3 (Max). Evaluator: Artificial Analysis. Dataset type: artificial-analysis-evaluation. Reasoning: reasoning enabled. Reasoning effort: Max. Score display: 23.4%. Source ID: artificial-analysis. Evidence capture ID: aa-model-page-2026-10-19-8a022369738c. Source payload hash: 8a022369738cbe2a0e2f9bf486a2882865dbb0c6f1396dfec84059a802560e3c. Parser version: artificial-analysis-rsc-models-v2. Imported at: 2026-10-19
Comparison methodology: Exact AA configuration: Kimi K3 (Max) (release kimi-k3, row kimi-k3, UUID f7d2fc3e-1f7b-405f-818c-07952a4af78f, reasoning=true, source reasoning-token configuration budget=2000, suffix=Max). This configured value is not measured token consumption.. Reasoning: reasoning enabled. Reasoning effort: Max
Context: Artificial Analysis marks CritPt as under review; dataset revisions may change results.. The source dataset marks this result as disputed. It remains visible as documented evidence, but is not reliable comparative proof.

Source Artificial Analysis

Recorded measurement details

AlmanBench v0.1: Accepted cases (Show measurement, test conditions, and source)

Source value: 90.9620991254
Score: 90.9620991254
Metric: accepted cases
Unit: %
Benchmark version: v0.1, results commit f34ddbf
Category: general
Task: overall
Task label: Accepted cases
Direction: Higher is better
Comparison cohort: almanbench-v0-1:official:overall
Source type: independent-evaluator
Evaluator: Alman Institut
Status: active
Retrieved at: 2026-08-09
Methodology: 1,029 public tasks with one direct run per row. The target is the Alman language specification.. Source model ID: curated/kimi-k3. Source model name: Kimi K3. Provider reported by source: Moonshot AI. Evaluator: Alman Institut. Dataset type: public. Leaderboard date: 2026-08-05. Reasoning effort: max. Standard error: 0.893833. Source ID: alman-institut. Evidence capture ID: curated-alman-institut-2026-08-09-b5b769c9e870. Source payload hash: b5b769c9e870d769fb78c01a834af36d6c2cf156bb7a17f0a1f272eb70517156. Parser version: curated-v1. Imported at: 2026-10-15
Comparison methodology: 1,029 public tasks with one direct run per row. The target is the Alman language specification.

Source Alman Institut

SWE-Marathon v1.1: Overall (Show measurement, test conditions, and source)

Source value: 48.1
Score: 48.1
Metric: pass@1
Unit: %
Benchmark version: v1.1
Category: coding
Task: overall
Task label: Overall
Direction: Higher is better
Comparison cohort: swe-marathon-v1-1-2026-10-15-claude-code-max
Source type: official-leaderboard
Evaluator: SWE-Marathon
Status: active
Retrieved at: 2026-10-15
Methodology: SWE-Marathon v1.1 overall resolution rate, pass@1. Claude Code agent, max reasoning. 20 realistic, multi-hour software-engineering tasks with k=8 trials per task. Binary reward is 1.0 only when every verifier test passes, otherwise 0.0.. Source model ID: curated/kimi-k3. Source model name: Kimi K3. Provider reported by source: Moonshot AI. Evaluator: SWE-Marathon. Dataset type: public. Agent: Claude Code. Attempts: 20 tasks; k=8 trials per task. Reasoning effort: max. Source ID: swe-marathon. Evidence capture ID: curated-swe-marathon-2026-10-15-0a96f6d270c5. Source payload hash: 0a96f6d270c551f3b8b614cca8ade6c8e05edd254cb33f3da499cc6cc5148db0. Parser version: curated-v1. Imported at: 2026-10-15
Comparison methodology: SWE-Marathon v1.1 overall resolution rate, pass@1. Claude Code agent, max reasoning. 20 realistic, multi-hour software-engineering tasks with k=8 trials per task. Binary reward is 1.0 only when every verifier test passes, otherwise 0.0.
Context: The score evaluates the named model, reasoning effort, and agent configuration together, not an isolated model-only run.

Source SWE-Marathon

Vals Index: SWE-bench (Show measurement, test conditions, and source)

Source value: 95.098
Score: 95.098
Metric: benchmark score
Unit: %
Benchmark version: 1.2
Category: aggregate
Task: swebench
Task label: SWE-bench
Direction: Higher is better
Comparison cohort: vals-vals-index:1.2:swebench
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-08-11
Methodology: Source model ID: kimi/kimi-k3. Source model name: Kimi K3. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-09. Latency in seconds: 611.386. Standard error: 2.138. Cost per task in USD: 0.879924. Source ID: vals-ai. Evidence capture ID: vals-vals_index-2026-08-11-e79d08d59249. Source payload hash: e79d08d5924964d8c5c590ec13203e07e902ed1f2b6d2b1c7fc7f911c6e3b82c. Parser version: vals-astro-v2. Imported at: 2026-08-11

Vals Multimodal Index: SWE-bench (Show measurement, test conditions, and source)

Source value: 95.098
Score: 95.098
Metric: benchmark score
Unit: %
Benchmark version: 1.2
Category: aggregate
Task: swebench
Task label: SWE-bench
Direction: Higher is better
Comparison cohort: vals-vals-multimodal-index:1.2:swebench
Source type: independent-evaluator
Evaluator: Vals AI
Status: active
Retrieved at: 2026-10-15
Methodology: Source model ID: kimi/kimi-k3. Source model name: Kimi K3. Evaluator: Vals AI. Dataset type: private. Leaderboard date: 2026-08-11. Latency in seconds: 611.386. Standard error: 2.138. Cost per task in USD: 0.879924. Source ID: vals-ai. Evidence capture ID: vals-vals_multimodal_index-2026-10-15-077b22575f6e. Source payload hash: 077b22575f6e075b7b78157d000ec8f94d7ead409c7dcbcf04887630ed572a2d. Parser version: vals-astro-v3. Imported at: 2026-10-15

Page 1 of 31

Predecessor and successor

Sources and data date

Type	Evidence and data date
Speed	Kimi, Max effort. Output speed after the first streaming chunk, not total response time. Retrieved September 7, 2026. Source: Artificial Analysis · Speed (Artificial Analysis)Speed measurement methodology
Price	Base API prices without caching or batch discounts. Higher context tiers and other rates are listed under Costs. Source: Pricing · API pricing
Input	Documented modalities. Retrieved September 7, 2026. Source: Model documentation · Model metadata · Kimi K3 repository · Editorial description reviewed October 2, 2026
Output	Documented modalities. Retrieved September 7, 2026. Source: Model documentation · Model metadata · Kimi K3 repository · Editorial description reviewed October 2, 2026
Research status	Research date September 8, 2026. 6 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Unresolved	release-date Original wording No normalized release-date field in card.
Not published	reasoning effort and pass@k Note The cited result does not report reasoning effort or pass@k; exact task date and serving/checkpoint details are recorded in the benchmark configuration.
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Artificial Analysis (retrieved October 19, 2026)
Additional source	Alman Institut (retrieved August 9, 2026)
Additional source	SWE-Marathon (retrieved October 15, 2026)
Additional source	LMArena (retrieved October 15, 2026)
Additional source	LMArena (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved August 11, 2026; October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Vals AI (retrieved October 15, 2026)
Additional source	Kimi K3 model card (retrieved September 8, 2026) · Kimi K3 model card · Editorial description reviewed October 2, 2026
Additional source	LlamaIndex / Run-Llama ExtractBench (retrieved October 15, 2026)
Additional source	Epoch AI benchmark run dataset snapshot (retrieved October 19, 2026)
Additional source	Model metadata (retrieved September 8, 2026)
Additional source	Kimi API model list · Editorial description reviewed October 2, 2026
Additional source	OpenRouter: Popularity index (derived), CC BY 4.0
Additional source	Vercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional source	Ollama: cumulative downloads for the popularity index
Additional source	Replicate: cumulative runs for the popularity index
Additional source	Google Trending Now: limited feed selection for Germany and the US
Additional source	Creative Commons Attribution 4.0
Additional source	Moonshot AI, Kimi-K3 model card (Hugging Face) (2026-09-19)