Skip to main content

CloudflareDecision modelActive

Clef

PopularityTop group about equally popular, 12 models

66out of 100new calculation

based on two data groups, mostly search, range 48 to 83

Summary

Clef is Cloudflare’s 27-billion-parameter model for typed decisions. You provide state, questions, and possible answers. Choice, Noul, and Score come back as structured probabilities without free-form answer text. The same decision run can take text, JSON, images, and video as input.

The checkpoint is based on Qwen3.8-27B with a vision encoder. Cloudflare specifies a 64k-token context. You can call it through Workers AI as @cf/cloudflare/clef for $0.24 per 1M input tokens or run the Apache-2.0 weights locally. The free neuron allowance is shared across the entire Workers AI account. Clef is a decision component, not a general chat model.

GraduallyBench Decision

Clef decides 55 of 60 test cases correctly. The median of the 33 tested decision models is 60.0 %.

Accuracy

91.7 %

55 of 60 test cases

Robustness

96.7 %

29 of 30 reworded variants

Unnecessary reviews

3.8 %

2 of 52 cases without a required review

Response time

345 ms

median, 95 % under 700 ms, hosted

Accuracy compared

Share of correct decisions in percent, higher is better

20 of 33 models

As of 11/10/2026. Source: GraduallyBench Decision

Accuracy by task familyThe tick marks the median of all 33 tested models.
Triage91.7 %11 / 12, median 58.3 %
Routing91.7 %11 / 12, median 83.3 %
Constraints100.0 %12 / 12, median 33.3 %
Tables83.3 %10 / 12, median 50.0 %
Evidence91.7 %11 / 12, median 75.0 %

Clef

Benchmark run
Show test details

Decisions

Cloudflare · German, English

Execution Hosted. Precision not documented.

130 valid outputs from 130 attempted and 130 planned test slots.

Measured duration p50 / p95 345 / 700 ms (130 cases). Hosted request including network time. Quantile calculation not documented.

Automatic decision accuracy
91.67 %(55 / 60 planned cases)German, English
Automatic decision accuracy, Triage
91.67 %(11 / 12 planned cases)German, English
Automatic decision accuracy, Routing
91.67 %(11 / 12 planned cases)German, English
Automatic decision accuracy, Selection with constraints
100 %(12 / 12 planned cases)German, English
Automatic decision accuracy, Numbers and tables
83.33 %(10 / 12 planned cases)German, English
Automatic decision accuracy, Sufficient evidence
91.67 %(11 / 12 planned cases)German, English
Correct robustness variants
96.67 %(29 / 30 planned cases)German, English
Correct development cases
95 %(38 / 40 planned cases)German, English
Unnecessary reviews
3.85 %(2 / 52 assessable cases without a required review)German, English
Missed required reviews
12.5 %(1 / 8 assessable cases requiring review)German, English

Response times are comparable only within the same environment and form no shared speed ranking. Where used, the test references were not independently reviewed by humans. Test coverage and methods differ by model. Each metric stands on its own; there is no combined overall score across tests. Data compiled on 11/10/2026. How we test · Download all Decision and Audio results as JSON

All benchmark results

Every published result with its source, test setup and comparison models.

Show all 154 published benchmark results

Page 1 of 13

Measurements without matching peer values

These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.

Decision Index 0.2.1: BFCL (case exact accuracy) (Show measurement, test conditions, and source)
Source value
98.5
Metric
BFCL (case exact accuracy)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: ToolRet (nDCG@10) (Show measurement, test conditions, and source)
Source value
69.2
Metric
ToolRet (nDCG@10)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: API-Bank (accuracy) (Show measurement, test conditions, and source)
Source value
91.9
Metric
API-Bank (accuracy)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: BANKING77 (macro-F1) (Show measurement, test conditions, and source)
Source value
94.2
Metric
BANKING77 (macro-F1)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: CLINC150+OOS (macro-F1) (Show measurement, test conditions, and source)
Source value
97.4
Metric
CLINC150+OOS (macro-F1)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: RouterBench (selected quality) (Show measurement, test conditions, and source)
Source value
79.7
Metric
RouterBench (selected quality)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: Home appliance simulator (case exact accuracy) (Show measurement, test conditions, and source)
Source value
83
Metric
Home appliance simulator (case exact accuracy)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: SGD/SGD-X (macro-F1) (Show measurement, test conditions, and source)
Source value
43.8
Metric
SGD/SGD-X (macro-F1)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: ContractNLI (macro-F1) (Show measurement, test conditions, and source)
Source value
81.4
Metric
ContractNLI (macro-F1)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: ANLI (macro-F1) (Show measurement, test conditions, and source)
Source value
69.8
Metric
ANLI (macro-F1)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: BPoMP (accuracy) (Show measurement, test conditions, and source)
Source value
96.9
Metric
BPoMP (accuracy)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card
Decision Index 0.2.1: Humicroedit (accuracy) (Show measurement, test conditions, and source)
Source value
66.7
Metric
Humicroedit (accuracy)
Unit
%
Benchmark version
0.2.1
Category
Decision Index 0.2.1
Direction
Higher is better
Source type
vendor-reported
Evaluator
Cloudflare Clef model card
Status
active
Retrieved at
2026-10-04
Methodology
Vendor-reported result. Run=Cloudflare internal evaluation; Benchmark version=0.2.1; Request latency=no
Source Cloudflare Clef model card

Page 1 of 13

Popularity compared

How often the model is searched for, used and mentioned, compared with every model of its category.

Popularity index

0 to 100, higher is more popular

20 of 42 models

As of November 2026 · Source: gradually.ai popularity index

Over time

Weekly values from October 18, 2026 to November 20, 2026

ClefStrands Decider 2B 54GLiNER2.5-Decide 46Clef-Flash 45Kev 4B 45

Method changes in the timeline, a jump at these points is no market event:

  1. 1November 1, 2026: Value only with search or usage data, 30-day attention
  2. 2November 1, 2026: Method version 4 (common scale, shrinkage)
  3. 3November 9, 2026: New topics measurement V20 (daily quorum, short forms)

What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.

All specifications

Architecture

Model class
Multimodal System One decision model, not a chat model
Source: Model class
Checkpoint
Cloudflare/clef
Source: Checkpoint
Base model
Qwen/Qwen3.8-27B with vision encoder
Source: Base model

Input and output

Input
Text, JSON, images, and video
Source: Input
Context window
64k tokens (provider specification)
Source: Context window

Watermarking and provenance

AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.

AI watermarking
Unknown
no source
Watermarking technique
Not known
no source

Licence and access

Access
Workers AI API and local weights
Source: Access
License
Apache-2.0
Source: License
Shutdown
None announced
no source

API

API model ID
Workers AI: @cf/cloudflare/clef
Source: API model ID

Further details

Output schema
Choice, Noul and Score with probabilities, without free-form answer text
Source: Output schema

Prices

API input price
$0.240 per 1M input tokens (21,818 neurons per 1M)Source
Workers AI billing
10,000 neurons per day free account-wide; Workers Paid is required beyond that quota. $0.011 per 1,000 neurons.Source

Sources and data date

Show all 14 sources

Benchmark sources at a glance

Which independent evaluators tested this model. This is coverage, not a quality ranking.

No active result from the reviewed external evaluators can currently be attributed to this model. Other source evidence remains available below.

Without vendor claims and historical or disputed results; those stay labelled in the single values.

TypeEvidence and data date
Research statusResearch date October 4, 2026. 6 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication.
Unresolved

forecastbench-scale

Note

ForecastBench prints Brier values 13.9 and 10.6 without a stated scale; the raw values remain unchanged and are not divided by 100.

Not published

clef-immutable-checkpoint-and-decoding

Note

The pinned index names the engine and base model but leaves weights_repo and served_checkpoint null and publishes no decoding settings.

Not published

clef-task-confidence-intervals

Note

No task confidence intervals are published in the pinned index rows.

Unresolved

score-run configuration

Original wording

The source identifies the exact model row and some adjacent model/route settings, but does not bind all per-cell prompt, decoding, or serving details to the score table.

Unresolved

parenthetical ranges

Original wording

Ranges are printed beside each score but the article does not define them as confidence intervals or identify another statistical meaning.

Unresolved

Task done check sample count

Original wording

The source reports 155 of 204 items for this task, but the denominator meaning is not made clear; no sampleCount is asserted.

Additional sourceCloudflare announcement (retrieved October 3, 2026) · Cloudflare Clef announcement · Editorial description reviewed October 3, 2026
Additional sourceClef model card (retrieved October 3, 2026; October 4, 2026) · Clef model card · Editorial description reviewed October 3, 2026
Additional sourceWorkers AI pricing (retrieved October 3, 2026) · Workers AI pricing · Editorial description reviewed October 3, 2026
Additional sourceJev Decision Index 0.3.2 (retrieved October 17, 2026)
Additional sourceTran Cao Minh et al., breast-ultrasound evaluation of CLEF and CLEF-Flash (retrieved October 17, 2026; October 23, 2026)
Additional sourceAIMultiple decision-models evaluation (retrieved October 18, 2026)
Additional sourceStreamDecisionBench GitHub README (retrieved October 18, 2026)
Additional sourceModel metadata (retrieved October 17, 2026)
Additional sourceOpenRouter: Popularity index (derived), CC BY 4.0
Additional sourceVercel AI Gateway: Popularity index (derived), CC BY 4.0
Additional sourceOllama: cumulative downloads for the popularity index
Additional sourceReplicate: cumulative runs for the popularity index
Additional sourceGoogle Trending Now: limited feed selection for Germany and the US
Additional sourceCreative Commons Attribution 4.0