TIILanguage model
Falcon 3 7B
Falcon 3 7B has no overall index value yet because there are too few independent benchmark results.
26out of 100same as last month
based on search, usage and attention
Summary
Falcon 3 7B is TII’s compact open base checkpoint in the Falcon 3 family. According to the release post, it was pretrained in a large run on 14 trillion tokens from web, code, STEM, and multilingual data. The release presents it as a base model, while conversation and agent work require a separate instruction-tuned derivative.
Falcon 3 7B has a 32,768-token context. TII says Falcon 3 10B continues the same training line through depth upscaling, but it remains a separate 10B checkpoint. Both variants are base models without instruction post-training.
On this page
All benchmark results
Every published result with its source, test setup and comparison models.
Show all 26 published benchmark results
Page 1 of 3
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
Visual generalization (average per-class accuracy): AWA2 (Show measurement, test conditions, and source)
- Source value
- 56.9
- Score
- 56.9
- Metric
- Average per-class classification accuracy on unaligned classes
- Unit
- %
- Benchmark version
- TMLR 01/2026, Appendix Table 12
- Category
- visual classification generalization
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Better Language Models Exhibit Higher Visual Alignment (TMLR, 01/2026; author-hosted full paper)
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Independent evaluation. Falcon3-7B-Base is used as a frozen decoder-based text encoder in the paper's CLIP-like visual-generalization framework: last-token-pooled text features with DINOv2 ViT-L/14 image features and a learned linear projection. Evaluation reports average per-class classification accuracy on unaligned/unseen classes. The paper says its results average five initialization seeds; Table 12 reports the raw cells AWA2: 56.9 ± 8.2; CUB: 44.0 ± 1.9; Aircraft: 35.1 ± 4.2; ImageNet+: 35.1 ± 0.5; Average: 42.8, but does not define the statistic after ±. The scalar score stores only the reported central value; ± is preserved in evidence and is not interpreted as a CI or standard deviation. No exact weight hash or checkpoint revision is given.
- Context
- This is a result for the combined visual encoder/projection evaluation, not standalone LLM generation or intrinsic language-model accuracy. The paper does not define the reported ± statistic; it is not converted into a CI.
Visual generalization (average per-class accuracy): CUB (Show measurement, test conditions, and source)
- Source value
- 44
- Score
- 44
- Metric
- Average per-class classification accuracy on unaligned classes
- Unit
- %
- Benchmark version
- TMLR 01/2026, Appendix Table 12
- Category
- visual classification generalization
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Better Language Models Exhibit Higher Visual Alignment (TMLR, 01/2026; author-hosted full paper)
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Independent evaluation. Falcon3-7B-Base is used as a frozen decoder-based text encoder in the paper's CLIP-like visual-generalization framework: last-token-pooled text features with DINOv2 ViT-L/14 image features and a learned linear projection. Evaluation reports average per-class classification accuracy on unaligned/unseen classes. The paper says its results average five initialization seeds; Table 12 reports the raw cells AWA2: 56.9 ± 8.2; CUB: 44.0 ± 1.9; Aircraft: 35.1 ± 4.2; ImageNet+: 35.1 ± 0.5; Average: 42.8, but does not define the statistic after ±. The scalar score stores only the reported central value; ± is preserved in evidence and is not interpreted as a CI or standard deviation. No exact weight hash or checkpoint revision is given.
- Context
- This is a result for the combined visual encoder/projection evaluation, not standalone LLM generation or intrinsic language-model accuracy. The paper does not define the reported ± statistic; it is not converted into a CI.
Visual generalization (average per-class accuracy): Aircraft (Show measurement, test conditions, and source)
- Source value
- 35.1
- Score
- 35.1
- Metric
- Average per-class classification accuracy on unaligned classes
- Unit
- %
- Benchmark version
- TMLR 01/2026, Appendix Table 12
- Category
- visual classification generalization
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Better Language Models Exhibit Higher Visual Alignment (TMLR, 01/2026; author-hosted full paper)
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Independent evaluation. Falcon3-7B-Base is used as a frozen decoder-based text encoder in the paper's CLIP-like visual-generalization framework: last-token-pooled text features with DINOv2 ViT-L/14 image features and a learned linear projection. Evaluation reports average per-class classification accuracy on unaligned/unseen classes. The paper says its results average five initialization seeds; Table 12 reports the raw cells AWA2: 56.9 ± 8.2; CUB: 44.0 ± 1.9; Aircraft: 35.1 ± 4.2; ImageNet+: 35.1 ± 0.5; Average: 42.8, but does not define the statistic after ±. The scalar score stores only the reported central value; ± is preserved in evidence and is not interpreted as a CI or standard deviation. No exact weight hash or checkpoint revision is given.
- Context
- This is a result for the combined visual encoder/projection evaluation, not standalone LLM generation or intrinsic language-model accuracy. The paper does not define the reported ± statistic; it is not converted into a CI.
Visual generalization (average per-class accuracy): ImageNet+ (Show measurement, test conditions, and source)
- Source value
- 35.1
- Score
- 35.1
- Metric
- Average per-class classification accuracy on unaligned classes
- Unit
- %
- Benchmark version
- TMLR 01/2026, Appendix Table 12
- Category
- visual classification generalization
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Better Language Models Exhibit Higher Visual Alignment (TMLR, 01/2026; author-hosted full paper)
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Independent evaluation. Falcon3-7B-Base is used as a frozen decoder-based text encoder in the paper's CLIP-like visual-generalization framework: last-token-pooled text features with DINOv2 ViT-L/14 image features and a learned linear projection. Evaluation reports average per-class classification accuracy on unaligned/unseen classes. The paper says its results average five initialization seeds; Table 12 reports the raw cells AWA2: 56.9 ± 8.2; CUB: 44.0 ± 1.9; Aircraft: 35.1 ± 4.2; ImageNet+: 35.1 ± 0.5; Average: 42.8, but does not define the statistic after ±. The scalar score stores only the reported central value; ± is preserved in evidence and is not interpreted as a CI or standard deviation. No exact weight hash or checkpoint revision is given.
- Context
- This is a result for the combined visual encoder/projection evaluation, not standalone LLM generation or intrinsic language-model accuracy. The paper does not define the reported ± statistic; it is not converted into a CI.
Visual generalization (average per-class accuracy): Average (Show measurement, test conditions, and source)
- Source value
- 42.8
- Score
- 42.8
- Metric
- Average per-class classification accuracy on unaligned classes
- Unit
- %
- Benchmark version
- TMLR 01/2026, Appendix Table 12
- Category
- visual classification generalization
- Direction
- Higher is better
- Source type
- independent-evaluator
- Evaluator
- Better Language Models Exhibit Higher Visual Alignment (TMLR, 01/2026; author-hosted full paper)
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Independent evaluation. Falcon3-7B-Base is used as a frozen decoder-based text encoder in the paper's CLIP-like visual-generalization framework: last-token-pooled text features with DINOv2 ViT-L/14 image features and a learned linear projection. Evaluation reports average per-class classification accuracy on unaligned/unseen classes. The paper says its results average five initialization seeds; Table 12 reports the raw cells AWA2: 56.9 ± 8.2; CUB: 44.0 ± 1.9; Aircraft: 35.1 ± 4.2; ImageNet+: 35.1 ± 0.5; Average: 42.8, but does not define the statistic after ±. The scalar score stores only the reported central value; ± is preserved in evidence and is not interpreted as a CI or standard deviation. No exact weight hash or checkpoint revision is given.
- Context
- This is a result for the combined visual encoder/projection evaluation, not standalone LLM generation or intrinsic language-model accuracy. The paper does not define the reported ± statistic; it is not converted into a CI.
MMLU (Show measurement, test conditions, and source)
- Source value
- 67.5
- Score
- 67.5
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; 5-shot.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
MMLU-PRO (Show measurement, test conditions, and source)
- Source value
- 39.2
- Score
- 39.2
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; 5-shot.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
IFEval (Show measurement, test conditions, and source)
- Source value
- 34.3
- Score
- 34.3
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; shot count not stated.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
GSM8K (Show measurement, test conditions, and source)
- Source value
- 76.2
- Score
- 76.2
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; 5-shot.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
MATH (Show measurement, test conditions, and source)
- Source value
- 18
- Score
- 18
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; 4-shot.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
ARC Challenge (Show measurement, test conditions, and source)
- Source value
- 59.6
- Score
- 59.6
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; 25-shot.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
GPQA (Show measurement, test conditions, and source)
- Source value
- 35.5
- Score
- 35.5
- Metric
- raw score
- Unit
- No unit provided
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Technology Innovation Institute Falcon3-7B-Base model card
- Status
- active
- Retrieved at
- 2026-10-15
- Methodology
- Vendor-reported result. Exact Falcon3-7B-Base column in TII internal pipeline table. Source states lm-evaluation-harness, raw scores, and same batch size across compared models; numeric unit/scale and task snapshot dates are not stated.; 0-shot.
- Context
- The source gives a numeric score but does not label its unit or scale; the raw value is retained without converting it to percent.
Page 1 of 3
Popularity compared
How often the model is searched for, used and mentioned, compared with every model of its category.
Popularity index
The 100 most popular models of this category, 0 to 100, higher is more popular
20 of 101 models
As of November 2026 · Source: gradually.ai popularity index
Over time
Weekly values from October 18, 2026 to November 7, 2026
Falcon 3 7BGPT-4o mini 26AutoGLM Phone 9B Multilingual 26GPT-5.5 Pro 26Claude Opus 4.5 26
Method changes in the timeline, a jump at these points is no market event:
- 1November 1, 2026: Value only with search or usage data, 30-day attention
What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.
Similar models
More models of the same kind as Falcon 3 7B, chosen by model line, developer, size, price and release date.
All specifications
Architecture
Input and output
Watermarking and provenance
AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.
- AI watermarking
- Unknown
- no source
- Watermarking technique
- Not known
- no source
Licence and access
Frequently asked questions about Falcon 3 7B
How large is the context window of Falcon 3 7B?
32,768 tokens. That is how much text Falcon 3 7B reads at once, about 50 A4 pages.
Page count as a rule of thumb from Artificial Analysis
Can I run Falcon 3 7B locally?
Yes, the weights are open.
Stated by TII
- Open weights
- yes
- License
- Falcon License
- Parameters
- 7B
- active per token
- n/a
Sources and data date
Show all 11 sources
Benchmark sources at a glance
Which independent evaluators tested this model. This is coverage, not a quality ranking.
No active result from the reviewed external evaluators can currently be attributed to this model. Other source evidence remains available below.
Without vendor claims and historical or disputed results; those stay labelled in the single values.
| Type | Evidence and data date |
|---|---|
| Input | Documented modalities. |
| Output | Documented modalities. |
| Research status | Research date October 15, 2026. 4 source URLs checked. This documents the inspected sources, not an exhaustive inventory of every publication. |
| Not published | score-unit-and-task-date Note Card calls values raw scores but does not label unit/scale or task snapshot dates; values remain unknown-unit raw scores. |
| Not published | checkpoint revision Note The paper names the exact Falcon3 base size/checkpoint family but does not give an immutable weight hash or revision. |
| Not published | sample counts Note No per-dataset scored example count is stated with Table 12; no sampleCount is inferred. |
| Unresolved | reported ± statistic Note Table 12 prints ± values and the paper states results average five initialization seeds, but does not define the statistic represented by ±. The raw text is retained in evidence and no CI is encoded. |
| Additional source | Technology Innovation Institute Falcon3-7B-Base model card (retrieved October 15, 2026) |
| Additional source | Better Language Models Exhibit Higher Visual Alignment (TMLR, 01/2026; author-hosted full paper) (retrieved October 17, 2026) |
| Additional source | El Amel Boussaha et al., Adapting Falcon3-7B Language Model for Arabic: Methods, Challenges, and Outcomes, Table 5 (retrieved October 17, 2026) |
| Additional source | Falcon 3 7B model card · Editorial description reviewed October 2, 2026 |
| Additional source | OpenRouter: Popularity index (derived), CC BY 4.0 |
| Additional source | Vercel AI Gateway: Popularity index (derived), CC BY 4.0 |
| Additional source | Ollama: cumulative downloads for the popularity index |
| Additional source | Replicate: cumulative runs for the popularity index |
| Additional source | Google Trending Now: limited feed selection for Germany and the US |
| Additional source | Creative Commons Attribution 4.0 |