H CompanyLanguage modelOpen weights
Holo4-27B
Holo4-27B has no overall index value yet because there are too few independent benchmark results.
33out of 100new calculation
based on two data groups, mostly search, range 23 to 42
Summary
Holo4-27B switches between screen interaction, code it writes, and API tools within a task. H Company post-trained Qwen3.8-27B on tasks spanning desktop, web, and Android environments. This dense 27B variant launched alongside Holo4-35B-A3B.
H Company releases the weights under CC BY-NC 4.0 for non-commercial use. The checkpoint handles screenshots and text with up to 262,144 context tokens.
On this page
All benchmark results
Every published result with its source, test setup and comparison models.
Show all 17 published benchmark results
Page 1 of 2
Measurements without matching peer values
These measurements have no matching peer values under the same test conditions. Their original values and sources remain available here.
OSWorld (Show measurement, test conditions, and source)
- Source value
- 85.2
- Metric
- OSWorld
- Unit
- %
- Category
- source-specific
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Provider model card
- Status
- active
- Retrieved at
- 2026-10-04
- Methodology
- Vendor-reported result. H Company hai-agents computer-use agent loop with screenshots and tools; the card presents vendor-run results for the exact checkpoint.
- Context
- Source-specific observation; it is not a shared comparison cohort.
OSWorld 2.0 (Show measurement, test conditions, and source)
- Source value
- 61.7
- Metric
- OSWorld 2.0
- Unit
- %
- Category
- source-specific
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Provider model card
- Status
- active
- Retrieved at
- 2026-10-04
- Methodology
- Vendor-reported result. H Company hai-agents computer-use agent loop with screenshots and tools; the card presents vendor-run results for the exact checkpoint.
- Context
- Source-specific observation; it is not a shared comparison cohort.
AutomationBench 1.0.6 (Show measurement, test conditions, and source)
- Source value
- 45.4
- Metric
- AutomationBench 1.0.6
- Unit
- %
- Category
- source-specific
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Provider model card
- Status
- active
- Retrieved at
- 2026-10-04
- Methodology
- Vendor-reported result. H Company hai-agents computer-use agent loop with screenshots and tools; the card presents vendor-run results for the exact checkpoint.
- Context
- Source-specific observation; it is not a shared comparison cohort.
OSWorld 2.0 success rate (Show measurement, test conditions, and source)
- Source value
- 41.5
- Metric
- success rate
- Unit
- %
- Benchmark version
- Hcompany Holo4 official release comparison; published 2026-09-28
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Hcompany Holo4 release report
- Status
- active
- Retrieved at
- 2026-10-16
- Methodology
- Vendor-reported result. Holo4-27B; OSWorld 2.0; success rate. Separate from the previously reported average partial score 61.7%.
- Context
- OSWorld 2.0 is reported as a single run; full harness details are not stated.
ALE-CLI average score (Show measurement, test conditions, and source)
- Source value
- 44.1
- Metric
- average score
- Unit
- %
- Benchmark version
- Hcompany Holo4 official release comparison; published 2026-09-28
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Hcompany Holo4 release report
- Status
- active
- Retrieved at
- 2026-10-16
- Methodology
- Vendor-reported result. Holo4-27B; Agents Last Exam CLI 105-task Linux split; Hcompany harness; single run.
- Context
- Two of 105 attempts that accessed reference answers left on the test machine were excluded; one run; the model's values are vendor-reported.
ALE-CLI success rate (Show measurement, test conditions, and source)
- Source value
- 19.4
- Metric
- success rate
- Unit
- %
- Benchmark version
- Hcompany Holo4 official release comparison; published 2026-09-28
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Hcompany Holo4 release report
- Status
- active
- Retrieved at
- 2026-10-16
- Methodology
- Vendor-reported result. Holo4-27B; Agents Last Exam CLI 105-task Linux split; Hcompany harness; single run.
- Context
- Two of 105 attempts that accessed reference answers left on the test machine were excluded; one run; the model's values are vendor-reported.
AndroidWorld (Show measurement, test conditions, and source)
- Source value
- 85.1
- Metric
- reported score
- Unit
- %
- Benchmark version
- Hcompany Holo4 official release comparison; published 2026-09-28
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- Hcompany Holo4 release report
- Status
- active
- Retrieved at
- 2026-10-16
- Methodology
- Vendor-reported result. Holo4-27B; AndroidWorld; score reported by Hcompany as measured by Qwen for Qwen3.8 release.
- Context
- The source provides no sample count or run variance for this AndroidWorld row.
AutomationBench v1.0.6 held-out 120-task subset (Show measurement, test conditions, and source)
- Source value
- 49.3
- Metric
- score
- Unit
- %
- Benchmark version
- Hcompany Holo4 official release comparison; published 2026-09-28
- Direction
- Higher is better
- Sample
- 120
- Source type
- vendor-reported
- Evaluator
- Hcompany Holo4 release report
- Status
- active
- Retrieved at
- 2026-10-16
- Methodology
- Vendor-reported result. Holo4-27B; AutomationBench v1.0.6; held-out subset of 120 tasks; public and held-out results are separate.
- Context
- Vendor-reported result on 120 held-out tasks within the 600-task public set. The other 480 public tasks belong to the split used to collect training data. This is not the official private-set evaluation.
Agentic Task Factory Web (Show measurement, test conditions, and source)
- Source value
- 80.2
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- H Company Holo4 release
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Vendor-reported result. H Company's Agentic Task Factory evaluation. Exact Holo4 model column and interface task. The test set mixes in-domain and out-of-domain tasks; the vendor says generated tasks were not used for training.
- Context
- Vendor-reported. The source publishes no scored sample count or confidence intervals for these tasks. The source does not identify a more specific score metric. The source does not state a benchmark-suite version.
Agentic Task Factory MCP (Show measurement, test conditions, and source)
- Source value
- 89.4
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- H Company Holo4 release
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Vendor-reported result. H Company's Agentic Task Factory evaluation. Exact Holo4 model column and interface task. The test set mixes in-domain and out-of-domain tasks; the vendor says generated tasks were not used for training.
- Context
- Vendor-reported. The source publishes no scored sample count or confidence intervals for these tasks. The source does not identify a more specific score metric. The source does not state a benchmark-suite version.
Agentic Task Factory Desktop (Show measurement, test conditions, and source)
- Source value
- 72
- Metric
- percent
- Unit
- %
- Direction
- Higher is better
- Source type
- vendor-reported
- Evaluator
- H Company Holo4 release
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Vendor-reported result. H Company's Agentic Task Factory evaluation. Exact Holo4 model column and interface task. The test set mixes in-domain and out-of-domain tasks; the vendor says generated tasks were not used for training.
- Context
- Vendor-reported. The source publishes no scored sample count or confidence intervals for these tasks. The source does not identify a more specific score metric. The source does not state a benchmark-suite version.
PinchBench v2.0.0 (Show measurement, test conditions, and source)
- Source value
- 94.7845804989
- Metric
- task success rate, score at least 0.5
- Unit
- %
- Benchmark version
- 2.0.0
- Category
- agentic-workflow
- Direction
- Higher is better
- Sample
- 441
- Source type
- vendor-reported
- Evaluator
- H Company Trajectories public index
- Status
- active
- Retrieved at
- 2026-10-17
- Methodology
- Vendor-reported result. The public index's PinchBench v2.0.0 entry identifies the Holo4 27B series. It describes 147 unique tasks in a staged-file code sandbox, using terminal and file read/write tools, a 200-step cap, and task scores from 0 to 1 with a pass threshold of 0.5. The model entry records 441 task-run trials over three runs and success_rate 0.9478458049886622. The index does not pin a model revision or publish a confidence interval.
- Context
- Vendor-reported. sampleCount 441 counts repeated task-run trials, not 441 independent tasks: the source identifies 147 unique tasks run three times. No confidence interval or checkpoint revision is published.
Page 1 of 2
Popularity compared
How often the model is searched for, used and mentioned, compared with every model of its category.
Popularity index
The 100 most popular models of this category, 0 to 100, higher is more popular
20 of 101 models
As of November 2026 · Source: gradually.ai popularity index
Over time
Weekly values from October 18, 2026 to November 20, 2026
Holo4-27BNemotron Cascade 2 30B A3B 33Command A Plus 33Qwen3 Omni 30B A3B Thinking 33Trinity Large Preview 32
Method changes in the timeline, a jump at these points is no market event:
- 1November 1, 2026: Value only with search or usage data, 30-day attention
- 2November 1, 2026: Method version 4 (common scale, shrinkage)
- 3November 9, 2026: New topics measurement V20 (daily quorum, short forms)
What is gaining popularity right now, across models, vendors, harnesses and AI subscriptions, is collected in All AI trends.
Similar models
More models of the same kind as Holo4-27B, chosen by model line, developer, size, price and release date.
- Holo4-35B-A3BH Company · same developer
- Holotron4-30B-A3BH Company · same developer
- Arete-27BNous Research · similar size
- Qwen 3.6 27BAlibaba · similar size
- Gemma 4 26B A4BGoogle · similar size
- DiffusionGemma 26B A4B ITGoogle · similar size
- Qwen 3.5 27BAlibaba · similar size
- Trinity MiniArcee AI · similar size
All specifications
Architecture
Input and output
Watermarking and provenance
AI watermarking refers to invisible signals embedded in the output. Visible marks and provenance metadata are listed separately. Unknown means there is insufficient evidence for that particular field.
- AI watermarking
- Unknown
- no source
- Watermarking technique
- Not known
- no source
Licence and access
- Shutdown
- None announced
- no source
API
Frequently asked questions about Holo4-27B
How large is the context window of Holo4-27B?
262,144 tokens. Separate limits may apply to input and output.
Can I run Holo4-27B locally?
Yes, the weights are open.
Stated by H Company
- Open weights
- yes
- License
- CC BY-NC 4.0
- Parameters
- 27B
- active per token
- n/a
Sources and data date
Show all 10 sources
Benchmark sources at a glance
Which independent evaluators tested this model. This is coverage, not a quality ranking.
No active result from the reviewed external evaluators can currently be attributed to this model. Other source evidence remains available below.
Without vendor claims and historical or disputed results; those stay labelled in the single values.