Skip to main content

AWS StrandsPerplexityDecision matchup

Strands Decider 2Bvs.pplx-decider-v1.1-27b

Which model makes better decisions?

pplx-decider-v1.1-27b does better in independent tests, while Strands Decider 2B is much smaller.

Independent tests
Strands Decider 2B0 of 1
pplx-decider-v1.1-27bahead1 of 1
Jev Decision Index
Popularity
Strands Decider 2B1
pplx-decider-v1.1-27bahead42
out of 100
Weights and access
Strands Decider 2Bopen, local
pplx-decider-v1.1-27bopen, local
Size
Strands Decider 2Bsmaller2 B
pplx-decider-v1.1-27b26.09 B
Parameters

Pick Strands Decider 2B for

smaller

Pick pplx-decider-v1.1-27b for

Jev Decision Indexmore popular

Shared tests

Independent evaluators and leaderboards only, the newest shared snapshot per evaluator. With 95 % ranges a lead counts when they do not overlap; for hit rates, when it holds in a 95 % test. Without any uncertainty figure at most “slightly ahead”.

Jev Decision Index

pplx-decider-v1.1-27b ahead

pplx-decider-v1.1-27b is clearly ahead in 27 of 51 subtests and slightly in 19, Strands Decider 2B in 0 clearly and slightly in 2. 3 are level.

Home appliances · Decision Index 0.3

Strands Decider 2B0.0
pplx-decider-v1.1-27b80.7

88 tasks, as of October 7, 2026

POP909 · Decision Index 0.3

Strands Decider 2B6.9
pplx-decider-v1.1-27b57.1

2,000 tasks, as of October 7, 2026

GSM8K · Decision Index 0.3

Strands Decider 2B24.7
pplx-decider-v1.1-27b76.6

2,638 tasks, as of October 7, 2026

Show all 51 subtests
SubtestStrands Decider 2Bpplx-decider-v1.1-27bVerdict
Home appliances · Decision Index 0.30.080.7pplx-decider-v1.1-27b ahead
POP909 · Decision Index 0.36.957.1pplx-decider-v1.1-27b ahead
GSM8K · Decision Index 0.324.776.6pplx-decider-v1.1-27b ahead
SATA-Bench · Decision Index 0.39.828.2pplx-decider-v1.1-27b ahead
CRUXEval · Decision Index 0.333.385.6pplx-decider-v1.1-27b ahead
MMLU-Pro · Decision Index 0.331.171.0pplx-decider-v1.1-27b ahead
API-Bank · Decision Index 0.339.685.8pplx-decider-v1.1-27b ahead
ChessBench · Decision Index 0.39.217.7pplx-decider-v1.1-27b ahead
BBH · Decision Index 0.346.584.0pplx-decider-v1.1-27b ahead
MMLU · Decision Index 0.351.087.7pplx-decider-v1.1-27b ahead
BPoMP · Decision Index 0.356.095.2pplx-decider-v1.1-27b ahead
GPQA Diamond · Decision Index 0.333.256.1pplx-decider-v1.1-27b ahead
New Yorker · Decision Index 0.345.575.6pplx-decider-v1.1-27b ahead
HellaSwag · Decision Index 0.357.493.2pplx-decider-v1.1-27b ahead
WinoGrande · Decision Index 0.357.492.4pplx-decider-v1.1-27b ahead
CLadder · Decision Index 0.354.479.3pplx-decider-v1.1-27b ahead
PhishNChips · Decision Index 0.350.873.2pplx-decider-v1.1-27b ahead
Decision Index all-suite calibration accuracy54.176.1pplx-decider-v1.1-27b ahead
MuSR · Decision Index 0.351.170.7pplx-decider-v1.1-27b ahead
HoVer · Decision Index 0.354.174.1pplx-decider-v1.1-27b ahead
ARC-Challenge · Decision Index 0.371.197.0pplx-decider-v1.1-27b ahead
cfcolor · Decision Index 0.350.764.5pplx-decider-v1.1-27b ahead
When2Call · Decision Index 0.359.673.9pplx-decider-v1.1-27b ahead
Humicroedit · Decision Index 0.349.761.2pplx-decider-v1.1-27b ahead
BFCL · Decision Index 0.381.497.2pplx-decider-v1.1-27b ahead
Habermas · Decision Index 0.338.042.0pplx-decider-v1.1-27b ahead
ARC-Easy · Decision Index 0.390.599.3pplx-decider-v1.1-27b ahead
Decision Index confidence-above-95% share (lower is better)0.02.0Strands Decider 2B slightly ahead
ACOS · Decision Index 0.36.028.2pplx-decider-v1.1-27b slightly ahead
Decision Index 0.3 · Full Decision Index score2263pplx-decider-v1.1-27b slightly ahead
Decision Index 0.3 · Private new-domains component2056pplx-decider-v1.1-27b slightly ahead
Decision Index 0.3 · Public breadth skill score2362pplx-decider-v1.1-27b slightly ahead
Decision Index 0.3 · Private same-skills component2361pplx-decider-v1.1-27b slightly ahead
Decision Index 0.3 · Public index skill score2562pplx-decider-v1.1-27b slightly ahead
iSarcasmEval · Decision Index 0.329.671.0pplx-decider-v1.1-27b slightly ahead
RAGTruth · Decision Index 0.335.783.1pplx-decider-v1.1-27b slightly ahead
Amazon ESCI · Decision Index 0.326.060.4pplx-decider-v1.1-27b slightly ahead
VAST · Decision Index 0.340.476.7pplx-decider-v1.1-27b slightly ahead
ANLI · Decision Index 0.339.974.3pplx-decider-v1.1-27b slightly ahead
Decision Index all-suite Brier score (lower is better)55.233.5pplx-decider-v1.1-27b slightly ahead
Decision Index all-suite expected calibration error (lower is better)4.47.1Strands Decider 2B slightly ahead
Decision Index 0.3 · Public index raw score4472pplx-decider-v1.1-27b slightly ahead
CLINC150 · Decision Index 0.364.791.5pplx-decider-v1.1-27b slightly ahead
BRIGHT · Decision Index 0.336.850.8pplx-decider-v1.1-27b slightly ahead
FinEntity · Decision Index 0.372.795.4pplx-decider-v1.1-27b slightly ahead
NLI4CT · Decision Index 0.365.884.9pplx-decider-v1.1-27b slightly ahead
ToolRet · Decision Index 0.360.567.8pplx-decider-v1.1-27b slightly ahead
ContractNLI · Decision Index 0.373.078.4pplx-decider-v1.1-27b slightly ahead
HLE · Decision Index 0.314.016.2level
RouterBench · Decision Index 0.378.979.8level
BANKING77 · Decision Index 0.380.480.6level

Source · latest October 7, 2026

All data side by side

Strands Decider 2Bpplx-decider-v1.1-27b
KindAdapterStandalone
DeveloperAWS StrandsPerplexity
StatusOpen weightsOpen weights
ReleasedOctober 5, 2026October 6, 2026
Weightsopenopen
Runs locallyyesyes
Parameters2 B26.09 B
LicenseApache-2.0Apache-2.0; the public Hugging Face repository is not access-gated
Pricen/aPerplexity states $0.02 per 1M input tokens.
Popularity (out of 100)142

More comparisons with Strands Decider 2B and pplx-decider-v1.1-27b

All decision models compared