Skip to main content

Firefly Image Model 5vs.Runway Gen-4 Image

Which one is better?

In our own test both are on par. Neither is in the arena. Neither has an API price.

Same prompt, two images

Same task, the first image of each. The task with the biggest difference is preselected.

Firefly Image Model 5: Character and detail, first image from the fixed test run
Firefly Image Model 587 out of 100
Runway Gen-4 Image: Character and detail, first image from the fixed test run
Runway Gen-4 Image22 out of 100

Result for “Character and detail”:Firefly Image Model 5 ahead

Prompt given to both modelsCreate a square cinematic full-body portrait of a fictional bicycle courier waiting under a transparent umbrella at a rainy tram stop in Hamburg at blue hour. She wears a mustard raincoat, navy trousers, red sneakers, a silver helmet, and carries a teal messenger bag. Keep both hands visible, render the bicycle correctly, use realistic wet-street reflections, and include no readable brand names.

What the rating looks at: Anatomy, clothing, and spatial consistency.

“Ahead”: better in all three rating rounds. “Slightly ahead”: a higher value, but not in every round.

Test protocol of the images

Both models receive the same archived prompt in exactly one request, and the first result counts. Files are normalized to 1,024 × 1,024 pixels without cropping. Provider resolution, randomness, quality tier and prompt processing can still differ. The images are a practical visual test, not a reconstruction of the arena configuration.

Character and detail

Firefly Image Model 5: manual, one request, first output, Firefly Image 5, 1:1, 1K, no reference image, no negative prompt, 10 Adobe credits, generated Aug 16, 2026, 12:14 PM. Source

Runway Gen-4 Image: manual, 1:1, one request, first output (first top-left candidate of native batch), exact UI model Runway Gen-4 Image, provider-default random seed, native resolution provider default, fast mode not offered, no reference images, no selected effects, default content settings, source UI file Firefly_Create a square cinematic full-body portrait of a fictional bicycle courier waiting u 715099.png, source 1080x1080, stored 1024x1024 (Lanczos3 downscale), generated Nov 1, 2026, 10:33 PM. Source

Protocol gradually-image-comparison-v1. Prompt SHA 256: 985a75b38642a9f0e5e0c0e0c67f1b7f67780d42bd2168fa24e9a7a7a94b0da6

Firefly Image Model 5 image SHA 256: 6a8e97db33824727599cf62339ff714cfb836a96a5f078010bb7760d7372f3d4

Runway Gen-4 Image image SHA 256: 1235971dc0ffbe1e82ce305c9e7608d10a9b604697ec359a332cd4f2d931db71

Infographic

Firefly Image Model 5: manual, one request, first output, Firefly Image 5, 1:1, 1K, no reference image, no negative prompt, 10 Adobe credits, generated Aug 16, 2026, 12:14 PM. Source

Runway Gen-4 Image: manual, 1:1, one request, first output (first top-left candidate of native batch), exact UI model Runway Gen-4 Image, provider-default random seed, native resolution provider default, fast mode not offered, no reference images, no selected effects, default content settings, source UI file Firefly_Create a square German infographic titled SO FUNKTIONIERT PHOTOSYNTHESE. Show exactly 715099.png, source 1080x1080, stored 1024x1024 (Lanczos3 downscale), generated Nov 1, 2026, 10:33 PM. Source

Protocol gradually-image-comparison-v1. Prompt SHA 256: ed65cb4e6a51e2336f8b149ad4cbb16e020f07d527ad94362e719d2dcf91d94f

Firefly Image Model 5 image SHA 256: 8fa6d9b40c417847061ec33d789ad5bf91f1e85da586515c6226ce6db825d1ba

Runway Gen-4 Image image SHA 256: 13955a0ff71a8e54cde4d84a78ace5dba2bc64b8df79c939bffabca22620480c

Product photography

Firefly Image Model 5: manual, one request, first output, Firefly Image 5, 1:1, 1K, no reference image, no negative prompt, 10 Adobe credits, generated Aug 16, 2026, 12:14 PM. Source

Runway Gen-4 Image: manual, 1:1, one request, first output (first top-left candidate of native batch), exact UI model Runway Gen-4 Image, provider-default random seed, native resolution provider default, fast mode not offered, no reference images, no selected effects, default content settings, source UI file Firefly_Create a square premium product photograph of a brushed titanium wristwatch standing 715099.png, source 1080x1080, stored 1024x1024 (Lanczos3 downscale), generated Nov 1, 2026, 10:31 PM. Source

Protocol gradually-image-comparison-v1. Prompt SHA 256: c67fd71e91304458a2feef5c91efa8677260fab0c0099a29a2c52cb579f5b2f3

Firefly Image Model 5 image SHA 256: c36dab49ebe40473fa9e9a61b2b02fe36c4cd3536cbb6aac1d0ad0f8944d8bfc

Runway Gen-4 Image image SHA 256: 24a4b7e7c9ac88d5e5c7a508aca6c7de29c4ca9e55c0d17623005dbe3e6aaadd

Typography and layout

Firefly Image Model 5: manual, one request, first output, Firefly Image 5, 1:1, 1K, no reference image, no negative prompt, 10 Adobe credits, generated Aug 16, 2026, 12:14 PM. Source

Runway Gen-4 Image: manual, 1:1, one request, first output (first top-left candidate of native batch), exact UI model Runway Gen-4 Image, provider-default random seed, native resolution provider default, fast mode not offered, no reference images, no selected effects, default content settings, source UI file Firefly_Create a square editorial poster for an imaginary night train called MONDFALTER. Show 715099.png, source 1080x1080, stored 1024x1024 (Lanczos3 downscale), generated Nov 1, 2026, 10:31 PM. Source

Protocol gradually-image-comparison-v1. Prompt SHA 256: 2e012c3d14ee5dd02203a94f394ca80a5038cdebd6032b25a8b8a221f2255419

Firefly Image Model 5 image SHA 256: cf8a921a221de5e456df2311482fc999303f5438270fb1a77c1be2dd3d9afc0b

Runway Gen-4 Image image SHA 256: 73ca9e031f19143e8227ccfb5d651cd72eed23184d7cf7b980890310d55f7a8d

The numbers at a glance

Arena ratingfrom votes by users · higher is better
n/a

Firefly Image Model 5

not in the arena

n/a

Runway Gen-4 Image

not in the arena

GraduallyBenchour own rating, 0 to 100 · higher is better
48

Firefly Image Model 5

Rank 49 of 74

25

Runway Gen-4 Image

Rank 61 of 74

Price per imagedollars through the API · lower is better
n/a

Firefly Image Model 5

no API price

n/a

Runway Gen-4 Image

no API price

Ranks among the 22 image models with an arena rating and the 74 with a GraduallyBench run; prices compared with 28 models with an API price.

Firefly Image Model 5

Subscription
n/a No plan in Germany names exactly this model.
Via API
No API price known. Access: API, Web app.

Runway Gen-4 Image

Subscription
No Runway subscription includes this model. Through other providers from ≈ €6.39 a month (ElevenLabs Starter, with limited credits). 19 plans in Germany.
Via API
No API price known. Access: API, Web app.
Weights
unknown.

Subscriptions only count plans that name exactly this model. Subscription prices include VAT, API prices are in dollars.

GraduallyBench from Nov 1, 2026 · Subscription database from Sep 29, 2026 (34 days old)

All data side by side

The better value is bold. For ratings only when the gap is clear.

KennzahlFirefly Image Model 5Runway Gen-4 Image
Ratings
Arena ratingfrom votes by users, higher is bettern/an/a
Arena rankn/an/a
Arena votesmore votes, a safer ratingn/an/a
GraduallyBenchour own rating, 0 to 1004825
GraduallyBench by task
Typography and layoutLegible text, hierarchy, and composition7432
Product photographyMaterials, reflections, and fine details2420
Character and detailAnatomy, clothing, and spatial consistency8722
InfographicNumbers, labels, and visual organization527
API price
Per imagelower is bettern/an/a
100 imagesn/an/a
Profile
ReleasedOct 28, 2025n/a
Weightsopen means: runs locallyproprietaryunknown
LifecycleGenerally available since March 19, 2026no notice
AccessAPI, Web appAPI, Web app
Parametersnot publishednot published
Largest output4 Megapixelnot consistently published
Plans in Germanynaming exactly this modeln/a19

API prices for one image at 1,024 × 1,024 pixels according to Artificial Analysis.

Sources: Firefly Image Model 5 model source, status source (verified Aug 15, 2026) · Runway Gen-4 Image model source (verified Nov 1, 2026)

Arena ratings by category

From blind votes on LMArena. “Ahead” means the lead is clear.

No shared arena score in the stored snapshot

The stored benchmark database contains no measurement for Firefly Image Model 5 and Runway Gen-4 Image from the same arena and category. Older model versions are not used as substitutes.

Compare another matchup