Optimizely recently published a LinkedIn highlighting that with the use of their Marketing AI Benchmark project Mark-Bench validating the expected cost for usage. In this article, we break down what this means for customer.

The AI number nobody puts on the slide 

100 marketing tasks a day: $362 on Claude Opus 5.5. $68 on Kimi K3. The quality gap? Under five points. 

That's the headline from Optimizely's new Mark-Bench research. It changes the AI question from "which model is best?" to "which model is good enough, and what am I paying for the difference?" Once AI moves from pilot to production, that's the question that counts.

What Optimizely tested 

Mark-Bench puts AI models through 285 real marketing tasks, each with a brief, source files and a checklist. A task only passes if every item is met. Optimizely pitted the closed-weight models behind Mark today (Claude, Gemini, GPT) against open-weight challengers (Kimi, GLM, DeepSeek) it plans to bring into Mark soon. In short: a preview of the choices coming to your instance.

Quality per dollar 

Kimi K3 delivers 92% of Opus's quality for 19% of the price.

Model Tasks passed Cost per task Quality vs Opus Cost vs Opus
Gemini 4 Argon 62.5%  about 2x Kimi K3  102%  about 38%
Claude Opus 5.5 61.4% $3.62 100% 100%
Kimi K3 56.5% $0.68  92% 19%
DeepSeek V4.1 Flash 53.3%  $0.21  87% 6%
GLM-5.3 Flash  36.5% under $0.02  59%  under 1% 

Source: Optimizely Mark-Bench (early version), November 2026. Ratios calculated by Niteco; Argon's are approximate.

  • The top is a tie. Argon, Opus and GPT-6.1 Sol are statistically level. Paying for a "winner" buys little. 
  • The gap is small. Open-weight Kimi K3 and GLM-5.3 sit within six points of Opus at a fifth of the price. 
  • Simple work is nearly free. The cheapest model clears 59% of what Opus does for under two cents.

How cents become six figures 

AI is billed by the token, on everything that goes in and comes out. Briefs, brand guides, product data and multi-step agents all run the meter. Small per-task prices compound fast: 

Volume (illustrative) Claude Opus 5.5  Kimi K3 DeepSeek V4.1 Flash 
100 tasks a day, for a year  $132,130 $24,820  $7,665 
1,000 tasks a day, for a year  $1,321,300  $248,200  $76,650

Based on Mark-Bench average cost per task. Real costs vary with task size and setup.

Model choice is a multiplier on every market, language and agent you add.

Right model, right job 

On summarising an email, Optimizely's Imran Yousuf puts it neatly: "A cent and a half might be more than sufficient." The smart play is matching each task to the cheapest model that does it well.

Tier Use it for
Frontier (Opus, Argon, GPT) Campaign strategy, brand-critical copy, experiment analysis, complex agent workflows 
Near-frontier (Kimi K3, GLM-5.3) Commerce product descriptions, page drafts, test variants, localisation
Budget (DeepSeek Flash, GLM Flash)  Summaries, tagging, alt text, SEO metadata, form triage

The catch: you can only route well if you know what each model can do. That's what marketing-specific benchmarks are for. 

What this means for Optimizely customers? 

Optimizely is building a model router, per-instance control over which models are switched on, and model recommendations for the agents you build. Model choice is becoming a commercial decision, not just a technical one. The payoff: 

Your budget goes further. Savings on routine work fund more markets, use cases and tests. 

Scale becomes viable. Catalogue enrichment and localisation stop being too expensive to automate. 

You're less locked in. With the top models tied and open-weight close behind, no vendor is irreplaceable. 

Get ready now. Know your cost per task, define what "good enough" means for each job, decide who owns model choices, and check your data requirements before new models land. 

One caveat: this is an early version of Mark-Bench, so treat small gaps as directional. The direction itself is clear. 

Work with the largest global Optimizely partner

Link copied!
Find out
how we can help you.
Contact Us
Find out <br/>how we can help you.