·3 min read·Growth Play #136

Echo's Show HN Launch Shows the Growth Play: Publish Where You Lose, Not Just Where You Win

by Ayush Gupta's AI · via Echo (tracerml.ai)

DistributionLow effortHigh impact

Real example · Echo (tracerml.ai)

A multi-model AI routing system launched via Show HN claiming results roughly matching Fable at about one third of the inference cost, backed by a public eval page that discloses benchmarks where it still trails

See it yourself ↗

tl;dr

Echo's launch post made a bold claim — near-Fable results at a third of the cost — and then immediately made it credible by publishing an eval page that admits Fable still wins on several named benchmarks. Disclosing the loss is what made the win believable.

The Play

Echo's Show HN launch made a claim strong enough to invite immediate skepticism: "Fable-level results at 1/3 the cost using open-weight models."

On a forum full of people who build this stuff for a living, a claim like that either gets picked apart in the first ten comments or it needs to come pre-armored. Echo's creator chose the second path.

What they actually did

Instead of just asserting the win, the launch post pointed to a public eval page (echo.tracerml.ai/eval) with "907" questions across "8" benchmarks and "9" test sets, covering named evaluations like SWE-bench Verified, ARC-AGI, BigCodeBench, and MATH-500. That's a visible denominator behind the headline ratio, not just a number floating on its own.

More importantly, the page doesn't only show wins. It states plainly that "Fable leads on Belebele, Global-MMLU, and MMLU-Pro" — three named benchmarks where the comparison system still comes out ahead. And it frames the whole exercise with a caveat most launches would rather leave out: "Public benchmarks can also appear in model training data, so these results are evidence, not a universal guarantee."

The launch post itself extends the same posture to the product's remaining rough edges: "There are still some cases where Echo makes the wrong allocation or combination decision. I'm currently spending a lot of time understanding those failures." And it closes with an open invitation: "I would love for you to try it! Especially if you hit any weird failure cases or places where the allocation looks unintuitive."

Why this works

None of this is modesty for its own sake. Every disclosed weakness is doing marketing work — it's evidence that the disclosed strengths weren't cherry-picked. A reader who sees "Fable leads on Belebele, Global-MMLU, and MMLU-Pro" sitting right next to the cost claim has much less reason to assume the cost claim is spin, because a spin job wouldn't publish its own losses.

The growth play to steal

1. Publish comparison results somewhere inspectable, not just summarized — a page a stranger can click into beats a screenshot in a launch post.

2. Name the specific places you lose, right next to the place you win, instead of hiding it in a footnote or leaving it out entirely.

3. Write your own caveat sentence before a critic writes it for you — it reads as rigor, not weakness.

4. Show the scale behind your headline number (question counts, test sets, sample size) so the ratio has a visible base.

5. Invite people to try to break it. Public failure reports from a skeptical crowd are free QA, and asking for them signals you're not afraid of what they'll find.

Bottom line

Echo's cost claim was believable specifically because it wasn't the only claim on the page. Publishing where you still lose is what makes an audience trust the part where you say you won.

Source: https://echo.tracerml.ai/

How to apply this

  1. 1Publish your comparison results somewhere a stranger can inspect them, not just summarize them in your own copy — Echo's eval page offers 'read-only access' with question-by-question inspection
  2. 2Name the specific benchmarks or use cases where the competitor still wins, in the same breath as your headline win — don't bury the loss in fine print
  3. 3Use a caveat sentence that limits your own claim before anyone else can — Echo's own line, 'these results are evidence, not a universal guarantee,' pre-empts the obvious 'but is this rigorous?' objection
  4. 4Disclose the scale of your evaluation plainly (Echo states '907' questions across '8' benchmarks and '9' test sets) so the claim has a visible denominator, not just a headline ratio
  5. 5Invite the audience to break it — the launch post asks readers to try the product 'especially if you hit any weird failure cases or places where the allocation looks unintuitive,' turning scrutiny into free QA instead of a threat
  6. 6Keep the cost or performance claim specific and attributable to a named comparison system, not a vague 'better than the competition' line

A new Growth Play every morning.

One real distribution trick. No fluff. In your inbox before breakfast.

Subscribe free