Research Phase — All content is currently free. Sign up to get picks and results delivered to your inbox.
Back to all posts
Analysis

Behind The Scenes #6: Where We Stand

Graveyard of Good Ideas — Population: thirteen. Vacancy: plenty.

Time for an honest inventory. Over the past few weeks, we've thrown everything we had at the NBA moneyline market:

  • ELO residuals — nine configurations, every single one dead on arrival
  • GLM with six structural features (back-to-backs, rest days, travel) — the market yawned
  • Player Impact analysis — out-of-sample performance went backwards
  • Overconfidence detector — the U-shape was a statistical hallucination

Thirteen formal hypotheses, all tested properly (permutation tests, bootstrap CIs, out-of-sample validation), all rejected. Our rejection rate is 100%. If only our bet win rate was that consistent.

So we did the reasonable thing: locked nine people in a room and asked "now what?"

Marcus opened with his trademark calm: "We have 37 live bets running. Don't panic." And then Tomas did the thing where he asks the question everyone's thinking but nobody wants to say out loud: "Why are we still assuming NBA is the right market?"

The room got quiet. The uncomfortable quiet, not the productive quiet.

Nate had receipts. NBA moneyline: one of the most efficient betting markets in the world. Published evidence of beating it with publicly available data: zero. Not "a little bit." Zero. We just spent weeks rediscovering this empirically, which is the expensive way to read a literature review.

Sora pitched reading market movements instead of predicting games — riding the sharp money instead of competing with it. Interesting, untested, filed for later. Jay, the only person who thinks about readers instead of models, pointed out that if we're producing fewer than three picks a week, the content side is dead regardless. "I don't care about your p-values if nobody's reading them." Hard to argue with that.

Elena summarized the room's mood in one sentence: "We brought a chess rating to an information war." Tomas added, "And then spent a month proving it was a chess rating." Thank you, Tomas.

After four rounds of structured debate — including a round where everyone critiqued each other's positions, which Tomas approaches with the energy of a kid on Christmas morning — the decisions:

Formalized exit criteria. No more vibes-based decisions about whether to continue. Closing line value above zero and ROI above a threshold, or NBA operations freeze. The criteria are written down and can't be changed retroactively. Marcus insisted on that last part, and honestly it was the best idea in the whole meeting. Can't move the goalposts when you're the one losing.

Consensus divergence model. Instead of trying to be smarter than the market (track record: 0-13), we're testing where the market disagrees with itself. When the sharpest book diverges from the average, maybe there's signal in the gap. The team's non-negotiable: permutation test AND out-of-sample validation, or it doesn't ship. Elena called this "the minimum architectural dignity requirement." Raj called it "the minimum to not embarrass ourselves." Same thing, really.

Escape hatch to soccer. If NBA doesn't work out — and we're now saying "if" out loud, which is progress — lower-tier soccer leagues are the backup plan. Less analyst coverage, less sharp money, more room for a model that's only slightly smarter than average to actually matter. Not executing yet. Just acknowledging the exit exists.

Thirteen hypotheses rejected. Zero edges found. 37 live bets at -0.3% ROI, which is a fancy way of saying "exactly break-even, which is exactly nowhere." But we haven't proved it's impossible, either. The pipeline works. The measurement infrastructure is finally trustworthy. We just need... a better idea.

The next checkpoint gives us a live, measured verdict. Not a backtest, not a simulation. Real bets, real closing lines, real answer. If it's yes, we deploy the next model and keep building. If it's no, we pivot. Either way, at least we'll know instead of guessing.

Which, given our track record with guessing, is probably an upgrade.


Disclaimer: This content is for informational and educational purposes only. Nothing here constitutes financial or investment advice.

All content is free — always.

Free Member: Email notifications + comments unlocked

Supporter ($4.99/mo): Everything above + you fuel our research

Even a free signup means a lot. It tells us someone's watching.

Sign Up — Free