All notes

AI

Jul 11, 2026

GPT-5.6, Grok 4.5, Claude, and Muse Spark Build the Same Four Apps

A head-to-head evaluation pits 12 models against identical build tasks, surfacing real capability gaps across code generation, coherence, and product completion.

The team ran 12 models through the same four app-building prompts — a controlled format that strips away benchmark theater and forces models to ship working product.

The format matters. Asking models to build complete applications, rather than solve isolated coding puzzles, exposes failure modes that unit-task evals miss: context retention across files, self-correction when a generated dependency breaks, and the ability to produce something a user can actually run.

GPT-5.6 and Grok 4.5 are both recent releases operating at the frontier. Their inclusion alongside Claude and Muse Spark sets up a cross-lab comparison that isn't filtered through lab-published benchmarks. Muse Spark is the outlier worth watching — it sits outside the OpenAI, Anthropic, and xAI ecosystems, which means the evaluation gives a read on whether smaller or newer entrants can compete on practical build tasks, not just token prediction.

For engineers deciding which model to wire into an agentic coding pipeline, this kind of evaluation carries more signal than MMLU scores or HumanEval pass rates. Building four distinct apps forces variation in domain, UI complexity, and state management — conditions closer to a real sprint than a coding interview.

A few things to track when reading the results: whether models that score well on one app type degrade on others, how each model handles ambiguity in the prompt without asking for clarification, and whether output requires significant post-generation editing before it runs.

The broader takeaway is structural. As model count increases and release cadence compresses, practical build-off evaluations become a necessary calibration tool. Choosing the wrong model for a production coding workflow has real cost. Head-to-head comparisons on identical tasks, run by teams outside the labs, are currently the most reliable signal available.