Creează un cont pentru a te abona la acest blog și a-i urmări articolele pe pagina Lectură.
-
Opus 4.8 and Opus 5 tied on strict functional score across 25 matched Stet tasks, but their paired artifacts differed: Opus 4.8 had the lower footprint on 20 tasks, while Opus 5 ran more shell commands on 18 and more tests on 15.
-
Six interventions meant to save tokens gave different answers depending on how you count.
-
On 24 real tasks, Sonnet scaled effort into more checking while Opus stayed flatter through high.
-
GLM 5.2 vs Composer 2.5 and the premium field on 50 real merged PRs from graphql-go-tools (Go) and sqlparser-rs (Rust).
-
Composer 2.5 vs Opus 4.8, GPT-5.5 and Opus 4.7 on 50 real merged PRs from sqlparser-rs (Rust) and graphql-go-tools (Go).
-
Fable 5 vs Opus 4.8, GPT-5.5 and two more on 30 real GraphQL Go Tools and SQLParser Rust tasks.
-
I graded four frontier coding models on 50 real merged PRs in Go and Rust - not just whether tests pass, but craft, equivalence, and cost.
-
Codex optimized its own AGENTS.md against real Stet repo tasks.
-
A fresh GPT-5.5 Codex high rerun on 21 clean GraphQL-go-tools tasks compared with the May 5 GPT-5.5 high run.
-
Claude Opus 4.7 reasoning-effort curve on 29 matched GraphQL-go-tools tasks: low, medium, high, xhigh, and max.
-
An interactive GPT-5.5 Codex reasoning-effort curve on 26 matched GraphQL-go-tools tasks: low, medium, high, and xhigh.
-
Opus 4.7 vs GPT-5.5 vs GPT-5.4 on 56 real coding tasks across two open-source repos.
-
Three Opus snapshots, same 12/28 test pass rate.
-
AGENTS.md is loaded into every turn.
-
Three models, same pass rate.