Compare runs
B is compared with the latest successful run of the previous version.
11 steps · 13.4s · ≈$0.048
11 steps · 15.2s · ≈$0.0085
steps 11 → 11 · cost −82% · duration +14% · outcome succeeded
What changed between them
| Agent version | 1.4.0 | 1.5.0 |
| Prompt version | v7 | v8 |
| Model | claude-sonnet-4-5 | gpt-4.1-mini |
Step by step
= same (3)≠ changed (5)+ only in B (2)− only in A (2)| A · run_8b4a65d4 | B · run_b720efc4 | |
|---|---|---|
| ≠ | #2 claude-sonnet-4-5 | #2 gpt-4.1-minimodel changed |
| ≠ | #3 sentry.getIssue | #3 sentry.getIssueargs changed |
| ≠ | #4 claude-sonnet-4-5 | #4 gpt-4.1-minimodel changed |
| = | #5 gitlab.searchCode | #5 gitlab.searchCode |
| + | — | #6 gpt-4.1-mini |
| + | — | #7 gitlab.searchCode |
| = | #6 gitlab.readFile | #8 gitlab.readFile |
| ≠ | #7 claude-sonnet-4-5 | #9 gpt-4.1-minimodel changed |
| ≠ | #8 jira.createIssue429 Too Many Requests | #10 jira.createIssueargs, outcome changed |
| − | #9 jira.createIssue429 Too Many Requests | — |
| − | #10 jira.createIssue | — |
| = | #11 slack.postMessage | #11 slack.postMessage |
System spans are left out; steps are aligned on the tool called (or LLM call), then compared on arguments and outcome.