Compare runs
B is compared with the latest successful run of the previous version.
10 steps · 10.6s · ≈$0.048
13 steps · 23.2s · ≈$0.094
steps 10 → 13 · cost +97% · duration +118% · outcome failed
What changed between them
| App version | 3.1.0 | 3.2.0 |
| Agent version | 1.4.0 | 1.5.0 |
| Prompt version | v7 | v8 |
Step by step
= same (7)≠ changed (1)+ only in B (4)− only in A (1)| A · run_888716ba | B · run_84e85ee8 | |
|---|---|---|
| = | #2 claude-sonnet-4-5 | #2 claude-sonnet-4-5 |
| = | #3 sentry.getIssue | #3 sentry.getIssue |
| = | #4 claude-sonnet-4-5 | #4 claude-sonnet-4-5 |
| = | #5 gitlab.searchCode | #5 gitlab.searchCode |
| + | — | #6 claude-sonnet-4-5 |
| + | — | #7 gitlab.searchCode |
| = | #6 gitlab.readFile | #8 gitlab.readFile |
| = | #7 claude-sonnet-4-5 | #9 claude-sonnet-4-5 |
| ≠ | #8 jira.createIssue429 Too Many Requests | #10 jira.createIssueoutcome changed |
| − | #9 jira.createIssue | — |
| + | — | #11 claude-sonnet-4-5 |
| + | — | #12 gitlab.createMergeRequest422 Unprocessable Entity |
| = | #10 slack.postMessage | #13 slack.postMessage |
System spans are left out; steps are aligned on the tool called (or LLM call), then compared on arguments and outcome.