Compare runs
B is compared with the latest successful run of the previous version.
9 steps · 10.7s · ≈$0.046
11 steps · 12.8s · ≈$0.041
steps 9 → 11 · cost −11% · duration +19% · outcome succeeded
What changed between them
| App version | 3.1.0 | 3.2.0 |
| Agent version | 1.4.0 | 1.5.0 |
| Prompt version | v7 | v8 |
Step by step
= same (7)≠ changed (1)+ only in B (2)− only in A (0)| A · run_c6bf92e0 | B · run_5c85b96f | |
|---|---|---|
| = | #2 claude-sonnet-4-5 | #2 claude-sonnet-4-5 |
| = | #3 sentry.getIssue | #3 sentry.getIssue |
| = | #4 claude-sonnet-4-5 | #4 claude-sonnet-4-5 |
| = | #5 gitlab.searchCode | #5 gitlab.searchCode |
| = | #6 gitlab.readFile | #6 gitlab.readFile |
| = | #7 claude-sonnet-4-5 | #7 claude-sonnet-4-5 |
| ≠ | #8 jira.createIssue | #8 jira.createIssue429 Too Many Requestsoutcome changed |
| + | — | #9 jira.createIssue429 Too Many Requests |
| + | — | #10 jira.createIssue |
| = | #9 slack.postMessage | #11 slack.postMessage |
System spans are left out; steps are aligned on the tool called (or LLM call), then compared on arguments and outcome.