Overview
Agents
1 agent regressed
sentry-triage1.5.010 min ago
Regressed
Runs · 24 h
40
Failed
10.0%
p50 duration
15.0s
Mean cost
$0.052
14 daysrunscost
+10.0 ptsFailed runs2.5% → 12.5% · 1.5.0 vs 1.4.0
+58%Mean cost$0.035 → $0.056 · 1.5.0 vs 1.4.0
+0.76Repeated tool calls0 → 0.76 · 1.5.0 vs 1.4.0
+58.8 ptsRuns on a new tool path0.0% → 58.8% · 1.5.0 vs 1.4.0
+4 more
support-botv2.1.010 min ago
Healthy
Runs · 24 h
26
Failed
7.7%
p50 duration
2.76s
Mean cost
$0.0007
14 daysrunscost
Eval suites
| Agent | Latest vs previous | Result | Scenarios | Last run |
|---|---|---|---|---|
| sentry-triage | 1.5.0 vs 1.4.0 | fail6 scenarios worse | 12 | 2 d ago |
Recent alerts
| When | Agent | Metric | Before | After | Compared |
|---|---|---|---|---|---|
| just now | sentry-triage | warning Mean duration | 12.0s | 15.2s | last 24 h vs previous 7 days |
| just now | sentry-triage | warning Mean cost | $0.038 | $0.052 | last 24 h vs previous 7 days |
| just now | sentry-triage | warning Tokens per run | 11.9k | 15.1k | last 24 h vs previous 7 days |
| just now | sentry-triage | critical Repeated tool calls | 0.12 | 0.70 | last 24 h vs previous 7 days |
| just now | sentry-triage | critical Score · correct | 0.91 | 0.65 | last 24 h vs previous 7 days |
| just now | sentry-triage | critical Failed runs | 2.5% | 12.5% | 1.5.0 vs 1.4.0 |
| just now | sentry-triage | warning Mean duration | 11.4s | 15.5s | 1.5.0 vs 1.4.0 |
| just now | sentry-triage | critical Mean cost | $0.035 | $0.056 | 1.5.0 vs 1.4.0 |