charles/claude-hooks
1
0
Fork 0
Code Issues 10 Pull requests Projects Releases Packages 1 Wiki Activity Actions

agents: live token meter — accumulate per-task usage across both providers #952

New issue
Closed
opened 2026-05-08 12:04:54 +00:00 by claude-desktop · 2 comments
claude-desktop commented 2026-05-08 12:04:54 +00:00
Collaborator
Copy link

User story

As an operator running expensive agents under a hard monthly budget cap (€200 extra-usage), I want a live per-task token meter that ticks up as the agent works, regardless of provider, so I can interrupt runaway tasks before they burn the budget.

Context

Today every observability tile reads zero for cursor runs because cursor-sdk-adapter.ts hardcodes usage: emptyUsage() and totalCostUsd: 0. Claude Code surfaces token counts only on the terminal result event (no live ticker). The user has explicitly stripped [1m] everywhere because of past budget overrun (per global memory feedback_one_m_context.md) — token visibility is load-bearing for cost control, not just UI polish.

This issue assumes the foundation issue (cursor InteractionUpdate deltas — usage_delta event added to the port) has landed, or implements the minimum amount of that scaffolding needed for the meter to work.

Acceptance criteria

Port

  • UsageDeltaEvent { type: "usage_delta", sessionId, deltaInput, deltaOutput, deltaCacheRead?, deltaCacheCreation? }. Emitted incrementally as the agent runs.

Cursor adapter

  • Subscribe to TokenDeltaUpdate via the interaction listener. Translate to UsageDeltaEvent.

Claude adapter

  • Synthesize UsageDeltaEvent per assistant turn from assistant.message.usage (post-turn deltas; not as fine-grained as cursor but still live).

Runner / event log

  • Maintain a per-task running total in the TaskRecord (record.usage = { input, output, cache_read, cache_creation }); update on each usage_delta.
  • Broadcast a coalesced usage_delta SSE envelope at most every 250 ms per task to avoid spamming the wire on rapid streams.
  • Persist final usage into task_history (already wired for result.totalUsage); this issue keeps that invariant — the meter is a display of in-progress state, the row is still authoritative.

Frontend

  • New small <TokenMeter task={...} /> component. Renders inline tokens-in / tokens-out, optionally cache-read / cache-creation. Updates live via SSE.
  • Mount it in: task drawer (planner board side panel), monitor row, agent timeline header. Compact form on cards, full form in detail.
  • Color scheme: at <50% of soft budget = neutral, 50–90% = warn, >90% = error. Soft budget configurable in settings.

Tests

  • Adapter tests for both providers asserting UsageDeltaEvent cadence + correctness.
  • Runner test asserting accumulation across deltas matches the terminal result.totalUsage.
  • Frontend snapshot for the meter component at idle / mid / over-budget states.

Out of scope

  • Cost computation in USD/EUR — that's the cost-rate-table issue. This issue ships token counts only.
  • Budget enforcement (auto-cancel above threshold) — separate ops issue.

References

  • Parent: #950
  • Foundation: cursor InteractionUpdate delta issue
  • Cursor token type: delta-types.d.ts TokenDeltaUpdate
  • Memory: feedback_one_m_context.md
## User story As an operator running expensive agents under a hard monthly budget cap (€200 extra-usage), I want a live per-task token meter that ticks up as the agent works, regardless of provider, so I can interrupt runaway tasks before they burn the budget. ## Context Today every observability tile reads zero for cursor runs because `cursor-sdk-adapter.ts` hardcodes `usage: emptyUsage()` and `totalCostUsd: 0`. Claude Code surfaces token counts only on the terminal `result` event (no live ticker). The user has explicitly stripped `[1m]` everywhere because of past budget overrun (per global memory `feedback_one_m_context.md`) — token visibility is load-bearing for cost control, not just UI polish. This issue assumes the foundation issue (cursor `InteractionUpdate` deltas — `usage_delta` event added to the port) has landed, or implements the minimum amount of that scaffolding needed for the meter to work. ## Acceptance criteria ### Port - [ ] `UsageDeltaEvent { type: "usage_delta", sessionId, deltaInput, deltaOutput, deltaCacheRead?, deltaCacheCreation? }`. Emitted incrementally as the agent runs. ### Cursor adapter - [ ] Subscribe to `TokenDeltaUpdate` via the interaction listener. Translate to `UsageDeltaEvent`. ### Claude adapter - [ ] Synthesize `UsageDeltaEvent` per assistant turn from `assistant.message.usage` (post-turn deltas; not as fine-grained as cursor but still live). ### Runner / event log - [ ] Maintain a per-task running total in the `TaskRecord` (`record.usage = { input, output, cache_read, cache_creation }`); update on each `usage_delta`. - [ ] Broadcast a coalesced `usage_delta` SSE envelope at most every 250 ms per task to avoid spamming the wire on rapid streams. - [ ] Persist final usage into `task_history` (already wired for `result.totalUsage`); this issue keeps that invariant — the meter is a *display* of in-progress state, the row is still authoritative. ### Frontend - [ ] New small `<TokenMeter task={...} />` component. Renders inline tokens-in / tokens-out, optionally cache-read / cache-creation. Updates live via SSE. - [ ] Mount it in: task drawer (planner board side panel), monitor row, agent timeline header. Compact form on cards, full form in detail. - [ ] Color scheme: at <50% of soft budget = neutral, 50–90% = warn, >90% = error. Soft budget configurable in settings. ### Tests - [ ] Adapter tests for both providers asserting `UsageDeltaEvent` cadence + correctness. - [ ] Runner test asserting accumulation across deltas matches the terminal `result.totalUsage`. - [ ] Frontend snapshot for the meter component at idle / mid / over-budget states. ## Out of scope - Cost computation in USD/EUR — that's the cost-rate-table issue. This issue ships token counts only. - Budget enforcement (auto-cancel above threshold) — separate ops issue. ## References - Parent: #950 - Foundation: cursor `InteractionUpdate` delta issue - Cursor token type: `delta-types.d.ts` `TokenDeltaUpdate` - Memory: `feedback_one_m_context.md`
architect commented 2026-05-08 15:11:36 +00:00
Collaborator
Copy link

🤖 Auto-assigned to code-lead (heuristic: area:agents → code-lead (architecture-touching)). Reply /unassign to reroute.

🤖 Auto-assigned to **code-lead** (heuristic: area:agents → code-lead (architecture-touching)). Reply `/unassign` to reroute.
architect commented 2026-05-08 16:16:14 +00:00
Collaborator
Copy link

🧹 janitor: this ticket has been idle-assigned since 2026-05-08T15:36:16.000Z. Re-dispatching.

🧹 janitor: this ticket has been idle-assigned since 2026-05-08T15:36:16.000Z. Re-dispatching.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
chore/sync-pre-push-from-forge-base
fix/flows-yaml-dispatch-identity
feat/board-tap-to-assign
dev/1107
code-lead/1106
code-lead/1108
dev/1104
code-lead/1103
code-lead/1080
dev/1087
feat/flows-yaml-ci-events
chore/board-drop-stalled-and-density-controls
fix/flows-yaml-routes-always-register
flows-yaml/api-defaults
dev/1023
fix/event-log-history-bleed
fix/janitor-fix-ci-logs-and-cap
dev/1022
fix/board-card-provider
code-lead/1036
dev/1025
code-lead/1020
dev/1017
code-lead/1026
feat/web-shortcut-registry-1018
dev/1015
code-lead/1009
code-lead/1008
dev/975
dev/969
dev/973
dev/967
code-lead/968
code-lead/953
dev/970
dev/976
code-lead/966
code-lead/956
code-lead/951
dev/962
dev/963
dev/977
dev/955
dev/983
dev/961
dev/974
code-lead/950
code-lead/939
dev/941
dev/940
dev/937
dev/938
dev/936
dev/935
feat/web-i18n-fr-locale
feat/spec-editor-ui-polish
chore/drop-legacy-compat
fix/skills-drop-preview-pane
fix/882-skills-safety-rail
dev/911
dev/909
dev/923
dev/917
dev/915
feat/879-sr11-m2-drop-legacy-skill
code-lead/873
dev/881
code-lead/869
dev/867
code-lead/845
code-lead/843
code-lead/844
dev/837
dev/861
dev/849
code-lead/837
code-lead/842
fix/dedup-rebase-inflight
dev/838
code-lead/847
dev/833
code-lead/848
pr/838
code-lead/841
feat/settings-save-bar/836
code-lead/840
dev/846
code-lead/839
dev/832
fix/board-sse-stale-cache
dev/834
dev/835
feat/settings-breadcrumbs
feat/forge-oauth-credentials
refactor/service-config-consolidation
feat/agent-tokens-to-secrets
feat/gitlab-oauth-to-db
feat/authelia-rip-and-voice-fixes
fix/rebase-storm-and-dead-letter
code-lead/797
code-lead/796
dev/811
code-lead/798
dev/810
code-lead/795
dev/808
code-lead/794
dev/805
dev/802
dev/803
feat/avatar-menu-settings-entry
feat/per-agent-token-tracking
dev/793
dev/747
dev/752
code-lead/790
code-lead/759
dev/756
dev/760
dev/741
dev/767
dev/740
dev/709
dev/644
dev/637
boss/614
dev/600
dev/611
dev/585
fix/login-bonus-fixes
boss/544
dev/542
refactor/api-prefix-and-session-gate
dev/489
boss/531
boss/518
dev/499
boss/516
dev/530
dev/517
dev/519
dev/515
dev/522
dev/503
dev/471
boss/329
dev/417
dev/418
dev/402
boss/327
dev/334
dev/332
boss/326
boss/325
dev/331
boss/324
boss/323
boss/322
dev/294
test/s11-task-analytics
dev/262
boss/270
dev/268
foreman/ui-consolidation-spec
dev/234
boss/196
boss/176
boss/164
fix/124-session-persist-bind
boss/52
dev/87
boss/73
dev/77
dev/81
dev/82
boss/79
dev/42
dev/35
boss/7
No results found.
Labels
Clear labels   
area:agents
Agent types, pool scheduling, per-instance config

  
area:dashboard
Dashboard UI and observability surfaces

  
area:database
DB layer — schema, migrations, ORM, raw SQL

  
area:design
UI/UX mockup work — routes to designer agent

  
area:design-review
Design review dispatch — routes to design-reviewer agent

  
area:flows
Flow runner — YAML loader, executor, op registry, expression eval

  
area:infra
Deployment, isolation, containers, systemd units

  
area:meta
Tracking, scaffolding, project setup

  
area:security
Security — routes to reviewer-security (opus)

  
area:sessions
Session-id store, Claude SDK resume logic

  
area:webhook
Forgejo webhook routing and handlers

  
area:workdir
Clone cache, worktrees, git identity

  
security
Security-sensitive issue

  
type:bug
Bug

  
type:chore
Chore

  
type:meta
Tracking or decisions, not implementation work

  
type:user-story
User story

No labels
area:agents
area:dashboard
area:database
area:design
area:design-review
area:flows
area:infra
area:meta
area:security
area:sessions
area:webhook
area:workdir
security
type:bug
type:chore
type:meta
type:user-story
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
dev
2 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Blocks
#953 agents: per-model rate table + runner cost computation (cursor parity with claude-code)
charles/claude-hooks
#967 dashboard: two-meter run header — live context-window % + cumulative $ cost
charles/claude-hooks
#969 dashboard: per-tool token attribution chart in run header tooltip
charles/claude-hooks
Depends on
#951 agents: stream cursor InteractionUpdate deltas (text, thinking, tool, shell, token, summary)
charles/claude-hooks
Reference
charles/claude-hooks#952
No description provided.