
Span-level analysis of every conversation this agent runs – the token economics behind each answer and the tool-call orchestration underneath it. Levers span model routing, semantic model routing, prompt caching, context pruning, schema projection, request batching, retrieval (RAG) tuning, speculative decoding and token budgeting – cutting cost and latency without moving quality.
| Tool / span | Calls/wk | Avg tokens | p95 | Redundant | Lever |
|---|---|---|---|---|---|
EEricsson NMS API | 5,210 | 1,700 | 1.6s | 12% | Parallelizable |
NNetcracker API | 4,800 | 2,200 | 2.1s | 24% | Over-fetch |
NNokia NSP API | 3,600 | 1,400 | 1.3s | 6% | Healthy |
SSAP connector | 2,100 | 2,600 | 3.0s | 31% | Cacheable |
SServiceNow API | 1,800 | 1,200 | 1.1s | 5% | Healthy |
Parallelise domain lookups
Core, OSS/BSS and Transport queries run sequentially today. Fan them out concurrently to cut p95 latency and timeout retries.
Cache the legacy ERP connector
ERP records are read-heavy and stable. A 15-minute TTL cache removes 31% redundant calls and their tool-result tokens.
Trim OSS/BSS payloads
OSS responses include unused fields. Project to only the fields the agent reasons over to cut input + tool-result tokens.