Claude

Engineer Knowledge Copilot

Claude agent·claude-opus-4-8
Connected
T1 · Inline
Full fidelity·The agent's model and tool calls route through Sentry's gateway.

Answers engineer questions from 30 years of incidents, runbooks and change logs – with sources.

Performance by version

Avg latency
3.1s−11%
Tokens / wk
1.24M−10%
Cost / wk
$186−10%
Quality
97%+1%
Success
98.4%+1%

v3 · Semantic routing · Jun 2026Route single-fact lookups to Haiku; reserve Opus for multi-step reasoning (deltas vs v2)

Objectives & ROI

Token cost / wkAhead
−23%goal −15%
Engineer onboardingOn track
6 daysgoal < 5 days
Answer quality (cited)Met
97%goal ≥ 97%
Ticket deflectionOn track
54%goal 60%

Data flow

Dashed tiles are the markdown / JSON context we author around the harness.

Integration logic – MD files

  • MDrelease-verification.md

    Verify a GitHub release built & deployed cleanly, then audit CloudWatch logs for errors

    AWSGitHub
  • MDinfra-drift-detection.md

    Reconcile Terraform / IaC in GitHub against live AWS resources

    AWSGitHub
  • MDdeploy-rollback.md

    Trace a regression to its commit and roll the AWS deployment back

    AWSGitHub
  • MDpr-ticket-compliance.md

    Check each PR links a valid Jira ticket and meets its acceptance criteria

    GitHubJira
  • MDchangelog-sync.md

    Sync merged PRs into Jira ticket status and release notes

    GitHubJira
  • MDincident-triage.md

    Correlate CloudWatch alarms into a single triaged incident summary

    AWS
  • MDpr-review-checklist.md

    Enforce the engineering review checklist on every PR

    GitHub

Harness

Owned IP

The model is rented and swappable. This is the part we own and port: the MCP tools, the markdown / JSON context wrapped around them, and the systems they connect.

ClaudeRuns in its own harnessClaude Agent SDK (Anthropic API)Configured & maintainedSentry-managed project · Anthropic Console orgSentry registers & governs it – it is not rebuilt here.
MCP tools5
  • vector_search

    Retrieve top-k from 30y of incidents & runbooks

  • confluence_lookup

    Fetch runbook / wiki pages by title

  • jira_query

    JQL search over OPS issues

  • github_read

    Read change-log diffs & commits

  • aws_s3_fetch

    Fetch runbooks & docs from the S3 knowledge bucket

Context files3
  • MDcopilot/retrieval.md

    How sources are queried and top-k ranked

  • MDcopilot/answer-policy.md

    Citations required; answer format & length

  • JSONcopilot/sources.json

    Source registry + freshness / TTL rules

Connected systems4
AWSGitHubJiraConfluence

Access & scope

Who accesses it
  • Field engineersvia Chat
  • Onboarding portalvia MCP
Auth
SSO (Okta), per-engineer scope, read-only to source systems
Data scope
Reads incidents, runbooks & change logs – no writes to source systems
Model – rented & swappable
claude-opus-4-8liveclaude-haiku-4-5gpt-4oopen-weight

Swap freely – the harness above doesn't change.