Complete AI Training
Sign inGet my AI kit

Your job's AI kit

Get your AI kit

Tell us who you are and what you do. We show you your kit right away and email you the link: skills, prompts, AI agents, MCP servers and courses for your job.

500+ jobs ready, and we make a kit for any other job. No payment needed to look.

Share

AI agent for backend developers

Product Supportability Review Agent

Every feature can be diagnosed by support when it fails.

Product Supportability Review Agent: what goes in, what the agent does and what you get

What it does

New features often ship before anyone checks whether support can tell why they fail. When a customer reports a problem, the logs show the same vague message for very different causes. This agent takes the feature spec and error catalog, lists every way the feature can fail, and triggers each failure on purpose in a sandbox. It then reads the logs and asks one question: can a support person tell these causes apart? If two failures look identical, it writes an instrumentation requirement for engineering and retests once the fix lands. It then drafts diagnostic guidance for support. The release decision and any change to production logging stay with people. Edge case: a timeout and a permission error that both log 'request failed' are treated as one blind spot, not two passes.

How it works

Follow the arrows from top to bottom. The orange dashed arrow is the loop: when a check fails, the agent goes back and tries again.

Start and resultWhat it doesA check on its own workWaits for your OKGoes back and retries
Yes, continueApprovedNo 1 STARTS WHEN Feature nears release 2 USES A TOOL Read the spec and error catalog 3 DOES Map every failure state 4 USES A TOOL Trigger each failure in the sandbox 5 USES A TOOL Read the resulting logs 6 CHECKS THE RESULT Can logs distinguish each cause? If not: create an instrumentation requirement, wait forthe fix and retest. Back to step 4. 7 DOES Draft diagnostic guidance for support 8 YOU APPROVE Support lead approves the guidance before release 9 RESULT Supportability evidence pack
Read the steps as a list
  1. Feature nears release
  2. Read the spec and error catalog
  3. Map every failure state
  4. Trigger each failure in the sandbox
  5. Read the resulting logs
  6. Can logs distinguish each cause?If not: create an instrumentation requirement, wait for the fix and retest. Back to step 4.
  7. Draft diagnostic guidance for support
  8. Support lead approves the guidance before releaseThe agent waits here for your OK.
  9. Supportability evidence pack

How it decides

It requires logs that distinguish causes.

  • Two failure states with identical log output count as a gap, even if each logs something.
  • Probes run only in the sandbox with test accounts, never against production.
  • Guidance is drafted only for causes the logs can actually distinguish.
  • A requirement is closed only after a retest shows the new log output.

Make it yours

Every agent is a starting point. You choose these settings for your own situation.

  • Which failure states count as in scope (default: every state in the error catalog plus spec edge cases)
  • Sandbox environment and test accounts to use
  • Minimum log detail support needs (default: unique error code plus user-facing message)
  • Who receives instrumentation requirements (default: feature engineering lead)
  • Release gate: block release or only warn when gaps remain (default: warn)

What keeps you in control

It always asks you first

  • Release approval
  • Production instrumentation

Hard limits

  • Sandbox only.

It stops when

  • Done: pack complete.

Set it up

We guide you through the set-up, step by step

Members get the full set-up guide for this agent. No technical skills needed: you copy, paste and upload.

10 minto set it up in your AI
5 AIsChatGPT, Claude, Copilot, Gemini, Grok
  • One set of instructions to paste into your AI, with the clicks for ChatGPT, Claude, Microsoft 365 Copilot, Gemini and Grok
  • The agent then walks you through connecting your own data, one source at a time
  • A downloadable copy with the flow chart, the rules and the full guide
Get access to this agent

An example run

What happensBefore the 4.2 release of a file upload feature, the agent maps 9 failure states and triggers each in the sandbox. Two of them, an expired token and a file over 50 MB, both log 'upload failed'. The check fails, so it files a requirement for distinct error codes. Engineering ships the change on Thursday, the agent reruns all 9 probes, every cause is distinct, and the support lead approves the evidence pack.

More agents for backend developers