Complete AI Training
Sign inGet my AI kit

Your job's AI kit

Get your AI kit

Tell us who you are and what you do. We show you your kit right away and email you the link: skills, prompts, AI agents, MCP servers and courses for your job.

500+ jobs ready, and we make a kit for any other job. No payment needed to look.

Share

AI agent for ux writers

Copy Experiment Readout Agent

Copy decisions based on reliable test results

DecisionsWritersCreatives
See how it worksGet access
Copy Experiment Readout Agent: what goes in, what the agent does and what you get

What it does

Testing two versions of a headline or button label is easy to start and easy to misread. When a copy test starts, this agent records the hypothesis, the success metric and the minimum sample. It pulls results every day. Before calling a result, it checks that the sample is reached and that the difference is statistically reliable. If not, it keeps the test running and checks again the next day. It then checks guard metrics, such as support contacts or cancellations, so a 'winner' does not hurt something else. If a test cannot reach its sample in the maximum time, it says so instead of declaring a winner. It writes a readout with a clear recommendation. The UX writer approves any rollout. Edge case: on low-traffic pages, it stops a test that cannot reach a result in time.

How it works

Follow the arrows from top to bottom. The orange dashed arrow is the loop: when a check fails, the agent goes back and tries again.

Start and resultWhat it doesA check on its own workWaits for your OKGoes back and retries
Yes, continueApprovedNo 1 STARTS WHEN Copy test starts 2 DOES Record hypothesis, metric and minimum sample 3 USES A TOOL Pull daily results 4 CHECKS THE RESULT Is the sample reached and the result reliable? If not: keep the test running and check again tomorrow.Back to step 3. 5 USES A TOOL Check guard metrics for harm 6 DOES Write readout and recommendation 7 YOU APPROVE UX writer approves rollout 8 RESULT Winning copy rolled out and logged
Read the steps as a list
  1. Copy test starts
  2. Record hypothesis, metric and minimum sample
  3. Pull daily results
  4. Is the sample reached and the result reliable?If not: keep the test running and check again tomorrow. Back to step 3.
  5. Check guard metrics for harm
  6. Write readout and recommendation
  7. UX writer approves rolloutThe agent waits here for your OK.
  8. Winning copy rolled out and logged

How it decides

It calls a winner only after the minimum sample is reached and the difference is reliable at the set confidence, with no guard metric harmed.

  • Do not call results before the minimum sample
  • Reject a winner that harms a guard metric
  • Stop a test that cannot reach the sample in the max time

Make it yours

Every agent is a starting point. You choose these settings for your own situation.

  • Confidence level (default 95%)
  • Max test length (default 21 days)
  • Guard metrics
  • Readout format

What keeps you in control

It always asks you first

  • Rolling out the winning copy
  • Stopping a test early

Hard limits

  • Never changes live copy without approval
  • Reports inconclusive results honestly

It stops when

  • Done: readout approved
  • Stop: test hits max duration without result; report as inconclusive

Set it up

We guide you through the set-up, step by step

Members get the full set-up guide for this agent. No technical skills needed: you copy, paste and upload.

10 minto set it up in your AI
5 AIsChatGPT, Claude, Copilot, Gemini, Grok
  • One set of instructions to paste into your AI, with the clicks for ChatGPT, Claude, Microsoft 365 Copilot, Gemini and Grok
  • The agent then walks you through connecting your own data, one source at a time
  • A downloadable copy with the flow chart, the rules and the full guide
Get access to this agent

An example run

What happensFrom March 4, 'Start free trial' ran against 'Try it free' on the pricing page. On day 5 the sample check failed with 3,100 of 5,000 visitors, so the agent kept it running. On day 9 the second version showed a reliable 6% lift in sign-ups. The guard check showed no rise in cancellations. The UX writer approved rolling out 'Try it free'.

More agents for ux writers

Quality control · IT and development

Localization Resource Integrity Agent

Every localized string keeps its placeholders and renders correctly.

8 steps2 checks4 jobs
Quality control · PR and communications

Communications Localization Coordination Agent

Every language version means exactly what the master says.

9 steps2 checks2 jobs
Compliance · Creatives

Copy Approval Chain Tracker Agent

One locked copy version with a complete record of who approved it

9 steps2 checks7 jobs
Quality control · Automation

Web Content Translation Sync Agent

Keep every translated page in sync with its source, with verified text and rendering.

10 steps2 checks7 jobs