ChatbotsPrompt A/B test

Generate A/B variants of a system prompt to test

Use when you want to compare different prompt approaches against a clear metric.

The prompt
prompt.txt
You are a prompt optimization specialist. Generate A/B test variants of a system prompt.

Baseline system prompt: {{baseline_prompt}}
Metric you want to improve: {{target_metric}}
Constraint you must not break: {{hard_constraint}}

Produce:
1. 3 distinct variants, each changing ONE lever (tone, structure, instruction order, examples) to influence {{target_metric}}.
2. A hypothesis for each variant explaining why it might move the metric.
3. The same 5 test inputs to run through all variants.
4. A scoring rubric tied directly to {{target_metric}}.
5. A note on sample size and how to call a winner.

Constraint: every variant must still respect {{hard_constraint}}; isolate one change per variant for clean results.

Click the copy button in the top right of the block to grab the full prompt.

Variables

Replace each placeholder below with your own values before you run the prompt.

  • {{baseline_prompt}}
  • {{target_metric}}
  • {{hard_constraint}}
Recommended models
Claude Opus 4.8GPT-5Gemini 2.5 Pro
Tags
#optimization#ab-testing#experiments#prompt-engineering

Related prompts

ChatbotsSupport system prompt
Customer support assistant system prompt

You are the system prompt author. Write a production-ready system prompt for a customer support assistant. Company: {{company_name}} Product or service: {{product}} Customer audien...

Claude Opus 4.8GPT-5Gemini 2.5 Pro
#support#system-prompt#persona#guardrails
View
ChatbotsSales qualifier flow
Lead qualification sales bot flow

Design a conversation flow for a sales qualification chatbot. Offer: {{offer}} Ideal customer: {{ideal_customer}} Qualifying criteria: {{criteria}} Handoff destination: {{handoff}}...

Claude Opus 4.8GPT-5Gemini 2.5 Pro
#sales#flow#qualification#lead-gen
View
ChatbotsFAQ bot persona
Turn help docs into an FAQ bot persona

You are configuring an FAQ assistant that must answer only from supplied documentation. Source material: {{documentation}} Write a system prompt that instructs the assistant to: -...

Claude Opus 4.8GPT-5Gemini 2.5 Pro
#faq#system-prompt#grounding#support
View
ChatbotsPersona builder
Build a named assistant persona with backstory

Create a complete persona definition for a chatbot. Assistant name: {{assistant_name}} Purpose: {{purpose}} Personality traits: {{traits}} Audience: {{audience}} Deliver: 1. A one-...

Claude Opus 4.8GPT-5Gemini 2.5 Pro
#persona#character#voice#system-prompt
View
ChatbotsRefund handler
Refund request handling script

Write a conversation script for a support bot that handles refund requests. Refund policy: {{refund_policy}} Required details: {{required_details}} Tone: {{tone}} The script must:...

Claude Opus 4.8GPT-5Gemini 2.5 Pro
#support#flow#refund#guardrails
View
ChatbotsOnboarding flow
New user onboarding walkthrough bot

Design an onboarding conversation flow for a chatbot guiding new users. Product: {{product}} Key first actions a user should take: {{first_actions}} Aha moment to reach: {{aha_mome...

Claude Opus 4.8GPT-5Gemini 2.5 Pro
#onboarding#flow#activation#ux
View

0 Comments

Sign in to post

Loading discussion...