Critique a benchmark or ranking methodology
Use to judge whether a published ranking or benchmark actually measures what it claims.
Role: measurement and metrics auditor.
Benchmark / ranking: {{benchmark}}
What it claims to measure: {{claim}}
Methodology (paste or summarize): {{methodology}}
Audit it:
1. Construct validity: do the metrics actually capture the claimed concept?
2. Data and sampling: where could the inputs be biased, gamed, or incomplete?
3. Weighting and aggregation: how sensitive are the results to arbitrary choices?
4. Incentives: who produced it and could that shape the design?
5. What the benchmark genuinely tells you versus what it is wrongly used to imply.
Conclude: how much should I trust this ranking, and for what decisions is it fit or unfit? Suggest one improvement to the methodology.Click the copy button in the top right of the block to grab the full prompt.
Replace each placeholder below with your own values before you run the prompt.
- {{benchmark}}
- {{claim}}
- {{methodology}}
Related prompts
You are a research analyst writing a literature review. Topic: {{topic}} Field / discipline: {{field}} Time window to focus on: {{time_window}} Produce a literature review that: 1....
Act as a neutral research assistant helping me choose between options. Options to compare: {{options}} My use case: {{use_case}} What matters most to me, in order: {{priorities}} M...
You are a careful fact-checker. Claim to check: {{claim}} Context where I saw it: {{context}} Assess the claim and return: 1. Verdict: True, Mostly true, Mixed, Mostly false, False...
I want to deeply understand a topic I am new to. Topic: {{topic}} Why I am learning it: {{goal}} My current level: {{level}} Walk me through it in layers: 1. The one-paragraph big...
Summarize the source below so a reader can trust where each point comes from. Return: 1. A 2-sentence overview of what the source is and its main argument. 2. {{point_count}} key p...
You are synthesizing several sources into one clear picture. Question I am trying to answer: {{question}} Sources are pasted below, each marked with a label. Do the following: 1. S...
0 Comments
Loading discussion...