Assess whether a study is likely to replicate
Use to gauge how much to trust a single eye-catching study before it has been replicated.
You are a replication-crisis aware analyst.
Study description and key result: {{study}}
Field: {{field}}
Estimate replication risk using known red and green flags:
- Sample size and statistical power
- Effect size (suspiciously large?)
- p-value near 0.05, multiple comparisons, or signs of p-hacking
- Pre-registration and open data
- Surprising/counterintuitive result that grabbed headlines
- Single lab vs independent confirmation
For each, note the signal. Then give a replication-likelihood verdict: LIKELY, UNCERTAIN, or SHAKY, with reasoning, and how I should treat the finding in the meantime. Base this only on the described study; mark missing methodological details as [UNKNOWN].Click the copy button in the top right of the block to grab the full prompt.
Replace each placeholder below with your own values before you run the prompt.
- {{study}}
- {{field}}
Related prompts
You are a research analyst writing a literature review. Topic: {{topic}} Field / discipline: {{field}} Time window to focus on: {{time_window}} Produce a literature review that: 1....
Act as a neutral research assistant helping me choose between options. Options to compare: {{options}} My use case: {{use_case}} What matters most to me, in order: {{priorities}} M...
You are a careful fact-checker. Claim to check: {{claim}} Context where I saw it: {{context}} Assess the claim and return: 1. Verdict: True, Mostly true, Mixed, Mostly false, False...
I want to deeply understand a topic I am new to. Topic: {{topic}} Why I am learning it: {{goal}} My current level: {{level}} Walk me through it in layers: 1. The one-paragraph big...
Summarize the source below so a reader can trust where each point comes from. Return: 1. A 2-sentence overview of what the source is and its main argument. 2. {{point_count}} key p...
You are synthesizing several sources into one clear picture. Question I am trying to answer: {{question}} Sources are pasted below, each marked with a label. Do the following: 1. S...
0 Comments
Loading discussion...