Welcome! You are reviewing a pre-analysis or preregistration plan. Please focus on clarity, completeness, and pre-specification. Base your responses only on the materials provided today.
Which materials did you review for this assessment? Select all that apply.
- Research question brief
- Full PAP/preregistration draft
- Hypotheses section
- Outcome definitions
- Analysis plan
- Power analysis
- Data dictionary / variable list
- Inclusion/exclusion rules
- Mock tables/figures
- Other
What best describes the planned study design?
In your own words, summarize the research question in one or two sentences.
Max 600 chars
Rate the clarity and labeling of hypotheses.
Note any hypotheses that seemed ambiguous, double-barreled, or underspecified.
Max 600 chars
How well do the planned tests align with the stated hypotheses?
Assess specification of outcomes and measures.
Which types of outcomes are planned? Select all that apply.
- Behavioral / administrative
- Survey scale or index
- Physiological / biomarker
- Derived composite/index
- Binary event
- Time-to-event
- Other
Assess clarity of the planned analyses.
Is the estimand explicitly defined?
- Yes, clearly defined (e.g., ATE/ITT/CACE)
- Partially defined
- Not defined
- Not applicable
Is a power analysis or sample size justification included?
- Yes, with calculations and inputs
- Yes, but minimal detail
- No
- Not applicable
Given the planned tests, how adequate is statistical power?
If applicable, note the MDE, key inputs, or any concerns about the power justification.
Max 100 chars
Rank potential threats to interpretability for this study (most to least concerning).
Any ethical considerations that influence analysis choices?
- None noted
- Privacy or data security risk
- Potential harm to participants
- Equity/fairness bias concerns
- Data governance/consent constraints
- Other
Which additions would most improve reproducibility before data collection? Select up to three.
- Mock registry entry (final wording)
- Code template or skeleton analysis script
- Data schema / variable naming plan
- Versioned package/dependency list
- Defined file/folder structure with README
- Plan for where materials will be shared
- Other
Attention check: To confirm you are reading the questions, please select “Agree” only.
- Strongly disagree
- Disagree
- Neutral
- Agree
- Strongly agree
Overall, how clear and decision-ready is the plan for data collection?
Based on clarity and pre-specification, is the plan ready to proceed?
- Yes, proceed as planned
- Mostly ready; minor edits recommended
- Hold; needs substantive revisions
- Unsure
Share the most actionable suggestions to improve clarity, pre-specification, or reproducibility.
Max 600 chars
Approximately how many minutes did you spend reviewing the materials today?
What is your primary role?
How many years of experience do you have with preregistrations or pre-analysis plans?
What is your primary field or domain?
Have you previously authored a preregistration or pre-analysis plan?
How familiar are you with this study’s topic area?
Any final comments or clarifications you would like the research team to know?
Max 600 chars
AI Interview: 2 Follow-up Questions on Pre-Analysis Plan Clarity
Thank you for your thoughtful review. Your feedback will help improve clarity and pre-specification before data collection.