A structured instrument for expert reviewers to evaluate the clarity, completeness, and pre-specification quality of a pre-analysis plan or preregistration draft before data collection begins.
What's Included
AI-Powered Questions
Intelligent follow-up questions based on responses
Automated Analysis
Real-time sentiment and insight detection
Smart Distribution
Target the right audience automatically
Detailed Reports
Comprehensive insights and recommendations
Template Overview
34
Questions
AI-Powered
Smart Analysis
Ready-to-Use
Launch in Minutes
This professionally designed survey template helps you gather valuable insights with intelligent question flow and automated analysis.
Sample Survey Items
Q1
Chat Message
Welcome, and thank you for participating in this pre-analysis plan peer review.
This survey asks for your expert feedback on the clarity, completeness, and pre-specification of a research plan. There are no right or wrong answers—we value your honest professional judgment.
Your responses are confidential and will be reported only in aggregate to the research team. Participation is voluntary, and you may stop at any time. The survey takes approximately 15–20 minutes to complete.
Please base your responses only on the materials provided today.
Q2
Multiple Choice
Which materials did you review for this assessment? Select all that apply.
Research question brief
Full PAP/preregistration draft
Hypotheses section
Outcome definitions
Analysis plan
Power analysis
Data dictionary / variable list
Inclusion/exclusion rules
Mock tables/figures
Other
Q3
Dropdown
What best describes the planned study design?
Randomized controlled trial
Quasi-experimental (e.g., DiD, IV, RD)
Observational cross-sectional
Longitudinal / panel study
Lab / online experiment
Qualitative or mixed methods
Other
Q4
Long Text
In your own words, summarize the research question in one or two sentences.
Max chars
Q5
Opinion Scale
Each hypothesis is clearly labeled (e.g., H1, H2) and easy to identify.
If applicable, note the minimum detectable effect (MDE), key inputs, or any concerns about the power justification.
Max chars
Q21
Ranking
Rank the following potential threats to interpretability for this study, from most to least concerning.
Drag to order (top = most important)
Measurement error / instrument validity
Confounding / selection bias
Noncompliance / attrition
Selective reporting / researcher degrees of freedom
Model misspecification
Multiplicity / p-hacking
Q22
Multiple Choice
Are there ethical considerations that may influence analysis choices? Select all that apply.
None noted
Privacy or data security risk
Potential harm to participants
Equity/fairness bias concerns
Data governance/consent constraints
Other
Q23
Multiple Choice
Which additions would most improve reproducibility before data collection? Select up to three.
Mock registry entry (final wording)
Code template or skeleton analysis script
Data schema / variable naming plan
Versioned package/dependency list
Defined file/folder structure with README
Plan for where materials will be shared
Other
Q24
Opinion Scale
Overall, how clear is the pre-analysis plan as currently written?
Range: 1 – 7
Min: Not at all clearMid: NeutralMax: Extremely clear
Q25
Multiple Choice
Based on your review, is this plan ready to proceed to data collection?
Yes, proceed as planned
Mostly ready; minor edits recommended
Hold; needs substantive revisions
Unsure
Q26
Long Text
What are your most actionable suggestions to improve the clarity, pre-specification, or reproducibility of this plan?
Max chars
Q27
AI Interview
Based on your responses, we'd like to explore your key recommendations in more depth. Please share your thoughts with our AI moderator.
AI InterviewLength: 2Personality: [Object Object]Mode: Fast
Reference questions: 7
Q28
Dropdown
Approximately how long did you spend reviewing the materials today?
Less than 15 minutes
15–30 minutes
31–60 minutes
1–2 hours
More than 2 hours
Q29
Dropdown
What is your primary role?
Academic researcher
Graduate student
Data scientist / analyst
Policy researcher / evaluator
Practitioner / NGO
Other
Q30
Dropdown
How many years of experience do you have with preregistrations or pre-analysis plans?
Less than 1 year
1–3 years
4–6 years
7–10 years
More than 10 years
Q31
Dropdown
What is your primary field or domain?
Economics
Political science
Public health
Education
Psychology
Sociology
Computer science / data science
Other
Q32
Multiple Choice
Have you previously authored a preregistration or pre-analysis plan?
Yes
No
Q33
Dropdown
How familiar are you with this study's topic area?
Novice
Intermediate
Advanced
Expert
Q34
Chat Message
Thank you for your thoughtful review. Your feedback will be used to improve the clarity and pre-specification of this plan before data collection begins.
Frequently Asked Questions
What is QuestionPunk?
QuestionPunk is a lightweight survey platform for live AI interviews you control. It's fast, flexible, and scalable—adapting every question in real time, moderating responses across languages, letting you steer prompts, models, and flows, and even generating surveys from a simple prompt. Get interview-grade insight with survey-level speed across qual and quant.
How do I create my first survey?
Sign up, then decide how you want to build: let the AI generate a survey from your prompt, pick a template, or start from scratch. Choose question types, set logic, and preview before sharing.
How can I share surveys with my team?
Send a project link so teammates can view and collaborate instantly.
Can the AI generate a survey from a prompt?
Yes. Provide a prompt and QuestionPunk drafts a survey you can tweak before sending.
How long does support typically take to reply?
We reply within 24 hours—often much sooner. Include key details in your message to help us assist you faster.
Can I export survey results?
Absolutely. Export results as CSV straight from the results page for quick data work.