A structured instrument for expert reviewers to evaluate the clarity, completeness, and pre-specification quality of a pre-analysis plan or preregistration draft before data collection begins.
What's Included
AI-Powered Questions
Intelligent follow-up questions based on responses
Automated Analysis
Real-time sentiment and insight detection
Smart Distribution
Target the right audience automatically
Detailed Reports
Comprehensive insights and recommendations
Template Overview
34
Questions
AI-Powered
Smart Analysis
Ready-to-Use
Launch in Minutes
This professionally designed survey template helps you gather valuable insights with intelligent question flow and automated analysis.
Sample Survey Items
Q1
Chat Message
Welcome, and thank you for participating in this pre-analysis plan peer review.
This survey asks for your expert feedback on the clarity, completeness, and pre-specification of a research plan. There are no right or wrong answers—we value your honest professional judgment.
Your responses are confidential and will be reported only in aggregate to the research team. Participation is voluntary, and you may stop at any time. The survey takes approximately 15–20 minutes to complete.
Please base your responses only on the materials provided today.
Q2
Multiple Choice
Which materials did you review for this assessment? Select all that apply.
Research question brief
Full PAP/preregistration draft
Hypotheses section
Outcome definitions
Analysis plan
Power analysis
Data dictionary / variable list
Inclusion/exclusion rules
Mock tables/figures
Other
Q3
Dropdown
What best describes the planned study design?
Randomized controlled trial
Quasi-experimental (e.g., DiD, IV, RD)
Observational cross-sectional
Longitudinal / panel study
Lab / online experiment
Qualitative or mixed methods
Other
Q4
Long Text
In your own words, summarize the research question in one or two sentences.
Max chars
Q5
Opinion Scale
Each hypothesis is clearly labeled (e.g., H1, H2) and easy to identify.
If applicable, note the minimum detectable effect (MDE), key inputs, or any concerns about the power justification.
Max chars
Q21
Ranking
Rank the following potential threats to interpretability for this study, from most to least concerning.
Drag to order (top = most important)
Measurement error / instrument validity
Confounding / selection bias
Noncompliance / attrition
Selective reporting / researcher degrees of freedom
Model misspecification
Multiplicity / p-hacking
Q22
Multiple Choice
Are there ethical considerations that may influence analysis choices? Select all that apply.
None noted
Privacy or data security risk
Potential harm to participants
Equity/fairness bias concerns
Data governance/consent constraints
Other
Q23
Multiple Choice
Which additions would most improve reproducibility before data collection? Select up to three.
Mock registry entry (final wording)
Code template or skeleton analysis script
Data schema / variable naming plan
Versioned package/dependency list
Defined file/folder structure with README
Plan for where materials will be shared
Other
Q24
Opinion Scale
Overall, how clear is the pre-analysis plan as currently written?
Range: 1 – 7
Min: Not at all clearMid: NeutralMax: Extremely clear
Q25
Multiple Choice
Based on your review, is this plan ready to proceed to data collection?
Yes, proceed as planned
Mostly ready; minor edits recommended
Hold; needs substantive revisions
Unsure
Q26
Long Text
What are your most actionable suggestions to improve the clarity, pre-specification, or reproducibility of this plan?
Max chars
Q27
AI Interview
Based on your responses, we'd like to explore your key recommendations in more depth. Please share your thoughts with our AI moderator.
AI InterviewLength: 2Personality: [Object Object]Mode: Fast
Reference questions: 7
Q28
Dropdown
Approximately how long did you spend reviewing the materials today?
Less than 15 minutes
15–30 minutes
31–60 minutes
1–2 hours
More than 2 hours
Q29
Dropdown
What is your primary role?
Academic researcher
Graduate student
Data scientist / analyst
Policy researcher / evaluator
Practitioner / NGO
Other
Q30
Dropdown
How many years of experience do you have with preregistrations or pre-analysis plans?
Less than 1 year
1–3 years
4–6 years
7–10 years
More than 10 years
Q31
Dropdown
What is your primary field or domain?
Economics
Political science
Public health
Education
Psychology
Sociology
Computer science / data science
Other
Q32
Multiple Choice
Have you previously authored a preregistration or pre-analysis plan?
Yes
No
Q33
Dropdown
How familiar are you with this study's topic area?
Novice
Intermediate
Advanced
Expert
Q34
Chat Message
Thank you for your thoughtful review. Your feedback will be used to improve the clarity and pre-specification of this plan before data collection begins.
Frequently Asked Questions
What is QuestionPunk?
QuestionPunk is an AI-powered survey and research platform that turns traditional surveys into adaptive conversations. Describe your research goal and get a complete survey draft, conduct AI-moderated interviews with dynamic follow-ups, detect low-quality responses, and produce insights automatically. It's fast, flexible, and scalable across qualitative and quantitative research.
How do I create my first survey?
Sign up, then choose how to build: describe your research goal and let AI generate a survey, pick a template, or start from scratch. Add question types, set logic, preview, and share.
Can the AI generate a survey from a prompt?
Yes. Describe your research goal in plain language and QuestionPunk drafts a complete survey with appropriate question types, ordering, and AI follow-up logic. You can then customize before publishing.
What question types are available?
QuestionPunk supports a wide range of question types: opinion scale, rating, multiple choice, dropdown, ranking, matrix, constant sum, AI interview (text and audio), long text, short text, email, phone, date, address, website, numeric, audio/video recording, contact form, chat message, conversation reset, button, page breaks, and more.
How do AI interviews work?
AI interviews conduct adaptive conversations with respondents. The AI asks follow-up questions based on what the respondent says, probing for clarity and depth. You control the personality, tone, model (Haiku, Sonnet, or Opus), and question mode (fixed count, AI decides when to stop, or time-based).
Can I test my survey before launching?
Yes. Use synthetic testing to create AI personas and run them through your survey. This helps catch issues with question flow, logic, and wording before real respondents see it.
How many languages are supported?
QuestionPunk supports 142+ languages. Add languages from the survey editor, auto-translate questions, and share language-specific links. AI interviews also adapt to the respondent's language automatically.
How can I share my survey?
Share via a direct link (with optional custom slug), embed on your website (iframe or script), distribute through Prolific for research panels, or generate a QR code for physical distribution.
Can I export survey results?
Yes. Export as CSV (flat or wide layout), Excel (XLSX), or export the survey structure as PDF/Word. Filter by suspicious level, response type, language, or date range before exporting.
Does QuestionPunk detect fraudulent responses?
Yes. Every response is automatically classified with a suspicious level (low/medium/high) based on attention checks, response timing, and behavioral signals. You can filter flagged responses in the Responses tab.
What are the pricing plans?
Basic (Free): 20 responses/month. Business ($50/month or $500/year): 5,000 responses/month with priority support. Enterprise (Custom): unlimited responses, remove branding, custom domain, and dedicated support.
How long does support take to reply?
We reply within 24 hours, often much sooner. Include key details in your message to help us assist you faster.