Survey Instrument Pretest: Clarity, Redundancy & Face Validity
A structured pilot review instrument for expert panelists or cognitive interview participants to evaluate draft survey items on clarity, redundancy, response-option quality, and face validity before fielding.
Sample questions
A preview of what’s in the template. Every question is editable before you launch.
Have you reviewed the draft item list provided by the researchers?
- Yes
- No
Overall, how clear were the draft items to you (i.e., easy to understand on first reading)?
Now let's focus on specific draft items you found problematic. Please identify any items that had issues—such as unclear wording, double-barreled phrasing, leading or biased language, excessive length, ambiguous timeframes, undefined terms, or cultural insensitivity. For each, describe the issue and how you would rewrite the item.
How would you rate the quality of the response options (e.g., scale labels, answer choices) in the draft items?
What is your age group?
- 18–24
- 25–34
- 35–44
- 45–54
- 55–64
- 65 or older
- Prefer not to say
Based on your responses in this review, do you have any additional suggestions to improve the clarity, reduce redundancy, or enhance the face validity of the draft items?
Have you previously participated in survey design or pilot testing?
- No
- Yes, once
- Yes, multiple times
- Prefer not to say
How appropriate are the draft items for measuring the intended construct(s)?
How would you rate the quality of the instructions accompanying the draft items?
What is your gender?
- Man
- Woman
- Non-binary
- Prefer not to say
Thank you for completing this pretest review. Your feedback will directly inform improvements to the survey instrument before it is fielded.
Did any items seem redundant with each other?
- No redundancy noticed
- Yes, about 1 pair
- Yes, about 2–3 pairs
- Yes, 4 or more pairs
How readable was the formatting and layout of the draft item list?
What is the highest level of education you have completed?
- Less than high school
- High school or equivalent
- Some college, no degree
- Associate degree
- Bachelor's degree
- Master's degree
- Doctoral degree
- Professional degree (e.g., JD, MD)
- Prefer not to say
If you noticed redundancy, please list the item numbers or exact wordings of the overlapping pairs and briefly explain why they seem redundant.
What is your current employment status?
- Student
- Employed full-time
- Employed part-time
- Self-employed
- Unemployed, seeking work
- Unemployed, not seeking work
- Retired
- Prefer not to say
If applicable, list any words or phrases in the draft items that were unclear, technical, or ambiguous.
Which region do you currently live in?
- Africa
- Asia
- Europe
- North America
- South America
- Oceania
- Prefer not to say
How did the overall length of the item set feel?
- Much too short
- Slightly too short
- About right
- Slightly too long
- Much too long
What is your primary language?
- English
- Spanish
- Mandarin Chinese
- Hindi
- Arabic
- Portuguese
- French
- German
- Japanese
- Korean
- Other
- Prefer not to say
Approximately how long did your most recent review take?
- Less than 5 minutes
- 5–10 minutes
- 11–20 minutes
- 21–30 minutes
- 31–45 minutes
- More than 45 minutes
What’s included
AI follow-ups
Adaptive probes on open-ended answers that pull out detail a static form would miss.
Attention checks
Built-in safeguards against rushed answers and low-quality respondents.
AI-drafted copy
Wording, ordering, and branching written by the AI — tuned to your research goal.
Auto report
Themes, quotes, and a plain-English summary write themselves once responses come in.
Why this template
What this template is built to do — we found no directly comparable template from other survey tools to review.
What sets it apart
- Includes structured opinion-scale ratings for item clarity, construct appropriateness, response-option quality, instructions, and layout — not just a single overall rating
- Built-in open-text prompts specifically ask panelists to flag redundant items and unclear wording by item number, supporting real pretest diagnostics
- An AI follow-up interview probes deeper into specific problematic items after the closed-ended questions, something static form builders cannot replicate
- Captures reviewer background (prior pilot-testing experience, review duration, demographics) to help researchers contextualize and weight expert feedback
Ready to launch?
Open this template in the editor. Every part is yours to change before the first respondent sees it.
Related templates
More studies from the same category.
Student Perceptions of Grading Rubric Quality
Measures student perceptions of rubric clarity, fairness, and usefulness for learning. Designed for course designers and academic researchers seeking to improve grading transparency and rubric design.
View templateRemote Exam Fairness & Privacy Perceptions Survey
Measures student perceptions of fairness, privacy, and acceptability of proctoring practices in remote exams. Designed for higher-education institutions seeking to evaluate and improve remote assessment policies.
View templateOnline & Hybrid Learning Student Experience Survey
Measures student engagement, satisfaction, perceived learning outcomes, and support needs in online and hybrid courses to guide evidence-based program improvements.
View templatePower Analysis Parameter Intake Survey
A structured intake instrument for statisticians and researchers to systematically document effect size, variance, design, and attrition assumptions needed to conduct power and sample size calculations.
View templateMixed-Methods Integration Quality Assessment
A team-level diagnostic for mixed-methods research projects, evaluating convergence, divergence, and integration rigor across qualitative and quantitative strands to guide analytic next steps.
View templateResearch Participant Eligibility & Informed Consent Screener
Screens prospective research participants for eligibility and verifies comprehension of informed consent elements before enrollment in an academic study.
View template