All templates
Education & Academic

Survey Instrument Pretest: Clarity, Redundancy & Face Validity

A structured pilot review instrument for expert panelists or cognitive interview participants to evaluate draft survey items on clarity, redundancy, response-option quality, and face validity before fielding.

Sample questions

A preview of what’s in the template. Every question is editable before you launch.

22 questions · ~10 min
Q01
Message

Welcome to this survey pretest. We are asking you to evaluate the clarity, redundancy, and face validity of the draft items you recently reviewed. Your participation is entirely voluntary, and you may stop at any time. There are no right or wrong answers—we are interested in your honest impressions as a reviewer. Your responses will be kept confidential and reported only in aggregate to improve the draft instrument. This review should take approximately 8–10 minutes.

Q02
Multiple Choice

Have you reviewed the draft item list provided by the researchers?

  • Yes
  • No
Q03
Opinion Scale

Overall, how clear were the draft items to you (i.e., easy to understand on first reading)?

Scale: 17
Min:Not at all clearMax:Extremely clear
Q04
AI Interview

Now let's focus on specific draft items you found problematic. Please identify any items that had issues—such as unclear wording, double-barreled phrasing, leading or biased language, excessive length, ambiguous timeframes, undefined terms, or cultural insensitivity. For each, describe the issue and how you would rewrite the item.

Q05
Opinion Scale

How would you rate the quality of the response options (e.g., scale labels, answer choices) in the draft items?

Scale: 17
Min:Very poor qualityMax:Excellent quality
Q06
Dropdown

What is your age group?

  • 18–24
  • 25–34
  • 35–44
  • 45–54
  • 55–64
  • 65 or older
  • Prefer not to say
Q07
Long Text

Based on your responses in this review, do you have any additional suggestions to improve the clarity, reduce redundancy, or enhance the face validity of the draft items?

Q08
Multiple Choice

Have you previously participated in survey design or pilot testing?

  • No
  • Yes, once
  • Yes, multiple times
  • Prefer not to say
Q09
Opinion Scale

How appropriate are the draft items for measuring the intended construct(s)?

Scale: 17
Min:Not at all appropriateMax:Extremely appropriate
Q10
Opinion Scale

How would you rate the quality of the instructions accompanying the draft items?

Scale: 17
Min:Very poor qualityMax:Excellent quality
Q11
Multiple Choice

What is your gender?

  • Man
  • Woman
  • Non-binary
  • Prefer not to say
Q12
Message

Thank you for completing this pretest review. Your feedback will directly inform improvements to the survey instrument before it is fielded.

Q13
Multiple Choice

Did any items seem redundant with each other?

  • No redundancy noticed
  • Yes, about 1 pair
  • Yes, about 2–3 pairs
  • Yes, 4 or more pairs
Q14
Opinion Scale

How readable was the formatting and layout of the draft item list?

Scale: 17
Min:Not at all readableMax:Extremely readable
Q15
Dropdown

What is the highest level of education you have completed?

  • Less than high school
  • High school or equivalent
  • Some college, no degree
  • Associate degree
  • Bachelor's degree
  • Master's degree
  • Doctoral degree
  • Professional degree (e.g., JD, MD)
  • Prefer not to say
Q16
Long Text

If you noticed redundancy, please list the item numbers or exact wordings of the overlapping pairs and briefly explain why they seem redundant.

Q17
Dropdown

What is your current employment status?

  • Student
  • Employed full-time
  • Employed part-time
  • Self-employed
  • Unemployed, seeking work
  • Unemployed, not seeking work
  • Retired
  • Prefer not to say
Q18
Long Text

If applicable, list any words or phrases in the draft items that were unclear, technical, or ambiguous.

Q19
Dropdown

Which region do you currently live in?

  • Africa
  • Asia
  • Europe
  • North America
  • South America
  • Oceania
  • Prefer not to say
Q20
Multiple Choice

How did the overall length of the item set feel?

  • Much too short
  • Slightly too short
  • About right
  • Slightly too long
  • Much too long
Q21
Dropdown

What is your primary language?

  • English
  • Spanish
  • Mandarin Chinese
  • Hindi
  • Arabic
  • Portuguese
  • French
  • German
  • Japanese
  • Korean
  • Other
  • Prefer not to say
Q22
Dropdown

Approximately how long did your most recent review take?

  • Less than 5 minutes
  • 5–10 minutes
  • 11–20 minutes
  • 21–30 minutes
  • 31–45 minutes
  • More than 45 minutes

What’s included

  • AI follow-ups

    Adaptive probes on open-ended answers that pull out detail a static form would miss.

  • Attention checks

    Built-in safeguards against rushed answers and low-quality respondents.

  • AI-drafted copy

    Wording, ordering, and branching written by the AI — tuned to your research goal.

  • Auto report

    Themes, quotes, and a plain-English summary write themselves once responses come in.

Why this template

What this template is built to do — we found no directly comparable template from other survey tools to review.

What sets it apart

  • Includes structured opinion-scale ratings for item clarity, construct appropriateness, response-option quality, instructions, and layout — not just a single overall rating
  • Built-in open-text prompts specifically ask panelists to flag redundant items and unclear wording by item number, supporting real pretest diagnostics
  • An AI follow-up interview probes deeper into specific problematic items after the closed-ended questions, something static form builders cannot replicate
  • Captures reviewer background (prior pilot-testing experience, review duration, demographics) to help researchers contextualize and weight expert feedback

Frequently asked questions

What questions are in the “Survey Instrument Pretest: Clarity, Redundancy & Face Validity” template?

The template includes 22 ready-to-use questions, starting with: “Welcome to this survey pretest. We are asking you to evaluate the clarity, redundancy, and face validity of the draft it…” · “Have you reviewed the draft item list provided by the researchers?” · “Overall, how clear were the draft items to you (i.e., easy to understand on first reading)?”. The full set is previewed above, and every question is editable.

How long does this survey take to complete?

Respondents typically finish the 22 questions in about 10 minutes.

Can I customize this template?

Yes — every question, answer option, and the ordering is editable before you launch. You can add or remove questions, or ask the AI editor to rework the survey around your research goal.

Is this template free to use?

Yes. Open it in the editor and start customizing right away — no account required to try it, and the free plan covers launching your survey.

Ready to launch?

Open this template in the editor. Every part is yours to change before the first respondent sees it.

Related templates

More studies on similar topics.

See all
Education & Academic

Student Perceptions of Grading Rubric Quality

Measures student perceptions of rubric clarity, fairness, and usefulness for learning. Designed for course designers and academic researchers seeking to improve grading transparency and rubric design.

View template
Education & Academic

Research Instrument Pilot Test Evaluation

Collects structured feedback from pilot participants on instrument clarity, cognitive burden, ambiguity sources, and session flow to guide pre-launch refinement of research questionnaires.

View template
Education & Academic

Interview Experience Study

A controlled comparison instrument for evaluating interview experiences across different moderator formats. This survey measures pre-interview expectations, embeds an interview session, and captures post-interview evaluations of comfort, quality, depth, trust, and willingness to participate again.

View template
Education & Academic

Pre-Analysis Plan Peer Review Assessment

A structured instrument for expert reviewers to evaluate the clarity, completeness, and pre-specification quality of a pre-analysis plan or preregistration draft before data collection begins.

View template
Education & Academic

Pre-Launch Product Concept Evaluation Survey

A structured concept testing instrument designed to measure perceived innovation, quality, purchase intent, and feature priorities for a new product among target consumers prior to market launch.

View template
Education & Academic

Participant Screener & Demographics

A clean recruiting screener: knock-out questions first, quota-ready demographics, an attention check, and an articulation check that verifies participants can give the rich answers qualitative research needs. Designed to disqualify politely and comply with prefer-not-to-say norms.

View template