Q01
Long Text
All templates
AI Refusal Message Clarity & Tone Evaluation
A stimulus-comparison survey for UX researchers and AI product teams to evaluate the clarity, tone, and helpfulness of AI safety and refusal messages. Produces actionable data on user preferences and improvement priorities.
Sample questions
A preview of what’s in the template. Every question is editable before you launch.
27 questions · ~4 min
Q02
Multiple Choice
In the last 30 days, approximately how often have you encountered an AI safety prompt or refusal message?
Q03
Long Text
Please carefully read the following AI refusal message (Message A): [Insert Message A stimulus text here]
Q04
Long Text
Please carefully read the following AI refusal message (Message B): [Insert Message B stimulus text here]
Q05
Multiple Choice
If you encountered a refusal in a real product, which message would you prefer to receive?
Q06
Long Text
How important is it to you that an AI provides clear guidance when it cannot fulfill a request?
Q07
Long Text
What is your age?
Q08
Long Text
Thank you for completing this survey. Your responses have been recorded and will help improve AI safety and refusal message design. If you have any questions about this study, please contact the research team at [insert contact information].
Q09
Multiple Choice
In which types of AI tools or platforms have you encountered these messages? Select all that apply.
Q10
Long Text
How clear was Message A?
Q11
Long Text
How clear was Message B?
Q12
Long Text
Rank the following qualities of a refusal or safety message from most important (1) to least important.
Q13
Long Text
Overall, how satisfied are you with the AI safety or refusal messages you have encountered in the last 30 days?
Q14
Multiple Choice
What is your gender identity?
Q15
Long Text
How helpful is Message A in guiding you toward safe next steps?
Q16
Long Text
How helpful is Message B in guiding you toward safe next steps?
Q17
Multiple Choice
What types of guidance would be most helpful to you after receiving a refusal? Select all that apply.
Q18
Long Text
Briefly describe what you were trying to accomplish the last time you encountered an AI refusal message.
Q19
Long Text
In which region do you primarily live?
Q20
Multiple Choice
Which words best describe the tone of Message A? Select up to three.
Q21
Multiple Choice
Which words best describe the tone of Message B? Select up to three.
Q22
Long Text
Based on your responses in this survey, please share any additional thoughts or suggestions about AI safety or refusal messages.
Q23
Long Text
What is your highest level of education completed?
Q24
Long Text
If you could edit Message A to improve it, what would you change?
Q25
Long Text
If you could edit Message B to improve it, what would you change?
Q26
AI Interview
We'd like to explore some of your responses in more detail. An AI moderator will ask you a few brief follow-up questions about your experiences with AI refusal messages.
Q27
Long Text
Which of the following best describes your current employment status?
What’s included
AI follow-ups
Adaptive probes on open-ended answers that pull out detail a static form would miss.
Attention checks
Built-in safeguards against rushed answers and low-quality respondents.
AI-drafted copy
Wording, ordering, and branching written by the AI — tuned to your research goal.
Auto report
Themes, quotes, and a plain-English summary write themselves once responses come in.
Ready to launch?
Open this template in the editor. Every part is yours to change before the first respondent sees it.