A stimulus-comparison survey for UX researchers and AI product teams to evaluate the clarity, tone, and helpfulness of AI safety and refusal messages. Produces actionable data on user preferences and improvement priorities.
What's Included
AI-Powered Questions
Intelligent follow-up questions based on responses
Automated Analysis
Real-time sentiment and insight detection
Smart Distribution
Target the right audience automatically
Detailed Reports
Comprehensive insights and recommendations
Template Overview
27
Questions
AI-Powered
Smart Analysis
Ready-to-Use
Launch in Minutes
This professionally designed survey template helps you gather valuable insights with intelligent question flow and automated analysis.
Sample Survey Items
Q1
Chat Message
Welcome, and thank you for participating in this study.
This survey asks about your recent experiences with AI safety and refusal messages — the responses you see when an AI system declines a request. It should take approximately 5–7 minutes to complete.
Your participation is entirely voluntary, and you may stop at any time. There are no right or wrong answers — we are interested only in your honest opinions. All responses are confidential, will be anonymized, and reported only in aggregate. Results will be used to improve the design of AI refusal messages.
By continuing, you indicate that you understand this information and agree to participate.
Q2
Multiple Choice
In the last 30 days, approximately how often have you encountered an AI safety prompt or refusal message?
Never
Once
2–3 times
4–6 times
7 or more times
Q3
Multiple Choice
In which types of AI tools or platforms have you encountered these messages? Select all that apply.
General-purpose AI assistant (e.g., ChatGPT, Claude)
Search engine with AI features
Social media bot
Customer support chatbot
Developer tool or code assistant
Productivity app integration
Other (please specify)
Q4
Chat Message
Please carefully read the following AI refusal message (Message A):
[Insert Message A stimulus text here]
Q5
Opinion Scale
How clear was Message A?
Range: 1 – 7
Min: Not at all clearMid: NeutralMax: Extremely clear
Q6
Opinion Scale
How helpful is Message A in guiding you toward safe next steps?
Range: 1 – 7
Min: Not at all helpfulMid: NeutralMax: Extremely helpful
Q7
Multiple Choice
Which words best describe the tone of Message A? Select up to three.
Respectful
Helpful
Clear
Reassuring
Robotic
Vague
Judgmental
Condescending
Q8
Long Text
If you could edit Message A to improve it, what would you change?
Max chars
Q9
Chat Message
Please carefully read the following AI refusal message (Message B):
[Insert Message B stimulus text here]
Q10
Opinion Scale
How clear was Message B?
Range: 1 – 7
Min: Not at all clearMid: NeutralMax: Extremely clear
Q11
Opinion Scale
How helpful is Message B in guiding you toward safe next steps?
Range: 1 – 7
Min: Not at all helpfulMid: NeutralMax: Extremely helpful
Q12
Multiple Choice
Which words best describe the tone of Message B? Select up to three.
Respectful
Helpful
Clear
Reassuring
Robotic
Vague
Judgmental
Condescending
Q13
Long Text
If you could edit Message B to improve it, what would you change?
Max chars
Q14
Multiple Choice
If you encountered a refusal in a real product, which message would you prefer to receive?
Message A
Message B
No preference
Q15
Ranking
Rank the following qualities of a refusal or safety message from most important (1) to least important.
Drag to order (top = most important)
Explains why it can't comply
Offers safe alternatives
Uses plain, simple language
Polite and non-judgmental tone
Brief length (concise)
Links to trustworthy resources
Q16
Multiple Choice
What types of guidance would be most helpful to you after receiving a refusal? Select all that apply.
Step-by-step safer method
Examples of allowed questions
Links to trustworthy resources
Short policy summary
Offer to rephrase the request
Other (please specify)
Q17
Opinion Scale
How important is it to you that an AI provides clear guidance when it cannot fulfill a request?
Range: 1 – 7
Min: Not at all importantMid: NeutralMax: Extremely important
Q18
Opinion Scale
Overall, how satisfied are you with the AI safety or refusal messages you have encountered in the last 30 days?
Range: 1 – 7
Min: Very dissatisfiedMid: NeutralMax: Very satisfied
Q19
Long Text
Briefly describe what you were trying to accomplish the last time you encountered an AI refusal message.
Max chars
Q20
Long Text
Based on your responses in this survey, please share any additional thoughts or suggestions about AI safety or refusal messages.
Max chars
Q21
AI Interview
We'd like to explore some of your responses in more detail. An AI moderator will ask you a few brief follow-up questions about your experiences with AI refusal messages.
AI InterviewLength: 2Personality: [Object Object]Mode: Fast
Reference questions: 5
Q22
Dropdown
What is your age?
Under 18
18–24
25–34
35–44
45–54
55–64
65 or older
Prefer not to say
Q23
Multiple Choice
What is your gender identity?
Woman
Man
Non-binary
Self-describe (please specify)
Prefer not to say
Q24
Dropdown
In which region do you primarily live?
Africa
Asia
Europe
North America
Oceania
South America
Prefer not to say
Q25
Dropdown
What is your highest level of education completed?
Some high school or less
High school diploma or equivalent
Some college or Associate degree
Bachelor's degree
Graduate or professional degree
Prefer not to say
Q26
Dropdown
Which of the following best describes your current employment status?
Full-time employed
Part-time employed
Self-employed
Student
Unemployed
Retired
Prefer not to say
Q27
Chat Message
Thank you for completing this survey. Your responses have been recorded and will help improve AI safety and refusal message design. If you have any questions about this study, please contact the research team at [insert contact information].
Frequently Asked Questions
What is QuestionPunk?
QuestionPunk is a lightweight survey platform for live AI interviews you control. It's fast, flexible, and scalable—adapting every question in real time, moderating responses across languages, letting you steer prompts, models, and flows, and even generating surveys from a simple prompt. Get interview-grade insight with survey-level speed across qual and quant.
How do I create my first survey?
Sign up, then decide how you want to build: let the AI generate a survey from your prompt, pick a template, or start from scratch. Choose question types, set logic, and preview before sharing.
How can I share surveys with my team?
Send a project link so teammates can view and collaborate instantly.
Can the AI generate a survey from a prompt?
Yes. Provide a prompt and QuestionPunk drafts a survey you can tweak before sending.
How long does support typically take to reply?
We reply within 24 hours—often much sooner. Include key details in your message to help us assist you faster.
Can I export survey results?
Absolutely. Export results as CSV straight from the results page for quick data work.