A stimulus-comparison survey for UX researchers and AI product teams to evaluate the clarity, tone, and helpfulness of AI safety and refusal messages. Produces actionable data on user preferences and improvement priorities.
What's Included
AI-Powered Questions
Intelligent follow-up questions based on responses
Automated Analysis
Real-time sentiment and insight detection
Smart Distribution
Target the right audience automatically
Detailed Reports
Comprehensive insights and recommendations
Template Overview
27
Questions
AI-Powered
Smart Analysis
Ready-to-Use
Launch in Minutes
This professionally designed survey template helps you gather valuable insights with intelligent question flow and automated analysis.
Sample Survey Items
Q1
Chat Message
Welcome, and thank you for participating in this study.
This survey asks about your recent experiences with AI safety and refusal messages — the responses you see when an AI system declines a request. It should take approximately 5–7 minutes to complete.
Your participation is entirely voluntary, and you may stop at any time. There are no right or wrong answers — we are interested only in your honest opinions. All responses are confidential, will be anonymized, and reported only in aggregate. Results will be used to improve the design of AI refusal messages.
By continuing, you indicate that you understand this information and agree to participate.
Q2
Multiple Choice
In the last 30 days, approximately how often have you encountered an AI safety prompt or refusal message?
Never
Once
2–3 times
4–6 times
7 or more times
Q3
Multiple Choice
In which types of AI tools or platforms have you encountered these messages? Select all that apply.
General-purpose AI assistant (e.g., ChatGPT, Claude)
Search engine with AI features
Social media bot
Customer support chatbot
Developer tool or code assistant
Productivity app integration
Other (please specify)
Q4
Chat Message
Please carefully read the following AI refusal message (Message A):
[Insert Message A stimulus text here]
Q5
Opinion Scale
How clear was Message A?
Range: 1 – 7
Min: Not at all clearMid: NeutralMax: Extremely clear
Q6
Opinion Scale
How helpful is Message A in guiding you toward safe next steps?
Range: 1 – 7
Min: Not at all helpfulMid: NeutralMax: Extremely helpful
Q7
Multiple Choice
Which words best describe the tone of Message A? Select up to three.
Respectful
Helpful
Clear
Reassuring
Robotic
Vague
Judgmental
Condescending
Q8
Long Text
If you could edit Message A to improve it, what would you change?
Max chars
Q9
Chat Message
Please carefully read the following AI refusal message (Message B):
[Insert Message B stimulus text here]
Q10
Opinion Scale
How clear was Message B?
Range: 1 – 7
Min: Not at all clearMid: NeutralMax: Extremely clear
Q11
Opinion Scale
How helpful is Message B in guiding you toward safe next steps?
Range: 1 – 7
Min: Not at all helpfulMid: NeutralMax: Extremely helpful
Q12
Multiple Choice
Which words best describe the tone of Message B? Select up to three.
Respectful
Helpful
Clear
Reassuring
Robotic
Vague
Judgmental
Condescending
Q13
Long Text
If you could edit Message B to improve it, what would you change?
Max chars
Q14
Multiple Choice
If you encountered a refusal in a real product, which message would you prefer to receive?
Message A
Message B
No preference
Q15
Ranking
Rank the following qualities of a refusal or safety message from most important (1) to least important.
Drag to order (top = most important)
Explains why it can't comply
Offers safe alternatives
Uses plain, simple language
Polite and non-judgmental tone
Brief length (concise)
Links to trustworthy resources
Q16
Multiple Choice
What types of guidance would be most helpful to you after receiving a refusal? Select all that apply.
Step-by-step safer method
Examples of allowed questions
Links to trustworthy resources
Short policy summary
Offer to rephrase the request
Other (please specify)
Q17
Opinion Scale
How important is it to you that an AI provides clear guidance when it cannot fulfill a request?
Range: 1 – 7
Min: Not at all importantMid: NeutralMax: Extremely important
Q18
Opinion Scale
Overall, how satisfied are you with the AI safety or refusal messages you have encountered in the last 30 days?
Range: 1 – 7
Min: Very dissatisfiedMid: NeutralMax: Very satisfied
Q19
Long Text
Briefly describe what you were trying to accomplish the last time you encountered an AI refusal message.
Max chars
Q20
Long Text
Based on your responses in this survey, please share any additional thoughts or suggestions about AI safety or refusal messages.
Max chars
Q21
AI Interview
We'd like to explore some of your responses in more detail. An AI moderator will ask you a few brief follow-up questions about your experiences with AI refusal messages.
AI InterviewLength: 2Personality: [Object Object]Mode: Fast
Reference questions: 5
Q22
Dropdown
What is your age?
Under 18
18–24
25–34
35–44
45–54
55–64
65 or older
Prefer not to say
Q23
Multiple Choice
What is your gender identity?
Woman
Man
Non-binary
Self-describe (please specify)
Prefer not to say
Q24
Dropdown
In which region do you primarily live?
Africa
Asia
Europe
North America
Oceania
South America
Prefer not to say
Q25
Dropdown
What is your highest level of education completed?
Some high school or less
High school diploma or equivalent
Some college or Associate degree
Bachelor's degree
Graduate or professional degree
Prefer not to say
Q26
Dropdown
Which of the following best describes your current employment status?
Full-time employed
Part-time employed
Self-employed
Student
Unemployed
Retired
Prefer not to say
Q27
Chat Message
Thank you for completing this survey. Your responses have been recorded and will help improve AI safety and refusal message design. If you have any questions about this study, please contact the research team at [insert contact information].
Frequently Asked Questions
What is QuestionPunk?
QuestionPunk is an AI-powered survey and research platform that turns traditional surveys into adaptive conversations. Describe your research goal and get a complete survey draft, conduct AI-moderated interviews with dynamic follow-ups, detect low-quality responses, and produce insights automatically. It's fast, flexible, and scalable across qualitative and quantitative research.
How do I create my first survey?
Sign up, then choose how to build: describe your research goal and let AI generate a survey, pick a template, or start from scratch. Add question types, set logic, preview, and share.
Can the AI generate a survey from a prompt?
Yes. Describe your research goal in plain language and QuestionPunk drafts a complete survey with appropriate question types, ordering, and AI follow-up logic. You can then customize before publishing.
What question types are available?
QuestionPunk supports a wide range of question types: opinion scale, rating, multiple choice, dropdown, ranking, matrix, constant sum, AI interview (text and audio), long text, short text, email, phone, date, address, website, numeric, audio/video recording, contact form, chat message, conversation reset, button, page breaks, and more.
How do AI interviews work?
AI interviews conduct adaptive conversations with respondents. The AI asks follow-up questions based on what the respondent says, probing for clarity and depth. You control the personality, tone, model (Haiku, Sonnet, or Opus), and question mode (fixed count, AI decides when to stop, or time-based).
Can I test my survey before launching?
Yes. Use synthetic testing to create AI personas and run them through your survey. This helps catch issues with question flow, logic, and wording before real respondents see it.
How many languages are supported?
QuestionPunk supports 142+ languages. Add languages from the survey editor, auto-translate questions, and share language-specific links. AI interviews also adapt to the respondent's language automatically.
How can I share my survey?
Share via a direct link (with optional custom slug), embed on your website (iframe or script), distribute through Prolific for research panels, or generate a QR code for physical distribution.
Can I export survey results?
Yes. Export as CSV (flat or wide layout), Excel (XLSX), or export the survey structure as PDF/Word. Filter by suspicious level, response type, language, or date range before exporting.
Does QuestionPunk detect fraudulent responses?
Yes. Every response is automatically classified with a suspicious level (low/medium/high) based on attention checks, response timing, and behavioral signals. You can filter flagged responses in the Responses tab.
What are the pricing plans?
Basic (Free): 20 responses/month. Business ($50/month or $500/year): 5,000 responses/month with priority support. Enterprise (Custom): unlimited responses, remove branding, custom domain, and dedicated support.
How long does support take to reply?
We reply within 24 hours, often much sooner. Include key details in your message to help us assist you faster.