AI Moderator Effectiveness by Demographic Group
A post-experience research survey evaluating the effectiveness of AI interview moderators across demographic groups. Measures overall experience quality, perceived empathy and understanding, cultural sensitivity, accessibility, and direct comparisons with human moderators. Designed to detect demographic moderation effects.
Sample questions
A preview of what’s in the template. Every question is editable before you launch.
Have you completed a research interview moderated by an AI system within the past 7 days?
How often do you use AI-powered tools (e.g., chatbots, voice assistants, AI writing tools) in your daily life?
The next questions ask about the AI-moderated research interview you recently completed. Please think specifically about that experience as you respond.
To what extent did you feel the AI moderator understood what you were trying to communicate?
To what extent did the AI moderator's questions feel respectful of your cultural background and personal identity?
Did you experience any of the following barriers during the AI-moderated interview? Select all that apply.
Have you ever participated in a research interview conducted by a human moderator (in person, by phone, or by video)?
Based on your responses throughout this survey, please share any additional thoughts or feelings about your experience with the AI moderator — including anything we may not have asked about.
What is your age?
How comfortable are you interacting with AI-powered systems in general?
How would you rate your overall experience with the AI-moderated interview?
To what extent did the AI moderator respond with empathy to your answers?
Were there any moments during the AI-moderated interview where you felt misunderstood, stereotyped, or that the AI was insensitive to your perspective? Please share what happened and how it affected your experience.
How easy was the AI-moderated interview to navigate and complete?
Compared to a human moderator, how would you rate the AI moderator on overall interview quality?
What is your gender identity?
Before this study, how many times had you interacted with an AI-powered chatbot or interview system?
How likely are you to participate in another research interview moderated by an AI in the future?
How well did the AI moderator adapt its follow-up questions to your specific responses?
Compared to a human moderator, how would you rate the AI moderator on making you feel heard and understood?
Which of the following best describes your racial or ethnic background? Select all that apply.
To what extent did you feel comfortable sharing your honest opinions during the AI-moderated interview?
How natural did the conversation with the AI moderator feel?
Compared to a human moderator, how would you rate the AI moderator on creating a comfortable environment for sharing honest opinions?
What is the highest level of education you have completed?
How personally sensitive or emotionally charged did you find the topic of the interview you completed?
Compared to a human moderator, how would you rate the AI moderator on being respectful of your cultural background and identity?
What is the primary language you speak at home?
Do you identify as having a disability that affects how you interact with digital technology? (Optional)
How would you describe the area where you live?
What’s included
AI follow-ups
Adaptive probes on open-ended answers that pull out detail a static form would miss.
Attention checks
Built-in safeguards against rushed answers and low-quality respondents.
AI-drafted copy
Wording, ordering, and branching written by the AI — tuned to your research goal.
Auto report
Themes, quotes, and a plain-English summary write themselves once responses come in.
Ready to launch?
Open this template in the editor. Every part is yours to change before the first respondent sees it.