All templates

AI Moderator Effectiveness by Demographic Group

A post-experience research survey evaluating the effectiveness of AI interview moderators across demographic groups. Measures overall experience quality, perceived empathy and understanding, cultural sensitivity, accessibility, and direct comparisons with human moderators. Designed to detect demographic moderation effects.

Sample questions

A preview of what’s in the template. Every question is editable before you launch.

31 questions · ~4 min
Q01
Long Text

Welcome to this research study on interview experiences. You recently participated in a research interview moderated by an AI system. We would now like to understand your experience. This survey takes approximately 10-12 minutes. There are no right or wrong answers — we are interested only in your honest opinions and perceptions. Your responses are completely confidential, will be anonymized, and reported only in aggregate for academic research purposes. Participation is voluntary, and you may stop at any time without penalty. Please click 'Next' to begin.

Q02
Multiple Choice

Have you completed a research interview moderated by an AI system within the past 7 days?

Q03
Multiple Choice

How often do you use AI-powered tools (e.g., chatbots, voice assistants, AI writing tools) in your daily life?

Q04
Long Text

The next questions ask about the AI-moderated research interview you recently completed. Please think specifically about that experience as you respond.

Q05
Long Text

To what extent did you feel the AI moderator understood what you were trying to communicate?

Q06
Long Text

To what extent did the AI moderator's questions feel respectful of your cultural background and personal identity?

Q07
Multiple Choice

Did you experience any of the following barriers during the AI-moderated interview? Select all that apply.

Q08
Multiple Choice

Have you ever participated in a research interview conducted by a human moderator (in person, by phone, or by video)?

Q09
AI Interview

Based on your responses throughout this survey, please share any additional thoughts or feelings about your experience with the AI moderator — including anything we may not have asked about.

Q10
Long Text

What is your age?

Q11
Long Text

How comfortable are you interacting with AI-powered systems in general?

Q12
Long Text

How would you rate your overall experience with the AI-moderated interview?

Q13
Long Text

To what extent did the AI moderator respond with empathy to your answers?

Q14
AI Interview

Were there any moments during the AI-moderated interview where you felt misunderstood, stereotyped, or that the AI was insensitive to your perspective? Please share what happened and how it affected your experience.

Q15
Long Text

How easy was the AI-moderated interview to navigate and complete?

Q16
Long Text

Compared to a human moderator, how would you rate the AI moderator on overall interview quality?

Q17
Multiple Choice

What is your gender identity?

Q18
Multiple Choice

Before this study, how many times had you interacted with an AI-powered chatbot or interview system?

Q19
Long Text

How likely are you to participate in another research interview moderated by an AI in the future?

Q20
Long Text

How well did the AI moderator adapt its follow-up questions to your specific responses?

Q21
Long Text

Compared to a human moderator, how would you rate the AI moderator on making you feel heard and understood?

Q22
Multiple Choice

Which of the following best describes your racial or ethnic background? Select all that apply.

Q23
Long Text

To what extent did you feel comfortable sharing your honest opinions during the AI-moderated interview?

Q24
Long Text

How natural did the conversation with the AI moderator feel?

Q25
Long Text

Compared to a human moderator, how would you rate the AI moderator on creating a comfortable environment for sharing honest opinions?

Q26
Long Text

What is the highest level of education you have completed?

Q27
Long Text

How personally sensitive or emotionally charged did you find the topic of the interview you completed?

Q28
Long Text

Compared to a human moderator, how would you rate the AI moderator on being respectful of your cultural background and identity?

Q29
Multiple Choice

What is the primary language you speak at home?

Q30
Multiple Choice

Do you identify as having a disability that affects how you interact with digital technology? (Optional)

Q31
Multiple Choice

How would you describe the area where you live?

What’s included

  • AI follow-ups

    Adaptive probes on open-ended answers that pull out detail a static form would miss.

  • Attention checks

    Built-in safeguards against rushed answers and low-quality respondents.

  • AI-drafted copy

    Wording, ordering, and branching written by the AI — tuned to your research goal.

  • Auto report

    Themes, quotes, and a plain-English summary write themselves once responses come in.

Ready to launch?

Open this template in the editor. Every part is yours to change before the first respondent sees it.