New

User Evals for AI features

Learn morechevron_right

Glimma InsightsGlimma Guide

AI-Moderated Research: A Practical Guide

What an AI moderator is, how AI-moderated research differs from traditional methods, when it makes sense, what the researcher still controls, and how the workflow works from setup to findings.

01

What is AI moderation?

AI moderation is a research approach where an AI conducts sessions with real participants using a study setup defined by the researcher.

Unlike a fixed survey, AI moderation can adapt the conversation in real time. It listens to each response, asks relevant follow-up questions, and guides the session toward the research goals.

Participants can answer questions, complete product tasks, or navigate a website or prototype. The AI follows the discussion guide while adapting its follow-ups to what each participant says.

During a session, an AI moderator can:

  • Ask the questions defined in the discussion guide
  • Recognize when an answer is brief, unclear, or incomplete
  • Ask relevant follow-up questions
  • Explore an unexpected answer when it is relevant to the study
  • Redirect the conversation when it moves outside the research scope
  • Move on once a topic has been explored sufficiently

02

What AI-moderated research is — and is not

AI-moderated research is sometimes confused with other ways AI is used in research. The distinction is important: the participant is still a real person.

It is not

Synthetic users

The AI is not inventing participant responses or simulating what a user might say.

It is not

Digital twins

The research does not replace real participants with modeled personas or virtual copies of users.

It is

Research with real people

Real participants share their own experiences while AI handles the moderation of the session.

It is also different from simply adding conversational wording to a survey. In a survey, the path is usually predefined. In an AI-moderated interview, what the participant says can influence what the moderator asks next.

03

How is it different from traditional moderated research?

The research goal can be the same. The major difference is who conducts the live session and how that changes the scale, consistency, and flexibility of the research.

Each method makes a different trade-off. The colors below show the relative strength of each approach on a given dimension — they are not quality scores.

Human-moderatedAI-moderatedUnmoderated
Interaction

Strong

Live conversation with full human judgment.

Adaptive

Dynamic follow-ups within the study boundaries.

Limited

Mostly predefined questions and tasks.

Depth

Strong

Can explore nuance and change direction freely.

Strong

Can probe responses and ask for examples or clarification.

Limited

Depth depends on what was anticipated in advance.

Scale

Limited

Researcher time grows with every session.

Strong

Many sessions can run in parallel.

Strong

Large samples are operationally easy to run.

Speed & cost

Higher effort

Scheduling and live moderation take time.

Efficient

Asynchronous participation reduces researcher time per session.

Efficient

Lowest moderation overhead once the study is built.

04

When does AI moderation make sense?

AI moderation works best when the research team can define what the moderator needs to learn before sessions begin.

AI moderation is a strong fit when

  • The learning goals are already reasonably clear
  • You want open-ended depth across more participants
  • Consistency across sessions matters
  • Participants can complete the study independently
  • The study can follow a defined guide and probing logic
  • Asynchronous participation would make recruiting easier

Human moderation may be stronger when

  • You are still discovering what the important questions are
  • The topic is highly sensitive or emotionally complex
  • The research direction may change significantly during the interview
  • Subtle non-verbal behavior is central to the research
  • The participant needs substantial guidance during the session

05

How Glimma approaches AI moderation

At Glimma, we see AI moderation as a human-in-the-loop workflow. The AI handles the live conversation, but the researcher stays involved at every important stage: setting up the study, reviewing how moderation works, validating the evidence, and refining the study over time.

This balance is important because product research often requires both flexibility and control. The moderator should adapt to each participant, but it should do so within boundaries defined by the researcher.

Human researcher
  • 1. Design

    Define the goal, choose the study type, and create the guide.

  • 2. Configure & pilot

    Set moderation rules, test the setup, and refine it before launch.

Glimma AI
  • 3. Moderate at scale

    Run participant sessions and ask adaptive follow-up questions.

  • 4. Analyze

    Organize transcripts, recordings, patterns, and key findings.

Human researcher
  • 5. Review & iterate

    Validate findings, adjust the study, and launch the next round.

1. Design the study

The researcher starts by defining the research goal, the product decision the study should inform, and the participant group they want to learn from. At this point, they also choose the right Glimma study type.

Glimma supports several product research workflows, including in-depth user interviews, concept testing, Figma prototype testing, live website testing, mobile app testing, onboarding or journey testing, and AI product or user evals.

Examples of studies you can run in Glimma

  • How to find out why customers cancel

    In-depth interview
  • How to test an AI assistant's answer

    User evals
  • How to test a new feature in a Figma prototype

    Prototype testing
  • How to compare your app with a competitor's

    App testingSurvey

Glimma also offers AI-assisted research guide creation. The researcher describes the research questions or hypotheses, and Glimma drafts a discussion guide they can review and edit.

Let's start getting insights

Describe your research questions or hypotheses

Understand why first-time users abandon checkout after adding items to their cart

Start with a blank pageUpload description from file

2. Configure the moderation and run a pilot

Next, the researcher creates the discussion guide and configures how Glimma should behave. This includes the core questions, tasks, probing instructions, tone, structure, and how flexible the moderator should be.

With Glimma, you can specify the follow-up questions for each question in the guide and how the moderator should probe.

Open-ended voice question

Title

Now take me back to the day you canceled. What was happening?
Follow-up question

Question probing

Listen for the immediate context, trigger and people involved; probe the sequence leading to cancellation. Move on once the day and decision are grounded in a concrete episode.

Before launch, the team can pilot the study to see whether Glimma is following the intended logic, asking useful follow-ups, and staying focused on the research goals. If needed, the guide or moderation rules can be adjusted.

3. Let Glimma moderate the sessions

Once the study is live, Glimma conducts participant sessions independently. It asks the planned questions, adapts its follow-ups in real time, and responds to what each participant says or does.

Because the sessions are AI-moderated, many participants can complete them in parallel and on their own schedule, which makes it easier to collect richer feedback from a broader group.

Glimma AI
Progress: 0.0%
Close

Can you walk me through the last time you used Netflix on your phone?

You may speak nowSubmit response
Participant webcam

4. Glimma AI analyzes the data

After sessions are complete, Glimma analyzes transcripts, recordings, ratings, and participant responses to surface recurring patterns, key findings, and supporting evidence across the study.

Glimma brings together advanced analysis features from both the quantitative and the qualitative research toolbox.

Key insights
POSITIVE

Jane uses Whisperer to dictate WhatsApp messages instead of typing them.

Jane generally found Whisperer’s transcription quality good.

NEUTRAL / PREFERENCE

Jane used Whisperer while commenting on an image sent by a friend.

Jane mentioned using a voice recorder while creating a weekend to-do list.

PAIN POINTS

Background noise on a bus caused some spoken words to be missed.

Jane experienced transcription difficulties in a noisy environment.

3–Question

Can you describe how well Whisperer captured your spoken message when you dictated it for WhatsApp?

Participant

I think it was pretty good though I remember that I was in a bus and I think there was some noise background and some of my words were not captured. I remember this was an issue I had.

Camera Recording(0:25)

5. Review the evidence and iterate

The researcher reviews the findings against the underlying evidence, decides what matters for the product, and checks whether any important perspectives or exceptions were missed.

If new questions emerge, the researcher can refine the guide, change the moderation rules, and run another round.

Main Themes:(4 themes)

Price increases trigger cancellation

14 participants

Hidden cancel flow erodes trust

11 participants

Competitor bundles pull users away

7 participants

Content gaps make the plan feel wasteful

16 participants
Competitor Bundles Pull Users Away7 participants
MayaView transcript

I switched to Streamly because it came bundled with my phone plan. … Paying for two services felt silly when one was basically free.

DanielView transcript

Cinebox had my kids' shows and the sports package for one price. … I kept Netflix for another month, then realized I hadn't opened it once.

PriyaView transcript

Honestly, it was the bundle. Streamly plus music cost less than Netflix alone. … I'd come back if there was a cheaper plan without ads.

Run your first AI-moderated study with Glimma