Conducting Moderated Research with Handrail

A Better Experience Begins With Understanding

Moderated research is one of the most popular and flexible user research techniques. It allows researchers to have 1-on-1 discussions with participants to deeply understand wants, needs, and desired outcomes.

It’s also widely used in the product development cycle during concept evaluations and usability assessments to help teams understand how users interact with products and services.

Content Overview

  • Step 1: Create a New Study
  • Step 2: Create a Research Plan
  • Step 3: Create a Research Guide
  • Step 4: Conduct Research Sessions
  • Step 5: Review Results

Step 1: Create a New Study

Navigate to the Studies page and click "Create Study" and then choose “Open Interview” or "Structured Interview" to start creating your research guide.

See example image:

Step 2: Create a Research Plan

Capture and clarify all the details regarding your research initiative. You can outline the study purpose or objective, how your research will be used, who will be involved in the study as well as when and where the research will take place.

Study Purpose

  • Add what you want to learn, measure, or benchmark during this study. This helps inform the overall goal of the study, guide specific topics and questions, as well as stay aligned to the overall goal.

Participants

  • Define your participant criteria, target user types, or recruitment methods. Establishing this information up front and being able to refer to it helps you and your team find the right people.

Schedule

  • List start and end dates, important milestones, or even the quantity of sessions you are targeting to complete. This information helps keep team members informed on important dates and can indicate progress towards completion.  

Location

  • Identify where your study will take place. This keeps everyone involved informed on the logistics of your study and allows team members to plan accordingly.

Team Members

  • Include team members and their roles. This will help promote collaboration and keep the team informed on who is responsible for certain aspects of the study.

Step 3: Create a Research Guide

Fill out the different sections of the research guide template. Customize the research guide template to fit your specific research needs by adding content to the following fields:

1. Introduction

Add an introduction for you and your team to use when conducting participant sessions. It could contain items like a welcome message, an overview script, or an outline of what the participant should expect during the session.

See example image:

2. Topics, Reference Notes, & Questions

I. Topics

Add a specific subject that you might focus on when having a discussion with your participant. Your research guide could contain one main topic or have multiple topics. Each topic creates a separate page in your active research guide.

Example Topics:

  • Participant background discussion
  • Tasks to perform
  • Wrap up discussion

Topics can contain reference notes that the facilitator or moderator can use during the research sessions. Topics may also contain qualitative and quantitative questions you can use for data collection and reporting purposes.

II. Reference Notes

Add notes or bullet points as reference notes to help guide your discussion. Each topic can house its own specific reference notes that the facilitator or moderator can use during the participant interview sessions.

Reference notes examples:

  • Discussion points
  • Reminders or prompts for the facilitator
  • Areas to probe for more detail
  • A specific scenario to help set up a block of potential probing questions

 

III. Questions (Structured Interview study only)

Drag and drop specific questions to topics to create a structured or semi-structured research guide and report on qualitative and quantitative data. You can create new questions, use a template from the library, or reuse a question from a previous study.

Available question types:

1. Text Entry

2. Multiple Choice

3. Multiple Select

4. Rating

5. Task Success

6. System Usability Scale

Each question also contains an additional note taking area that you can use to capture observations, participant quotes or other important contextual information identified during sessions.

 

3. Conclusion

Add a conclusion for you and your team to use when ending the research sessions. It could contain items like a thank you message, a script for a closing statement, or an outline of what the participant should expect now that the session is over.

 

Additional Notes for Creating Your Research Guide

Previewing the research guide

If you want to get a preview of what the research guide will look like while facilitating the research session, click on the preview button at the top of the page. This will give you an idea of the flow and if there may need to be adjustments made or topics added.

See example image:

 

Step 4: Conduct Research Sessions

Click the “+ Session” button to start a new research session and collect data. Each session you or your team members start will give you access to the research guide, and allow you to capture individual participant information, open notes for topics, answers to specific questions, contextual notes and quotes related to specific questions, and observational notes while you are talking to your participants.

Make sure to take good notes during each research session. The notes you and your team members take will be the main source of data seen in the Results tab. Clear and concise notes will help you when you’re ready to identify and interpret insights, patterns, and themes during analysis.

See example images:

There are two main ways you can use Handrail to help you conduct research sessions and collect data:

1. On Your Own

I. Enter Data Real Time

Click the “New Session” button to start a new research session and capture the research data that will be seen in the study results.

II. Enter Data After Research Session

Step 1: Click the “Print Guide” button to print the research guide to use a paper version of the research guide. This will allow you to have a paper copy of the research guide and take notes by hand or record audio with a separated device and enter data in later.

Step 2: Click the “+ Session” button to start a new research session to enter the information you took by hand or are transcribing from audio recorded from a separate device.

2. With Your Team

I. Enter Data Real Time

Click the “+ Session” button to start a new research session if you are the one responsible for capturing the research data that will be seen in the study results.

Once a research session has started, additional team members can join the live session to facilitate the session or capture notes, answers, and contextual information from their point of view.

II. Enter Data After Research Session

Step 1: Click the “Print Guide” button to print the research guide to use a paper version of the research guide. This will allow you and the team to have a copy of the research guide and take notes by hand or record audio with a separated device and enter data in later.

Step 2: Click the “+ Session” button to start a new research session if you are the one responsible for capturing the research data that will be seen in the study results.

Once a new session has started, additional team members can join the session to enter in their notes, answers, and contextual information they captured.

Additional Notes for Conducting Sessions

Participant Information

For each session, you have the ability to gather new participant details or select a participant that has previously been entered into Handrail. Participant information that has been previously entered into Handrail can be selected by choosing “Select Existing Participant” from the Participant Information tab of your session.

Handrail automatically creates a unique identification number and assigns it to each participant. This unique ID is used internally to keep participant data separated, but it can also be used as a reference for participant data stored outside of Handrail.

Participant identification information is not required in Handrail and should only be captured with permission of each participant.  

See Policies for more information regarding privacy and GDPR compliance.

Persona Assignment

If you have created personas, you can assign a persona to your participant during interview sessions. Sessions that have personas assigned to them can be filtered in results.

Session Clock

Each session contains a session clock in the right top corner of the interview guide. This clock shows the elapsed time of the session and is used as a timestamp reference for when questions are answered. This clock can be paused and reset at any time during the session.

Step 5: Review Results

Navigate to the “Results” tab to access an organized output of all the research sessions that you've completed in a single study. It will show all the personas assigned, and contain aggregated information of the notes, answers, and contextual information you and your team have captured organized by the topics and questions from the research guide.

See example image:

Notes for reviewing results:

Data Visualization

Depending on the study type, construction of the Research Guide and the types of questions used, Handrail automatically organizes all the research session data and generates aggregated views in different types of visualizations.

Example visualizations include:

  • Word clouds
  • Pie Charts
  • Bar Charts
  • Confidence Interval Error Bars

Data Filtering

The Results filter allows you to view or remove specific sessions, personas, topics and questions.

Research Cards

Capture key findings, issues, opportunities, quotes, action items, or other insights in the Research Cards inside of the Results or Analysis tab within your study.

Any cards you create on the Results page are automatically exported to the Analysis tab allowing you to do more in-depth analysis like tagging, grouping, and filtering.

Analysis Tab

The Analysis tab allows you to create and edit research cards as well as classify and categorize cards into groups that share similar meanings or qualities.

See example image:

Summary Tab

The Summary Tab is for creating an informal summary or topline report of your study findings, recommendations, and action items.

See example image:

Need more information or have questions we didn't cover here? Get in touch!


Did this help answer your question?

thumbs up
thumbs down

Thanks for the feedback! 🙏🏽


Help by drift