Recruiting and Participant Engagement: Part 1: Acquire: Q & A with Elizabeth MacLaughlin
Posted January 23rd 2012 by Elizabeth MacLaughlin
Attendees in our recent Mini Webinar about acquiring the right participants for Online Immersive Studies (click here for a link to the recording and presentation) had so many terrific questions that we didn’t get to answering all of them. Here are some follow up answers:
Q: Do you have a formula for over recruiting?
A: In general, we recommend over-recruiting by 18-20%. For harder to engage groups, 22-25% may be appropriate.
Q: Thinking of doing a "get to know" you question to eliminate those respondents not right for study. How many would you over recruit to do this?
A: Depending on your budget, an audition activity can be over-recruited 50-75%...or even up to twice as many as you’ll pick… so that you can both account for no-shows and pick the best participants for your study. Just remember to account for a small incentive (we recommend around $25) for dismissals, as well as any costs your recruit partners may have for recruiting for the entire group (not just the finalists).
Also remember to keep the overall number reasonable enough that you won’t be overwhelmed in choosing your final group. Ideally, your participants have 1-2 days (24-48 hours) to complete the audition activity, and then you’ll want to budget another day after that to make your final decisions, and let everyone know.
Q: Do you have experience with international research/inviting people from different nationalities?
A: Revelation supports multilingual projects in 16 languages, enabling researchers to conduct in-depth immersive studies simultaneously around the world, reaching over 3 billion potential customers!
Revelation currently supports English, Chinese (traditional and simplified), Japanese, Thai, Korean, Bahasa Malay, Spanish (EU and Latin American), Turkish, Brazilian Portuguese, French, German, Greek, Russian and Italian. Revelation offers a suite of translation services for all aspects of the study. For more information on the languages feature or our translation services, contact us.
Q: How can you vet technology aptitude and agreement to participate if you are using a 3rd party panel? What questions can you ask to narrow the sample to the correct respondent pool?
A: For Immersive studies, with 3rd party panels you’ll still want to run a recruit so that you can pre-screen your final group for both technology requirements, willingness to participate, and any targeting requirements you have of your group.
Once they’ve qualified during your recruit phase, only then do they enter your immersive study.
Q: Any best practices when recruiting Business Participants?
A: B2B can be a very exciting prospect for Immersive work! Just keep in mind that various professions will require higher incentivizing for any type of research work, and that targeting busy professionals often means there will be work in designing a study that is easy and convenient for them to engage with.
There will be more to come on Tuesday, January 31st at Part 2 of this Mini Webinar Series: all about Engaging and Retaining participants in online work. I hope to see you there! To register, click here.
Hello 2012! Five MR trends to watch in the coming year!
Posted January 3rd 2012 by Steve August
Well, here we are at the beginning of 2012. 2011, with all of its twists and turns, is behind us and we start the New Year looking ahead to see what might be in store. Here at Revelation, 2011 was a wonderful year of progress, challenge and growth. We see 2012 filled with immense opportunity. The wonderful thing about working in a dynamic, rapidly changing industry like market research is that each day represents a new opportunity to learn and find exciting new ways to create value for our customers.
So as we look forward into 2012, here are some of the things we are keeping an eye on:
1. Technology continues to reshape MR
No doubt about it, technology will continue to have an immense impact on MR, on both methodology and the business of MR itself. Technology enabled offerings will be the price of admission to stay current in the business, and more technology companies (especially around big data, marketing automation and mobile) will enter the market research space.
2. Hype versus reality
That said, technology is not methodology in itself, and new technology-enabled methods will need to prove out against methods that have been normalized over the past decades. In 2012, researchers and clients will be putting social media research, gamification and other buzz-y methods to the test.
3. Lighter weight engagement at key moments
Given that the attention span of potential MR participants for MR activity is constant shrinking, and more MR moves to the less expressive mobile medium, lightweight collection methods that engages quickly at key moments will become more widespread. Getting the right question to the right person at the right time will start to take on as much importance as the depth of information.
4. Delivering more value
We are not out of the economic woods yet by any means, and that means that budgets will continue to be tightened and a premium will be placed on delivering value. Ultimately the mission of market research is to understand people to answer business questions, and getting that mission accomplished faster, more cost effectively and just as reliably (if not more so) will continue to be a huge imperative. New methods, no matter how flashy, will be measured by how effectively they enable clients to get the answers they need.
5. Watch for new business models
While all the attention is on technology and methods, there is an undercurrent of disruption of current MR business models (for example, Usamp not charging for SurveyWriter to enable sample and other forms of revenue). Which traditional models will come under stress from a confluence of methodology and technology is yet to be seen, but inevitably, there will be a leap from applying technology to current methods and models to technology enabling new MR business models.
Here is to a great 2012! To learn more about Revelation’s Immersive Research, we have a few options for you:
January Mini Webinar Series: Acquiring, Engaging and Retaining Research Participants
Posted January 3rd 2012 by Kristie Conner
One of the consistent messages we hear from our clients after they complete an Immersive Research study with Revelation is how engaged their participants were in the research and the amount of data they gathered. In January, we are hosting two Mini Webinars that will highlight best practices for recruitment and participant engagement. The two part series will highlight Acquiring, Engaging and Retaining participants throughout the research study.
Recruiting and Participant Engagement: Part 1: Acquire
Revelation’s Client Services team has helped hundreds of our clients engage their participants in online Immersive Research studies that span days, weeks and sometimes even months! How do we do it? Join us, January 17, 2012, and learn about our three-pronged approach: Acquire, Engage, Retain.
Participant Engagement: Part 2: Engage. Retain.
Part 1, Elizabeth discussed Acquire: how to run successful recruits for online Immersive Research studies. On January 31, 2012, Elizabeth MacLaughlin will expand on the first webinar and discuss the second and third ingredients that get you the excited, engaged group you want!
Engage: How do you inspire your group to get excited about your online research study the minute they login? And, how do you connect with them online to strengthen their bond and commitment to the study? There are a few easy techniques you can employ during the first few days of your study that will go miles towards keeping your group operating at 100% throughout your study.
Retain: Your participants are off to a great start, but what now? How do you use Revelation to track your participants’ progress, and how and when is it appropriate to follow-up with your individual participants? What motivators will see them through from Day 1 to End?
To learn more or register click here.
Best Practices for Mobile Research: Q & A with Elizabeth MacLaughlin
Posted December 6th 2011 by Elizabeth MacLaughlin
All About Revelation Mobile
By: Elizabeth MacLaughlin, Client Services Manager
I recently hosted a mini-webinar to demonstrate the functionality of our Revelation Mobile App and discuss best practices in using mobile technology to capture in-the-moment data.
Here is a link to the recorded webinar and a PDF of the presentation, please click here.
Also, don't miss out on the follow-up webinar: Revelation Mobile Case Study. Click here to view the recording or download the presentation.
There were so many great questions that a few of them didn’t get answered. So, I put together the following Q&A series:
Q: What platforms does the Revelation Mobile App currently work on?A: The Revelation App currently is supported on:
-
iPhone Apple iOS 3.1.3 or later
-
Android 1.6 (Donut) or later
-
iPad 1 and 2 (keep in mind that iPad 1 does not have photo-taking capability)
Other mobile smartphone and tablet devices are not yet supported.
Q: If a participant is answering questions and a text pops up, when they return to the app will their entries still be there?A: Currently, if a text pops up while the participant is in the middle of answering an activity on their Mobile device, they can either continue the activity and finish (submit) it before looking at their text…or they can click away from the Revelation App to view their text (or answer their phone, or anything else that might distract them from their in-the-moment responses), in which case their responses will be lost when they return to the Revelation App.
This is why we recommend structuring mobile activities to be short, and recurring. That way the activity is continually available to the participant so they can easily return to it and answer questions, and if they do happen to lose a few responses, they can re-enter data quickly and easily.
Q: How can the moderator probe in the moment if they see a participant is currently in the store?A: Revelation Mobile functions as an asynchronous tool, and researcher follow-up probes only show up on the desktop interface. Therefore there will be some time between the participant responds to his/her in-the-moment activity and when they see and respond to follow-up probes.
Utilizing the “Record, then Reflect” Immersive practice is most effective for our tool, which allows participants to capture their in-the-moment documentaries on their mobile device with short texts and photo responses, and then to elaborate later from home with more reflective detail.
Q: How feasible is it to do a project solely on mobile? Will the participants pretty much always have to do an online part as well?A: On the Revelation Platform, the participant must first login to the online study from their desktop and create a password. Only after doing so are they able to use the Revelation App to access their Mobile activities. So to some extent, a desktop is currently required.
In addition, there are currently certain functionalities, such as ability to see and respond to probes; and certain activity types, such as an activity requesting video or a discussion activity, that are only available using a desktop computer.
On the whole, layering mobile activities in with non-mobile activities provides more rich data. However, if your goal is to run a study to collect primarily short, in the moment, response capture, you can certainly tailor a study that guides participants to primarily use their mobile devices to enter data. Just keep in mind that they potentially can respond to questions from their desktop as well, so setting participant study guidelines will be paramount.
Q: Can you give examples of your system being used for B2B research?A: Certainly! Our example for the webinar was a consumer shopping experience study, but one could use the same methods to capture B2B data, such as in the moment feedback from a tradeshow, conference or marketing event.
Thoughts from The Market Research Event
Posted November 9th 2011 by Steve August
Thoughts from The Market Research Event
During the past few days, I had the pleasure of attending The Market Research Event in Orlando. It was wonderful to meet so many of Revelation's customers, and vendors in person, as well as many friends and colleagues.
For those who have never attended TMRE , it can be a little overwhelming. There are nine (yes, nine!) concurrent tracks over the course of nearly three days. It’s impossible for any one person to see everything and inevitably there are sessions you want to attend that happen during the same time slot.
The event has only just finished up, but I’ve collected some of my high level takeaways:
1. From hype to reality - social media research is getting tested by end clients.
There were several presentations featuring end clients (Intel, Coleman) who have jumped into the social media research pool to see if it lived up to the hype and where it fit into the market research tool kit. The sense I got from the presentations is that the verdict is still out. On one hand it’s clear that SMR has value and can’t be ignored. On the other hand, specific applications, research norms and a realistic sense of time and effort required to get good results are part of the learning curve that end users are still climbing.
2. Innovation – not just the technology, but also business models
The idea and need for innovation permeated many of the sessions. There were presentations that dealt with market research technology and services, but I believe there is also starting to be some innovation around how market research fits into other business models. For example uSamp released a new DIY survey tool that’s totally free, and is essentially a driver for sample usage. As it scales, it also gives them a huge database of business contacts to potentially leverage in other ways. Google is playing with the idea of using micro-surveys as ‘pay-gates’ to premium content. In these cases money is not being made on the research itself, but enabling other revenue streams. It’s still VERY early days, but MR being integrated into other business models warrants keeping an eye on.
3. Things that were new three years ago are still new to a lot of people
While so many of the presentations presented forward looking technologies and methodologies, the MR industry still moves very slow in adoption of new things into mainstream practice. Ultimately new techniques and methods need to prove out and prove value. In the MR world, that takes time.
Revelation's customers are out in force at The Market Research Event (TMRE)
Posted November 6th 2011 by Steve August
We are so proud! Revelation’s customers are out in force at The Market Research Event. This week a number of our customers will be presenting. Of course, while the achievements of our customers are their own, we can’t help but feel a bit of pride in supporting their success.
If you are attending The Market Research Event (TMRE), please consider attending the following sessions in support of our customers.
Monday, 11/7 at 2:15
Illumination Research presents American Woman: A Deep Dive into Segmentation
Monday, 11/7 at 1:30pm
KL Communication presents The iPad is Changing the Way Americans Consume Media: Learning from the Time Inc. Innovation Panel
Tuesday 11/8 at 1:30pm
C+R Research presents Teens and Their Money: A Deep Immersion into Teen Spending Behaviors Using Social Media Research Technology
Tuesday 11/8 at 1:30pm
Nicole Freund of Coleman Outdoor presents Succeeding as a One-Wo/Man Army: Creating Value When You Are the Only Resource
Tuesday, 11/8 at 2:15pm
Stephanie Balderrama of Consumers Insights Group presents Creating a Brand Defining Presence in Unfamiliar Territory
Tuesday, 11/8 at 3:00pm
Dave Lundahl of Insights Now presents Breakthrough Product Innovation through Behavior-Driven Research
Congratulations to all of these amazing research companies!
The Market Research Event
Posted October 31st 2011 by Kristie Conner
Next week Revelation, Inc. is attending The Market Research Event in Orlando, Florida! Personally, this will be my first market research conference and I am looking forward to the overall experience. We’ll have a booth (#116 – please be sure you stop by) and in between booth duty I’ll be attending some of the sessions. I’m especially looking forward to:
- Jerry W. Thomas, President/CEO “The Future is Coming: Macro Economic Trends That Will Shape Consumer Behavior”
- Nicole Freund of Coleman, “Succeeding as a One-Wo/Man Army: Creating Value When You Are the Only Resource”
- Nick Mysore, “Trend Spotting with Social Media to Grow Your Business”
- Mary Egan, Starbucks Coffee Company, “Consumer Insight at a Source of Corporate Advantage”
- Jeremy Gutsche, Founder of Trendhunter.com, “The Trend Report: Clusters of Innovation”
- “How Constant Contact Uses Insight to Evolve With Our Customers
Meegan, Senior Account Manager picks:
- Eric Grosgogeat of Focus Vision Worldwide, and Jorge Calvachi, Amway, “How to Develop a Concept Across Two Continents in One Day?”
- Nicole Freund of Coleman, “Succeeding as a One-Wo/Man Army: Creating Value When You Are the Only Resource”
Rachel, Director of Client Services picks:
- “Experience Driven Innovation”, Intel Corporation
- “Revolutionizing Your Brand Research”, Harris Interactive
- “Social Media Meets Community Panels: All Those Comments Are Just Noise Until You Know Who They Are”, Vision Critical & Partner
- “Demonstrating the ROI of Market Research”, Interactive Discussion
- “Beyond Ethnography: Creating a Culture Committed to Consumer Empathy”, Paulette Kish, Mars Petcare
- Nicole Freund of Coleman, “Succeeding as a One-Wo/Man Army: Creating Value When You Are the Only Resource”
During the event you’ll be able to find me or one of the other Revelation team members – Meegan Thye-Walker or Rachel Bell at our booth, in a session or mingling. If you’d like to meet with any of the above or Steve August, CEO, just ping me at Kristie@revelationglobal.com or via Twitter @k_conner.
For those of you who stop by our booth we’ll not only have valuable information to share on Immersive Research, but a special surprise!
See you next week or follow us on Twitter to follow the TMRE activities.
- @revelationinc
- @k_conner
- @ rachel_bell44
How Steve Jobs Helped Create Revelation
Posted October 12th 2011 by Steve August
There has been quite a bit of sadness around the Revelation office since the news of Steve Jobs’ passing. We are a company of Apple fan boys and girls, and our office is a veritable showroom of Apple stuff – iMacs, iPhones, and iPads. And yet, the rows of sleek, immaculately designed devices on our desks represent only the most superficial impact that Steve Jobs has had on Revelation.
In fact, it could be argued that Revelation may very well not be here today without Steve Jobs’ influence. When I founded Revelation, my goal was for us to be the Apple of the market research business. I wanted to create a business that not only helped researchers understand consumers, but also offered a new kind of research experience.
I looked to Apple as our model. Beyond shiny surfaces and elegant interfaces, Apple embraced the notion that the whole experience had to be considered. The iPod had iTunes and access to the music and content and it all worked together seamlessly. The iPhone had apps and the App Store so you could make your phone do all kinds of useful things. (And of course, if you desired, useless but entertaining things.)
For Revelation, the idea was to not just create a piece of software, but to look at the whole process of going from business questions, to insight, to understanding. At Revelation, we looked not just at technology, but we also developed an activity-based approach that would get the most out of the technology and the online medium. The confluence of the two became Immersive Research.
Steve Jobs said that Apple lived at the intersection of technology and the liberal arts. I believe that qualitative market research lives at the intersection of the liberal arts and business. And we’ve always thought of Revelation living at the intersection of technology and market research.
When we started Revelation, we had no idea how immensely challenging it is to become ‘the Apple’ of anything. While we are proud of what Revelation has accomplished, we know we are still only at the very beginning, striving to that elusive ideal.
Beyond all the shiny devices, that’s the biggest impact Steve Jobs has had on Revelation -- the idea that having ideals in our work is important, and there is nothing more worthy of effort in our lives than working vigorously towards them.
And for that we thank you, Steve. You will be missed.
Surprise! More Data Than You Expect!
Posted September 7th 2011 by Steve August
One of the consistent things we hear at Revelation is a sense of surprise about how much data a Revelation-based project can generate. It seems new customers, who are more familiar with focus groups, are often most surprised by the amount of information their participants can generate within only a few days.
So why do Revelation Project studies generate such an unexpected treasure trove of information? There are two reasons that work together to produce so much data: the amount of active participation time and the nature of the activity-based approach.
Let’s talk about participation time first. This is just a simple case of math. Compared to in-person focus groups, participants in a Revelation-based study spend a lot more time actively participating. Howard Zaltman in his book “How Customers Think” estimated that the average focus group member actually only actively participates – the time they are speaking - for 7 minutes. Think about it – a focus group participant may contribute a total of two hours to a focus group. But in a room with ten people and a moderator, they have only a limited amount of time they can actively contribute.
In a five-day Revelation study, for roughly the same recruiting and incentive cost as a focus group, participants often actively participate for 20 minutes per day. Over the course of the study that can add up to 100+ minutes, nearly two hours of active participation. The huge difference in active participation time adds up to more data over the course of the study.
After active participation time, the nature of an activity-based approach is the second factor in Revelation-based studies producing a surprising amount of data. Activities elicit participant responses by creating opportunities to express beyond just answering questions. Let’s take, as an example, a photo metaphor exercise where participants are asked to post three images and descriptions to represent three different brands. With 15 participants, the total number of photos posted would be 45 images and accompanying descriptions, 15 for each brand. That is just one activity in a series of many more activities over the course of a week. Add a video activity for 15 participants that solicit two video clips of two minutes from each participant. This would generate 30 video clips and an hour of video to watch and analyze.
As you can see it starts to quickly add up! In just two activities, participants have generated 45 photos and texts from the metaphor activity and 30 video clips from the video activity!
The great thing about this is that recruiting and incentives are about the same for Revelation Project studies versus traditional focus groups, which means that you are getting a lot more contribution from each participant – and more data – for your research dollar.
To learn more download our new white paper Cost Effectiveness Comparison: Immersive Research™ Compared to Traditional Qualitative Research Methods.”
Blended Reality ResearchTM: Q & A with Karen Ward from Curiosity Inc.
Posted August 24th 2011 by Kristie Conner
We had a tremendous response to our Blended Reality ResearchTM (BRR) webinar and wanted to follow up on some of the questions that we didn’t get a chance to explore and answer during the Great Research Thinking webinar hosted by Revelation in July.
Q: What do you learn from the face-to-face ethnography as compared to the online study?
A: We find Immersive Research – an online, activity-based approach really useful to get a deep understanding of how people feel and think about a particular topic. Because we spend more time with them, they have time to reflect on their own attitudes, behaviours and ideas, often coming to interesting and insightful revelations on their own. Online platforms are also fantastic for learning about something that takes place over time – days, weeks, months - which is very expensive to replicate using ethnography.
In our work, we spend a lot of time thinking about user journeys and systems of interactions and connection points and we still find it difficult to get a clear read on this using online platforms only. Participants can only report and document behavior that they’re aware of so it’s incredibly helpful to be able to watch them complete a set of tasks. We usually start this learning online and deepen it when we’re in the field.
Q: Were the experts you spoke to during the BRR project case study you presented engaged in person, online or over the phone?
A: When we engage experts to help stimulate our own thinking, we engage them in whatever way is most convenient for them. Some we spoke to by phone or Skype and others we met in person. We don’t usually engage experts using online platforms as they have very limited time to spend with us and we tend to get the best insight from them when we’re engaged directly in conversation and/or show + tell.
Q: How do you manage/mine the tremendous amount of data generated from multiple weeks online followed by ethnographic fieldwork?
A: When we first started using online research tools, we definitely made the “more is more” mistake. We still battle this on every project because we’re a curious bunch and it’s so easy to ask more, add one more activity tack on a few more days to explore this really interesting bit…
But in most cases more isn’t more, it’s just more. So, we’re really rigorous in our project and research design and think about how we’re going to analyze the data generated by each phase, activity and question from the outset. We also schedule analysis and downloading time throughout the project so we’re thinking with the data as we go, rather than have it to pile up to be dug into and dealt with at the end. This can be very overwhelming.
And although we’re really rigorous about our project and research design, we do build in time and budget for what we call “rabbit holes”. You just never know what surprises are lurking about on discovery-based projects and it’s important for us to have the time and means to explore the unexpected. This is often where the juiciest insights and opportunities lie waiting.
Q: You talked about posting content from the digital environment to your physical project space. Do/how do you package this as a deliverable for your clients?
A: The content and artifacts that find their way into our physical project space aren’t packaged as a deliverable for clients per se. However, we do design the project space and populate it so that we can use the contents as stimulus for some of the divergent thinking and co-creation work we do with clients at different stages of the project. It’s also incredibly helpful for the project team to be “steeped” in the data throughout the project. It’s critical for pattern recognition, collaborative thinking and concept development.
Q: You could spend endless time analyzing all of this data. How do you know when it’s time to stop analyzing and start synthesizing and reporting?
A: Truthfully, it’s usually the project timeline that dictates when we stop! We schedule analysis time throughout the project and our analysis/synthesis is quite iterative. When it feels like that iterative process isn’t generating new insights and ideas, we know we’re ready to move onto reporting or concept/prototype development.
Q: To what extent do your clients participate in reviewing and commenting on the raw data? Do they have an appetite for this level of engagement in the data?
A: We actually insist that our clients dig into some of the raw data with us and build this into the project design. They usually do this in a few ways…
(1) We strongly encourage clients to do some reading while we’re online. In our experience, the client teams that get the most out of BRR actively schedule reading time throughout the online study;
(2) We strongly encourage them to come in the field with us; and
(3) We immerse them in curated data when they join us in our project space for ideation and collaboration work sessions. We design these sessions so they have time to browse and interact with the data so we can use it to think and create together.
Q: Have you found that clients want to eliminate face-to-face “in-context” time with online research?
A: No, not really. Sometimes we don’t think “in-context” research is required so we’ll recommend online only. But most of our projects benefit from a more integrated approach because BRR creates incremental value that is so much greater than 1 + 1 = 2. A BRR approach really does deliver a 1 + 1 = 5 level of insight. Our research design is very purposeful and we take the time to educate our clients on our recommended approach and why/how it will deliver the learning we need.
Q: What are the time and costs associated with planning and implementing a BRR project like the one you presented?
A: A full Research + Concepting project that includes BRR tends to take at least 3 months, more depending on the complexity of the challenge and the number of markets we need to learn in. And cost, well, it really depends. Let’s say more than $100,000 and less than $1,000,000!
Q: Does the BRR approach work for projects with much shorter timelines (2-4 weeks)?
A: In our experience, it’s difficult to integrate digital and analog methods and have time to learn and leverage the various phases to maximum effect in less than a month. The smallest scale BRR projects we do tend to take 6-8 weeks. We’ve actually never had a client come to us and expect turn-around in 2 weeks.
Q: How do you determine which projects are a good fit for BRR?
A: We ask two key questions when we’re designing the research phase of our projects: (1) what can we get people to do for us digitally; and (2) what do we want to do with them in context? If the answer is “nothing” to either of those questions, a BRR approach probably isn’t appropriate. We are finding, however, that most of our Research + Concepting work includes a Blended Reality ResearchTM approach.
Q: Do you find that access to and comfort with digital world skews to a particular demographic? How do you accommodate groups who have limited access to digital technology?
A: Using online platforms and digital capture tools is not always appropriate. There are some populations that simply don’t have access. If we need to learn from and work with a group that has limited access to digital technology, our research design reflects this. However, we have done online studies with people of all ages and from a variety of backgrounds. In our experience, as long as someone is using email and able to attach a picture or document to an email message, they are usually able to participate in one of our online studies.
Q: Do the participants you engage normally participate in online studies? Or do you have to recruit people who are familiar with online tools/platforms?
A: Not at all. Many of the people we recruit for the online portion of our BRR projects have never participated in an activity-based online study before. They love being able to do it on their own time and most really enjoy being asked to think creatively in a way that is rarely asked of them. They also appreciate the “deep listening” we do when we’re with them online. We read every word and probe and ask for follow up so they feel acknowledged and heard.
Q: How did/do you keep the participants engaged over the span of the project?
A: You can not communicate too much. When a participant has been accepted into one of our online studies, they are emailed right away by the Project Manager to welcome them to the project. Within the first 24 hours of the online study launching, every single participant is contacted by the Researcher who will be reading and responding to their work. All participants receive a daily email from their assigned Researcher that provides thanks and kudos on the previous day’s work and advises what is expected of them that day. We think of ourselves as cheerleaders and coaches as much as researchers. We want participants to feel our presence online and to feel appreciated and acknowledged. It can sometimes feel like overkill on our end, but the more we communicate and congratulate and actively moderate, the better the learning and level of engagement is.
Q: Do you ever do larger online samples to get more quantitative data to support the qualitative learning?
A: No, we don’t. Our focus is qualitative research, though we will sometimes work with a client’s existing quant partner (or one that we recommend) to determine the size and strength of the various opportunities that have been identified by our qualitative Research work and Concepting that emerges from it.
Q: Packaging is a very physical type of innovation. Do you have examples where you’ve applied this BRR approach to more conceptual types of innovation?
A: Absolutely. We have used BRR in Research + Concepting projects that have led to brand/positioning concept development and service and/or experience design concepts.
If you have any further questions about Blended Reality Research TM and how it might help you tackle your most pressing curiosities, please get in touch. We can be reached in Toronto at +1-416-531-7222 or at karen.ward@curiosityinc.com
Take the leap ... Find out how Actvities Can Improve Your Online Research
Posted August 10th 2011 by Kristie Conner
Why is an Activity-Based approach to research considered such a leap from traditional approaches? And why do activities work so well for online research?
Traditionally, qualitative market research has been divided into two main types of research: interview or question-based research (focus groups, in-depth interviews, etc.) and observational research (ethnography). An interviewer asks questions and follows up with probes. An ethnographer will observe people engaged in their natural behaviors in their natural settings. Both of these approaches are optimal for in-person, real-time research, and work quite well when a skilled researcher is present.
However, these traditional approaches lose much of their efficacy in online and mobile media, when a researcher is not immediately present. Observation can be clumsy via online, and the dynamic interaction of a live interview can be hard to replicate over the Internet, even with video interviewing.
Yet for researchers interested in being able to access consumers at key moments of decision, purchase, usage and perception, online and mobile media offer huge advantages. Today’s technology extends the potential reach of all forms of research in an unprecedented way. But to reap the full benefits of online research, we need to adapt our methods and start looking beyond questions and observations.
This is where an Activity-Based approach to research comes in, adapting the methodology to the technology. Activities can be diaries and journals, projective exercises, mini-documentaries, representational photography, personification exercises and countless other possibilities. They can be used to explore behaviors, experiences and emotions.
Designing great activities is both art and science. Often the simplest are the most powerful and effective. We use three criteria for defining great online research activities:
-Engaging to participants
-Enable researchers to get to the heart of a research objective
-Produce compelling deliverable
The switch from a question-based mindset to an activity-based one can be a challenging leap. But when it clicks—when researchers recognize the full potential of the deliverables and understand that online research requires a different approach—the power of Immersive Activity-based research becomes readily apparent.
In the coming months, Revelation will be making it significantly easier for researchers to make the leap. Stay tuned!
Blended Reality Research: Bringing Online and Real World Methods Together for Insight and Innovation
Posted July 27th 2011 by Kristie Conner
The blog post below has been written by Karen Ward of Curiosity Inc. Karen is going to be presenting the topic below in our Great Research Thinking webinar tomorrow, July 28.
Blended Reality ResearchTM: Bringing Online and Real World Methods Together for Insight and Innovation
We’ve been working and learning with Revelation and a variety of other online research platforms over the past 5 years. This surprises some of our clients who know us as a research and innovation company that is positively evangelistic about the power and importance of in-context, ethnographic research.
However, as our lived experiences as individuals are becoming more “blended”, so too must our research methods and tools as practitioners. And with the dramatic improvement of online platforms and digital capture tools, there has never been a better time to embrace what we call Blended Reality Research.
In the early days of our online research adventures, we primarily used online platforms like Revelation to administer “online homework” assignments leading up to our ethnographic field visits, thus replacing the physical homework assignments that we would previously send out to our participants.
This worked well as it gave us an opportunity to review and probe the responses to the online homework in advance of our ethnographic work, which made for much richer learning once we got in field. It also gave us the opportunity to build rapport with participants before we met them in person and that led to more openness and intimacy.
In the spirit of full disclosure, it must be said that while we had early success with online platforms, we also made a lot of mistakes. The most significant of the many was trying replicate what we were used to doing in a analog way in an online, digital environment. We did a lot of “failing forward” as we figured out how to best leverage what digital tools and online platforms made possible.
As a result of our ongoing experimentation with online tools and unwavering commitment to in-context discovery, we developed an approach and practice called Blended Reality Research (BRR). And on many levels, it’s as simple as it sounds. BRR weaves together digital learning platforms and tools with context-based discovery, collaboration and co-creation in physical environments. When we are designing a Blended Reality Research project, we ask ourselves 2 key questions:
1. What can we get participants to do for us and report back on digitally?
2. What would we like to do with them in context?
As much of our project work involves the development of new product and service concepts, we like to do mapping and sketching work with participants to help us understand event sequences, emotional journeys and relationships between objects, systems, etc. We still find that this kind of discovery and co-creation work is best done with low-tech tools like Sharpie markers and some of our paper-based tools in a physical environment. Similarly, a 3-hour in-context discovery session with 6-8 people is not a substitute for a national, 2-week online study where you have deep and daily contact with a larger group of participants.
For us, it’s not a question of online or in-context. The richest insight and innovation opportunities are surfaced when we take an integrated or “blended” approach to designing research and concepting projects. When we think deeply about what the various online and offline tools and methods in our kit can bring to a project, our learning and the experience we provide to our participants and clients gets better.
If you’d like to know more about our Blended Reality Research approach and how it comes to life in practice, please join us for our webinar on July 28 at 12:00pm ET/9:00am PT.
By Karen Ward, Curiosity Inc
Getting to the Heart of Emotions
Posted July 6th 2011 by Steve August
If we think about a consumer experience around a product or brand, we can divide it into three distinct layers: Behaviors, Context and Emotions.
Revelation’s Activity-Based approach can help you get at each of these layers, and today I’m going to focus on Emotions.
Emotions are the subtext to consumer experiences. If we can read the emotions, we can crystallize understanding of how people relate to their world. Some good Emotional activities are:
- Image metaphors
- Personification
- Storytelling
Emotions are often extremely difficult to put into words. As Gerald Zaltman described in “How Customers Think,” using images as vehicles for metaphors are a powerful way to help people access their emotions. A simple metaphor activity might ask participants to post an image that represents a particular product, brand, service or life event, and then describe why they chose that image. The simple combination of picture and description often creates a powerful response.
In personification activities, participants are asked to describe a series of events from the perspective of the product or object, rather than their own perspective. An example of a personification activity is asking participants to describe a day in the life of their computer from their computer’s point of view. This seemingly small twist often elicits strong emotional content, as participants tend to transfer their emotions on to the object.
Storytelling can also be a powerful conduit to deeper emotions. The key is how you set up the exercise. A good example of setting up a storytelling exercise is to introduce with the sentence, “Tell me about a time when you were surprised by…”
Activities: The Beginning of the Conversation
These are just a few examples of activities that can get participants to open up in surprising and effective ways. Of course, the activity itself is just the start of the conversation. Once a participant opens up through the activity, there is ample opportunity to probe for more depth and clarity.
Revelation fully supports the activities described above. Best of all, you can find examples in our Activity Library – at your fingertips as you build your project. Contact us to get started!
Tips for Creating Great Research Activities!
Posted July 6th 2011 by Rachel
Revelation Project, our Immersive Research platform, is designed to help our clients get deep insights by using an Activity-Based approach. Within Revelation Project, researchers have access to our Activity Library, which is a collection of online activities designed to unlock elusive Aha! Moments.
Below are some quick tips for getting started!
1. When our clients first start a study, we recommend that they take time to get to know the participants and do an introduction activity. At Revelation we call this a Warm-up or Welcome activity. The Activity Library offers some great examples that you can copy into your project.
A good Warm-up/Welcome activity should include the following:
- Clearly lay out what is expected of participants throughout the project
- Confirm incentive amounts and payments
- Provide an opportunity to introduce yourself
- Give respondents an opportunity to tell you a little about themselves and insure they are able to use the technology
2. Keep each activity short.
For both technology and methodology reasons, we recommend short activities.
- Completion rates are stronger in projects that have short activities
- Break longer assignments up into multiple shorter activities
- From a technology perspective, short activities ensure participant data is uploaded to the site successfully
3. Video assignments
Video assignments can be labor-intensive for the participant and the researcher. Below are tips for improving activities with video assignments.
- Consider asking for multiple short videos instead of one long video
- Provide clear guidelines for each video
These tips will help keep the activity focused and short, which benefits the participants when creating and uploading videos. This also is beneficial for the researcher when it comes to organizing, analyzing and reporting on the videos.
To learn more about our Activity Library click here. If you have not attended a demo we have weekly product demos on Wednesday’s at 10 AM. To register click here.
Immerse Yourself! The Five Characteristics of Immersive Research
Posted June 28th 2011 by Kristie Conner
Immerse Yourself! That is our theme for the summer and we'd like to help you get more actionable insight from your customers. How? With our Immersive Research platform.
Revelation's specialty is Immersive Research™. Immersive Research draws from a number of offline methodologies – ethnography, contextual inquiry and blends them in an online environment. Like traditional contextual methods, the goal of Immersive Research is to capture participant experiences and behaviors as they happen, and make those experiences meaningful in the context of a business question.
Below we've highlighted the five characteristics of Immersive Research:
1. Online
Immersive Research is a framework for in-depth online qualitative research, and the impact of being online manifests in two important ways. First, it gives researchers the ability to simultaneously capture the experiences an behaviors of a large number of geographically dispersed participants – something that would be extraordinarily expensive to execute via offline methods.
Because the research occurs online it enables any person within an organization, from product and marketing managers to CEOs, to access the data generated by an immersive research study. In this way, entire organizations could be immersed in the experiences of their customers.
2. Primary interaction is individual
Immersive Research, like the offline methods it draws inspiration from, is on an individual basis. Participants capture their experiences through diaries (online/mobile), videos, photos and other tools. Researchers can aggregate participant experiences both by individual and the group interaction.
Due to the ease of including both individual and group interaction in the online environment, there may be group interactions that support the individual interactions.
3. Captures experiences, behaviors and emotions as they happen
Like ethnography, Immersive Research seeks to capture the behavioral and emotional moments in context as those moments happen. However, a big difference between ethnography and Immersive Research is that Immersive Research tends to rely almost entirely on a participant self-reporting, whereas observation is the very heart of ethnography.
Like ethnography, Immersive Research can produce two different data types. The recording of behaviors, occurrences, purchases, etc … often generates volumes of structured data delineating the what, where, when and why. On the other hand, the emotions and attitudes that accompany behaviors often generate open-ended text responses that need to be coded. The presence of both of these data types is a strong indicator of Immersive Research.
4. Sustained interactions
Another important aspect of Immersive Research is that interactions with participants are sustained long enough to capture applicable behaviors. Spending time with participants over time is an important part of capturing the natural rhythm of participant experiences. Whether it’s over the course of days, weeks or even months depends on how often experiences of interest tend to occur during the course of participants’ everyday lives.
5. Rich media
Perhaps the most powerful part of the Immersive Research experience is the ability to literally see through the eyes of the participants. The use of digital images or video to record behaviors and experiences let participants tell their stories with a richness that text descriptions simply cannot match. On occasion, images posted by participants can simultaneously capture both the behaviors and the heart of the emotion underlying the behavior. The use of rich media by participants to convey their experiences goes a long way in creating a sense of immersion in participants’ lives.
Helping Clients understand the “White Space”
Immersive Research is a great methodology for understanding the “white space” of customer experiences. The understanding generated by Immersive Research studies can provide fuel for creative efforts for new products, services and messaging.
Online qualitative research has been predominantly rooted in the focus group framework and text-based bulletin boards and chats; Immersive Research is marked by the adaptation of in-depth qualitative frameworks. By fully utilizing the latest technologies, hundreds of customer stories are at the fingertips of researchers.
Are you ready to get started? Want to find out if Revelation’s Immersive Research can help you get in-the-moment with your consumers -- email us at sales@revelationglobal.com ? If you have never used Revelation Project, we recommend that you attend our weekly product demo to register click here.
Making Sense of Context by Steve August
Posted June 9th 2011 by Steve August
If we think about a consumer experience around a product or brand, we can divide it into three distinct layers: Behaviors, Context and Emotions.
Revelation’s Activity-Based approach can help you get at each of these layers, and today I’m going to focus on Behaviors. Behaviors represent what actually happen, what consumers do.
But behaviors don’t exist in a vacuum. Behaviors occur within the context of people’s lives; their processes, beliefs, environments and day-to-day life. Contextual activities fill in the backdrop to which behaviors occur. Contextual activities include:
- Tours
- Show Me’s
- “Getting to know you’s”
- Deprivations
“Tours” tend to focus on physical environments, like the refrigerator example above. They can use photos or videos to bring to life the physical context of a particular behavior.
“Show Me’s” concentrate on understanding how people do the thing they do. They often have people describe step by step their process for accomplishing something. How someone does their laundry or makes their coffee would be good examples of “Show Me” activities.
“Getting to Know You’s” focus on learning more about the participants themselves as part of the context for understanding their behaviors and emotions. They make good warm up activities as well.
“Deprivations” are a powerful way to understand what a product or services means to a consumer. In a deprivation activity, the researcher instructs the participant to go for a prescribed duration without using the product or service and records the impact. An example of a deprivation activity would be to ask consumers to go a day without using their mobile phones.
Revelation fully supports the Contextual activities described above. Best of all, you can find examples in our Activity Library – at your fingertips as you build your project.
Contact us to get started!
Getting to the Heart of Consumer Behaviors: Digging Deeper Into Diaries
Posted May 11th 2011 by Steve August
If we think about a consumer experience around a product or brand, we can divide it into three distinct layers: Behaviors, Context and Emotions.
Revelation’s Activity-Based approach will help you get at each of these layers. Today I’m going to focus on Behaviors. Behaviors represent what actually happen, what consumers actually do. They are impacted by the Context (environments, processes, life events) in which they occur and are often driven by underlying Emotions. In Immersive Research, when we want to capture what consumer behavior actually happens, our go-to Activities are diaries.
We’ve done a lot of thinking about diaries and there are actually four types of diaries:
- Usage diaries
- Spotter diaries
- Process/Purchase diaries
- Behavior diaries
Each of these types of diaries captures different aspects of consumer behaviors. Let’s dig into these a bit deeper.
Usage diaries focus on how a consumer interacts with a particular object: a phone, a piece of software, an appliance, and food or beverages (consumption is a type of use). You could even say a diary of a day at an amusement park would be a usage diary on how the consumer is using the park. With usage diaries, the data capture is around the moment of use, the what, when, where, why, and specifics of the use. If a product has multiple types of uses, i.e. a smart phone, then you’ll want to capture the dimensions of the use that are pertinent to your research question.
Spotter diaries focus on capturing people’s encounters with things out in the world: brands, categories, foods, advertising, etc. In this case the diary is less about behaviors per se, but more about understanding the presence of things in a person’s life.
Process/purchase diaries focus on things that often evolve over time versus around a specific use: the rhythm of laundry in a household, preparing a tax return, buying a car. Often when someone makes a significant purchase decision, they go through a process: they’ll research, talk to their friends, see ads, and go to stores. It unfolds over time and you need the whole narrative to understand the behaviors.
Behavior diaries are more open-ended explorations and may not be focused on a particular object, category or process. They do tend to focus on a topic, for example hair care over the course of a week or month. A hair care diary could encompass tools, consumables, and going to a salon or barber. The goal is to get the whole picture of consumer behaviors around the topic.
Revelation supports all four types of diaries and you can find examples in our Activity Library. For any of these kinds of diaries, you can use media in the form of photos and videos (though photos tend to be much more efficient), closed ended questions that Revelation will tabulate and open ended text. And of course, we offer mobile diaries for iPhone (Android coming soon!) integrated via Revelation Mobile.
Capturing consumer behaviors in the moment they occur has never been more within your reach!
Celebrating Earth Day with Online Market Research
Posted April 20th 2011 by Kat Gomm
Earth Day began in the United States back in 1970 when gas guzzling V8 sedans, water and air polluting factories and toxic dumps were the norm. By 1990 Earth Day went global, mobilizing 200 million people in 141 countries and lifting environmental issues onto the world stage and Earth Day became the modern environmental movement worldwide. A lot has been done since 1970 and there are still many things we as a society and people can do to help take better care of Mother Earth.
In honor of Earth Day, April 22nd, we would like to share our Avoided Carbon Calculator. We teamed up with Portland-based sustainability consulting firm Fluid Market Strategies to answer the question: are there environmental benefits to using of Revelation’s Immersive Online software?
What we learned was by clients using Revelation’s online immersive research vs. traditional in-person focus groups we averted 2.5 times less gas emissions than if the studies were conducted in the traditional method. What does that equate to? It would be equivalent to cancelling two business trips via plane, not consuming 96 cheeseburgers, or avoiding 9 business trips (roughly 1.1K miles) via car.
To read the complete report and learn more on how you, your company and clients, can help contribute to a cleaner, healthier environment too, please click here.
Here’s to taking better care of Mother Earth! Happy Earth Day!
The Revelation Team
Fully Immersed: Using Activities to Capture Consumer Behaviors, Context and Emotion
Posted April 13th 2011 by Steve August
Immersive Research is a framework for online research that seeks to capture consumer experiences in context as they occur. Research Activities are the key to making Immersive Research work in the online and mobile medium. In this post, I will describe how to leverage an Activity-Based Approach to reveal the different layers of consumer experiences.
If we think about a consumer experience around a product or brand, we can divide it into three distinct layers:
- Behavior
- Context
- Emotion
Ok, let’s try to make this more tangible. Here’s an example of someone preparing dinner for themselves and a friend.
Behavior represents actions:
“I used my phone to text my friend at 4:30 to arrange dinner at 7:30. I was at the store and picked up food to prep, I stopped at this store since it’s on my way home and has the best quality. ”
Context represents the backdrop for the action, often environments:
“I have a small apartment, and an even smaller kitchen, so I have to arrange my space carefully, and can only have one or two friends over at a time.”
Emotion represents the underlying motivations and subtexts:
“I use this old flour sifter. It actually doesn’t work very well, but it was my grandmother’s and I feel connected to her. I stick with some of the food brands I use because I feel a connection to them – they are things I remember growing up. “
In Immersive Research, we can unlock the full dimension of the consumer experience by matching specific types of activities to the different layers of behavior, context and emotion.
Behavioral activities typically are diaries and journals. They can be set up to capture the various specifics of moments of behaviors, consumption, and usage.
Context activities are often photo or video tours and “show me’s” that capture environments, processes and show how an action fits in to people’s lives.
Emotion activities are often creative projective exercises that can be as simple as letter writing, or use imagery and metaphors to get deeper emotions.
By layering behavior, context and emotion activities together, you can develop a deep understanding of consumer experience; this is the kind of understanding that can move a business forward.
Now here’s the best part. Revelation’s Activity Library provides you with a myriad of examples of diaries and journals, tours, “show me’s” and creative projective exercises. Activity Library gives you a jump start so you can quickly and easily create powerful Immersive Research studies that give you the kind of understanding that can truly move you forward.
Get in touch to get started!
Five Reasons To Attend Our Upcoming Webinar
Posted March 22nd 2011 by Kristie Conner
Five Reasons To Attend Our Upcoming Webinar “How To Use Online Panels To Recruit For Online Qual Studies”
Revelation's webinars are designed to be educational and informative. It is important to Revelation that we always strive to share timely, relevant information that can help our clients! Below are five reasons we think you should definitely attend our upcoming webinar.
#1: Elizabeth MacLaughlin and Kevin Lewis. Both are industry experts that have a passion for sharing knowledge and helping their clients get the most out of their research studies!
#2: Because of their passion for sharing knowledge and helping clients. You’ll hear real-world benefits of using online panelists for online research studies from two people who are in the field helping people launch projects.
#3: Tips and Tricks. Experts always have the inside knowledge that they’ve learned along the way. During this 45 minute webinar you’ll get to hear some tips and tricks that can save you time and help you with your online recruitment for online studies.
#4: Manage road bumps … when doing something new one often runs into road bumps. During this webinar we will highlight potential road bumps and how to manage through them.
#5: Benefits of Online Recruitment for Online Studies. Learn about the benefits of choosing online recruitment for online studies.
We look forward to all your questions and thoughts on Thursday, March 24th. To register click here.