Categories
(part of Chapter 8: Managing the Agency)
Though it is easy to jump to conclusions at any sign of trouble, the important thing to remember is that both you and your agency are working towards the ultimate success of your project. That said, there are legitimate issues that may arise.
Luckily, most issues have reasonable solutions—and an experienced researcher will help you navigate them. Read on to learn about legitimate red flags versus project paranoia.
Now that the project is underway, and your budget is deeply invested, you will be very sensitive to any signs of trouble. That’s fine, but understand that custom research is complex. It’s important to stay calm and assess situations rationally. Still, sometimes things will happen and you will wonder, “Is this a problem? Should I escalate?” Some examples and guidelines are shown in Table 8.3.
Table 8.3 Determining Red Flags | |
Red flag | Legitimate concern? |
Questionnaire design process is behind schedule by more than two days |
No: Not if your team has been changing direction about priorities and scope during the design process. Yes: If you, the client, has stayed true to original objectives and your hypotheses were clearly laid out. A delay in this case might indicate the agency is overbooked. |
Questionnaire drafts are coming in with seemingly irrelevant content or poor construction |
No: Not if the agency is using a specific indirect method. For example, there are certain ways of constructing questions such that the most objective data can be gathered. Sometimes it might seem indirect—but there is a reason. For example, let’s take the example of a project on brand preferences. Instead of asking people what they think of Brand X, we might ask what they think of Brands X, Y, and Z. Do we care about Y and Z? Maybe not. But we don’t want to tip our hand to the participant that we do care about X. This is a simple example, but hopefully demonstrates why you might find a question off point. It might, in fact, be a good choice. Yes: If the draft reveals a clear lack of understanding about the topic, ask about it. If you feel that a survey taker would find the flow confusing, ask about it. If brand names are misspelled or other sloppy work is evident, escalate it. |
Data collection process is behind schedule by more than three days |
No: Not a real red flag if a legitimate roadblock has come up. Examples of common, legitimate issues: (a) you provided your own list, and it is not performing well; (b) you are collecting data in a country that is experiencing a political event, labor strike, national holiday, or other disruptive event. Yes: If the agency had at least a week prior to data collection beginning with your approval on screening criteria and quotas, this could be a legitimate red flag. Ask about it. There could be a valid explanation, but it is worth asking. |
At a midpoint progress meeting, you feel the project team is unprepared or distracted |
Possible: This can be a very legitimate red flag. Are they showing up to important meetings ill-prepared? Unable to answer questions on the fly? That suggests they are overbooked. If you feel that the resources assigned to your project are not being given adequate time, escalate it. It is perfectly fine to remind the agency that you hired it with the understanding that it would adequately staff your project—and that you now feel this is not happening. |
You find errors or suspicious data in a memo or report |
Possible: If you find any data suspicious at all, ask about it immediately. Most likely, the data were not labeled clearly (such that you were unable to interpret correctly). Professional research firms have QA processes that really do minimize the chance of data errors. Still, it happens, and if you feel at all uncomfortable or suspicious about data you see, you should immediately identify the specific data points and calmly ask for clarification. Don’t risk antagonizing the hard-working researcher by overreacting; chances are, there is a logical explanation. |
The agency is unable to send you a draft of the final presentation three days prior to the in-person presentation of findings |
Very likely. If your project includes a final presentation upon conclusion, the agency will have been working on it for at least a week prior to delivery, and more likely for two weeks (especially for large projects). Will it be 100 percent complete three days before the presentation? Not necessarily, but it should be at least 80 percent complete. Very often, the last few days are spent polishing and editing, so the agency should at least be able to send you the management summary or some subsections. And you should ask for it. The last thing you want is to find out—too late—that the agency rushed to pull together a haphazard presentation. Let it know you will want to see it at least three days before, and it should be able to comply. If it can’t comply, escalate the issue. An experienced researcher will not expect to reveal a research study’s results to your internal clients without having given you ample opportunity to preview it.
|
In all of these cases, an important premise is that you and your agency are working together towards a common goal: the project’s ultimate success. So even if you do see legitimate red flags, the best approach is to be reasonable; ask for an explanation, and ask for options to resolve the problem. Even if the agency did make a mistake—and it does happen—there will likely be very viable solutions.
This is an excerpt from the book, "How to Hire & Manage Market Research Agencies," which is available on Amazon. Published by Research Rockstar LLC. Copyright © by Kathryn Korostoff. All rights reserved.
Sign Up for
Updates
Get content that matters, written by top insights industry experts, delivered right to your inbox.