When a Survey Isn’t Enough: What Stakeholder Interviews Can Reveal

One of the practices of conscious leadership is recognising when we do not yet understand enough to make a good decision.

There are times when an organisation knows it needs to understand something, but reaches too quickly for a survey.

Surveys are useful. They can tell us how many people think something, how frequently something occurs, whether one group responds differently from another, or how attitudes change over time.

But sometimes the most important question is not how many? It is why?

Why are people disengaging from a programme that appears successful on paper?

Why do staff keep describing the same organisational frustration even though the process has been redesigned?

Why are some communities not using a service that was created for them?

Why does the data tell us one thing while people’s lived experience appears to tell us another?

Those are often questions that need conversation before they need measurement.

What stakeholder interviews can reveal

A good qualitative interview is not simply a survey conducted aloud, it allows someone to describe an experience in their own terms, including the contradictions, context and unexpected detail that we may not have thought to ask about.

The researcher can notice something interesting and follow it.

Can you tell me more about that?

What was happening when that changed?

You used the word “unsafe”. What did unsafe mean in that situation?

Sometimes one seemingly incidental comment changes the direction of an entire enquiry.

That is one of the great strengths of qualitative research: it can surface what the organisation did not yet know it needed to know.

Surveys work best when you already understand the question

Quantitative and qualitative research are not competing methods.

They answer different kinds of questions.

Broadly, quantitative research is powerful when we want to understand the size, frequency or distribution of something. Qualitative research is particularly useful when we need to understand experience, meaning, context or the processes producing what we can observe.

Current research guidance makes a similar distinction: qualitative approaches are particularly valuable when an issue or audience is not yet well understood, when emotional or contextual nuance matters, and when an organisation needs to explore a problem before attempting to measure it.

Sometimes qualitative research comes before a survey.

A series of stakeholder interviews might reveal the language people naturally use, the issues that matter to them and the assumptions an organisation has been making. A later survey can then test how widespread those experiences are.

Sometimes it comes after.

Perhaps a staff survey shows a fall in trust, or service data shows that one group is dropping out disproportionately. Interviews can help us understand what sits behind the numbers.

And sometimes qualitative research is sufficient in its own right, particularly when the purpose is not to estimate prevalence but to understand lived experience deeply enough to inform a decision.

The danger of asking only the questions we already know

There is another reason I am drawn to qualitative research. Research design is never entirely neutral. The questions we ask reflect what we already think matters. If an organisation creates a survey containing twenty predetermined questions and five predetermined answer options, it has already defined the territory in which the respondent is allowed to speak.

That may be entirely appropriate. But sometimes it means we repeatedly hear answers to our questions, while missing the question somebody else would have asked. This becomes especially important when working with communities whose experiences have historically been poorly represented in institutional decision-making.

Lived-experience research can reveal a different map of the problem, and sometimes what emerges is uncomfortable.

The service that looks accessible may not feel accessible.

The intervention designed to help may inadvertently create another burden.

The organisational change that looked logical from the centre may have very different consequences at the edges.

None of this means that one interview represents everybody.

Qualitative research has its own limitations, and rigorous work requires clarity about who participated, who did not, how themes were identified and what conclusions the evidence can reasonably support.

But it can reveal something extraordinarily valuable: how people actually experience the systems we create.

Five situations where I would consider stakeholder interviews

I would seriously consider qualitative stakeholder interviews when:

1. You know something is happening, but not why.

   
   

   The quantitative data shows a pattern, but not the forces producing it.

2. The subject is complex or emotionally nuanced.

   
   

   Experiences involving identity, trust, belonging, health, organisational culture or relationships are often difficult to compress into tick boxes.

3. You do not yet know the right questions to ask.

   
   

   Exploratory interviews can help identify themes before a larger piece of research is designed.

4. Different groups experience the same system differently.

   
   

   Interviews allow those differences to remain visible rather than averaging them away.

5. A decision will affect people whose perspectives have not yet shaped it.

   
   

   This is where stakeholder and lived-experience research can become particularly valuable.

6. 
   

Start with the decision, not the method

Perhaps the most useful question is therefore not:

Should we do interviews or a survey?

It is:

What are we trying to understand, and what decision will this research need to inform?

From there we can ask what kind of evidence is actually needed, sometimes that will be a survey, sometimes a handful of carefully designed conversations will reveal far more.

Often the strongest research combines several forms of evidence: existing data, literature, interviews, workshops, surveys or other participatory methods.

The method should follow the enquiry.

Not the other way around.

At She Changes, my commissioned research work uses qualitative methods to help organisations, public bodies and purpose-led organisations understand stakeholder experience, lived experience, organisational questions and issues that cannot be adequately understood through numbers alone.

Find Out More Here