The maths is the easy part

Let’s start with the uncomfortable truth. Most people who ask for a piece of research or analysis already know what they want it to say.

That may be an uncomfortable place to start, but it is based on our experience at HEU and Kaleidoscope. Someone has already decided on a direction. They have committed to a transformation, promised a saving, launched a programme. And now they would like some clever data to confirm that the thing they have already chosen was the right thing to choose.

It is a bit like a barrister calling you as an expert witness. The barrister knows what they want you to say before you take the stand, and you have to decide if you are going to play your part. This is not an individual taking a flawed approach; it is a system doing exactly what it was built to do.

The programme gets changed, the transformation is mandated. Then the leader is told to pull £90 million pounds out of their organisation, and prove it worked. Of course they come looking for evidence that it actually did. What choice do they have?  The pressure to justify the decision after the fact is built in, all the way up the chain.

The barrister in our story did not choose to be a barrister. We made them one.

So the first question our team asks is not about method. It is about purpose. What do you plan to do with it? Who is it for? Will the decision actually change on the basis of this evidence? If the answer is no, why are we doing the work at all?

That is the defining point.

If a leader can tell you, before they see the analysis, that if the answer is X they will do one thing and if it is Y they will do another, you are on the right path. That is the curiosity of leadership, the humility of informed decision-making. But if every possible answer will ultimately lead to the same action, you have not commissioned evidence, you have commissioned reassurance.

Spend time on the question

It is tempting and very common to spend about 99% per cent of time on the data and one per cent on the research question. It should be the other way around.

The maths is the easy part. Nobody loses sleep over the methods. Together, we have all the expertise covered. Kaleidoscope brings the qualitative researchers and engagement specialists; HEU brings the analysts, data scientists and econometricians who can go toe to toe with anyone on the data. What is hard, what actually determines whether the work changes anything, is the question. What are we really asking? Why are we asking it? Who benefits from each possible answer? We ask the same question five different ways before we start, because the wrong question means nothing downstream can rescue it.

So if you want more than data, if you want genuine insight, you have to start with the right research question. This is the most scientific thing we do. It is the first step, and it is the foundation of outcomes research. Treat the work as data monitoring and you will get exactly what you pay for: a precise answer to a question nobody checked was worth asking.

Publish everything, especially the uncomfortable parts

The other thing we do at HEU is publish, whatever the answer.

That changes the incentives in the room. If we tell you the answer is X and you decide to do Y, that is your call. You are the decision-maker and it lands with you. But the work will be public. And once it is public, you have to justify why you went the other way.

Some of what we find is uncomfortable. The HEU’s work with Marie Curie showed that one in six people die in poverty. The HEU work with Leukaemia UK showed that the most deprived populations get the worst access and the worst care. None of that is comfortable reading inside an NHS organisation. But it is out there, and discomfort is often the price of impact.

Kaleidoscope gets to the same place by a different route. When you build the evidence with the people who will have to act on it, rather than handing them a finished report, the awkward finding is already in the room. It is much harder to shelve a conclusion you and your team helped reach.

Rapid is fine. Wrong is not.

A quick word on speed, because everyone wants things to be rapid. Rapid should be proportionate to the size of the question. If an integrated care board is deciding how to spend a £120 million on inequalities, you do not want the answer in a fortnight. The scale of the decision sets the time the work deserves.

And the moment quality drops to hit an artificial deadline, trust goes. Trust is not a nice-to-have in this work. Trust is the whole relationship. Be wrong once, because someone gave you two days for a two-month question, and you will never be trusted with the big decisions again. So sometimes the most useful thing we can offer a leader is a respectful no.

We have told commissioners, in writing, that the budget on the table would not buy the credible answer they were asking for, and that a smaller budget would mean a smaller, weaker piece of work rather than the same work done cheaper. That conversation is uncomfortable. It is also the point at which a client learns they can trust you.

And it takes courage

None of this is easy, and most of it cuts against the grain. The system rewards people for doing as they are told and feeding good news back up the chain. It does not reward sticking your head above the parapet.

So turning insight into impact takes more than good analysts. It takes leaders brave enough to be curious, and brave enough to act when the answer is not the one they hoped for.

Why we talk about this openly

Which is exactly why Kaleidoscope put this on as a conversation at Confed in June this year. A courageous discussion between three colleagues working at different parts of the insight to impact pathway, asking what it really takes for great insights to make a difference to decisions.

Kaleidoscope is a social enterprise that exists to bring people together to improve health and care. Our work blends rigour with human connection, because we have watched too many projects that sounded brilliant in the room change nothing on the ward. The difference between insight that sits on a shelf and insight that shifts something is rarely the data. It is almost always the process. How the question was framed. Who was in the room. Whether anyone was genuinely prepared to be wrong.

So, the question we would leave every leader with is, are you prepared to lose the argument before you have seen it? Because if you are not, you were never commissioning insight. You were commissioning applause.