Opens in a new tab
Back to Blog

Attribution, not causation: what alumni interviews can actually tell you

Two benchmarked career-outcome lines converge with several alumni interview speech bubbles at a central evidence point.

Suppose your alumni are progressing into leadership positions faster than comparable peers.

Or they are more likely to work in research-intensive sectors.

Or they are more likely to remain in your country, state or province.

Those are meaningful differences.

They are correlations.

But the numbers leave an important question unanswered:

Why?

Let the quantitative findings shape the interviews

That is where alumni interviews become particularly valuable.

If you conduct the quantitative analysis first, you can use the findings to decide what the interviews need to explore.

Instead of asking alumni broadly whether the organization helped their careers, you can ask questions designed to uncover explanations for the differences you have already observed.

That turns the interviews from a collection of success stories into a way of investigating how the organization helped shape the outcomes in the data.

Suppose the data show faster progression into leadership.

The interview can skip unfocused fishing questions such as:

Did this organization help your career?

A more useful line of inquiry is:

Think about the responsibilities you had while doing your research. Were there experiences that helped prepare you to manage projects or people later in your career?

Open-ended follow-up questions can then explore what happened, when it happened and whether the alumnus still draws on that experience.

If the quantitative analysis instead shows an unusual concentration of alumni in technology businesses, the questions change.

You might explore whether alumni developed specialized technical knowledge, learned to work with complex equipment or data, became comfortable solving poorly defined problems, or gained experience translating research into practical applications.

If the observed difference is geographic retention, you might explore the professional networks alumni developed, the opportunities they became aware of, and how their research experience influenced where they chose to build their careers.

The quantitative findings tell you where to look. The interviews help you investigate what explains them.

Look for mechanisms, not endorsements

The most useful interview finding is not:

Alumni liked using your organization’s facilities to do research.

It is an explanation of how an experience could help produce an observed outcome.

In our experience, research organizations can provide formative experiences that help students and postdocs develop skills in:

  • project management
  • adaptability
  • communication
  • collaboration
  • specialized technical work
  • leadership
  • interdisciplinary work
  • difficult real-world problem solving

They may also give early-career researchers significant responsibility, expose them to career possibilities they had not previously considered, or connect them with professional networks that continue to matter later in their careers.

Those are the kinds of mechanisms the interviews can uncover.

They become more informative when they recur independently across interviews.

Imagine that the quantitative analysis finds faster movement into management.

Alumni from different disciplines and career paths might repeatedly describe having to coordinate complicated projects, adapt when plans failed, work across disciplines, and explain highly technical work to different audiences.

Now the two kinds of evidence connect.

You have observed a difference in career outcomes, and you have identified recurring experiences that help explain it.

That is the foundation for attribution.

Attribution asks what role the organization played

Career outcomes rarely have one cause.

Education matters. Previous experience matters. Individual ability and ambition matter. Employers and colleagues matter. Economic circumstances and opportunities matter.

A research organization is one part of that story.

Attribution asks:

What role did our organization play in producing the outcomes we observe?

When recurring explanations from alumni help explain differences already observed in the quantitative evidence, the case for attribution becomes stronger.

The two kinds of evidence have different jobs

The quantitative evidence tells you what is different.

The interviews help you understand why it is different.

Together, they allow a research organization to move beyond:

Our alumni have successful careers.

toward a considerably more useful argument:

Our alumni show particular career outcomes when compared with similar people, and the experiences alumni describe provide credible explanations for how our organization helped produce those differences.

That is a more defensible way to talk about impact.

Want to see how benchmarked findings and alumni evidence come together? See a sample Alumni Analyzer report.