Work / Merit America

Learning Systems Evaluation

From scattered signals to one view of the service.

Service Design· Research & Synthesis· Data Analysis

Merit America's career program is a service. Learners move through it, coaches guide it, and a dozen systems quietly record every step. I treated it that way: working alongside the coaches, I read the whole journey across 300+ learners and pulled outcomes, engagement, and coaching into one picture leadership could act on.

Method · signal triangulation

The problem

Nobody could see the whole journey.

Merit America was making high-stakes calls about learner success without a map of the service delivering it.

The signals that mattered sat in different places, Salesforce records, learner surveys, and coaches' own observations, so no one could see where the journey lost people, or step in before it did.

300+ learners across multiple cohorts

My role

Connecting frontstage to backstage.

I led the research and synthesis. With the coaches as frontstage partners, I built the interview guides and surveys, ran the qualitative interviews, and pulled the quantitative data out of Salesforce.

Then I stitched the lived experience and the system data into a single narrative, the kind leadership could read in one sitting and act on the next morning.

The process

Triangulating the journey.

No single source told the truth on its own, so I read them against each other.

1

Align

Stakeholder interviews to agree on the questions that actually mattered to the program, before gathering a single data point.

2

Gather

Structured surveys with learners, 1:1 interviews with coaches across cohorts, and cleaned quantitative data from Salesforce.

3

Triangulate

Read side by side, the three streams surfaced patterns no single source could: where the journey held, and where it slipped.

Key findings

The moments that decided it.

Weeks 1–3
Attendance in the first three weeks was the single strongest signal of who would finish. The service's earliest touchpoints set everything that followed.
2×
Learners who felt a sense of community were twice as likely to complete. Belonging is part of the service, not a byproduct of it.
Check-ins
Coaches who ran a structured check-in ritual saw consistently better retention. The frontstage moment was the intervention.

Outcomes

From insight to redesign.

Leadership took the findings straight into the service. The early weeks got a new intervention protocol, aimed at the exact touchpoints where the journey was quietly failing people.

Coaches were retrained around the check-in rituals that worked. Cohort outcomes measurably improved, and the work fed Merit America's wider organizational growth strategy.

Early-intervention protocol Coach training redesign Program design decisions

Next project

Language Service Design

View all work