Implementation outcomes indicate whether implementation is moving in the right direction and where, and how, it can be improved. They are stepping stones towards the final outcomes that we hope an approach will improve (e.g. attainment or behaviour). Implementation outcomes include adoption (whether people are using the new approach), fidelity (whether they are using it as intended), sustainment (is it maintained over the long-term).
There is a gap for further explanation of these implementation outcomes, understanding how they relate to each other and fit in the implementation process, examples of how they can be measured, and implementation strategies that would help improve an implementation outcome.
We explain each of the implementation outcomes in more detail than in guidance report, that includes ways to think about them wth examples. See EEF Guidance Report page 32 for more information about implementation outcomes.
The diagram below shows …. You can click on each to see…..
How to measure implementation outcomes
In the following we provide examples to show schools might measure each implementation outcome.
Put a link here to click on for advice, e.g. how to measure adoption, how to improve feasibility (strategies). Have two examples of measures for each, a looser/school-led example (possibly qualitative) and a more specific tangible/existing measure example for each. Present this as how a hypothetical (or actual) school measured the outcome. Elsewhere we will need a way in for those simply looking for how to measure, without the overview of all the outcomes.
Need to signal that this should be planned early.
Alongside this we will also have some examples of implementation strategies to use to improve the implementation outcome having measured it. Again, it could be presented as how the hypothetical school improved their outcomes. This will cross reference other resources on implementation strategies we are producing (see next).
Intended Use Implementation leaders who are planning data monitoring. Also examples to refer to in training that give practice related examples.
Implementation outcomes relationship
Watch the video below to hear how implementation outcomes relate to each other and where they might loosely fit in the implementation process.
Holding space for the one further resource.
The video talks about how it is not simply the case that improving more/all implementation outcomes improves final outcomes, but implementation outcomes are key at different stages and inform each other. This also introduces the idea of implementation outcomes as a stepping stone to intervention/final outcomes.
But needs to have reach as outcome, not intervention knowledge (intervention knowledge should be referred to as needed for a range of these in resource A above).
Consider intervention effectiveness as a filter – after all you might have better final outcomes with low fidelity if the intervention does not fit.
Need to also consider that these outcomes might be a cause to return to actual “explore work”.
Consider do you need fidelity to sustain? Are acceptability and feasibility views about an intervention being implemented? Remember implementation outcomes is fairly new, so try to keep it as simple as possible. Consider knowing core components as key to fidelity and could be added?
Intended Use – For anyone interested in implementation in schools. To supplement training both related to implementation outcomes and phases, to go further than guidance report and to complement other resources.