Sharing the learning at evidence and evaluation ‘Train the Trainer’ day

On 27 September 2017, the West of England AHSN and NIHR CLAHRC West ran a ‘Train the Trainer’ day to share resources and experience of running the workshops – ‘Finding the Evidence’ and ‘Getting Started with Service Evaluation’.

142 NHS commissioning staff across the West of England have attended these workshops since March 2016, reporting changes in evidence use and evaluation activity as a direct result.

Interest and demand from outside the West of England led to the development of this ‘Train the Trainer’ day, where 12 places were offered nationally via the CLAHRC and AHSN networks. The day was attended by staff from two CLAHRCs, four AHSNs and one Clinical Commissioning Group, all of whom are considering creating their own evidence and evaluation training programme.

The training team shared a host of prototype resources which consisted of a slide deck for each of the workshops, as well as instructive tutorial videos to be used as part of a face-to-face workshop, as preparatory material, or as stand-alone learning aids. The videos included:

  • Show me the evidence: the why and how of finding and using evidence
  • An online tour of the Evidence and Evaluation Toolkits
  • How do I get started with searching for evidence?
  • What is evaluation and why is it important?
  • How to plan my evaluation using the 5-step evaluation cycle
  • Different approaches to collecting data in an evaluation

Feedback was very positive, with delegates commenting that the online resources were “informative, creative and engaging…I will definitely use in delivering training myself” and that the day itself was “completely relevant and very useful”.

As a result of this successful event, the training team will complete the suite of on-line ‘Train the Trainer’ resources for national launch in January 2017 to strengthen the culture for evidence-informed practice across the health community.

For further information, contact Jo Bangoura j.bangoura@nhs.net

New evidence-informed case studies

How do I get started with an evaluation?
Where do I look for evidence?
What difference will it make anyway?

If you are new to service evaluation or don’t have experience of searching for evidence you may be wondering the answers to these questions. Don’t scratch around – learn from what other people have done!

Together with NIHR CLAHRC West, we have collected case studies from a variety of sources to demonstrate how evidence reviews and evaluations can lead to improved patient safety, cost savings, enhanced efficiency and policy changes.

For example, you could learn how Bristol Clinical Commissioning Group (CCG) has made a potential saving of £100,000 per year across Bristol, North Somerset and South Gloucestershire. Or how Swindon CCG has influenced antibiotic prescribing behaviour within the out-of-hours GP setting.

Check out the full list of case studies here.

More tips and resources on how to complete your own service evaluation or evidence review can be found on the NHS Evaluation Works and Evidence Works toolkits.

Developing a shared approach to evaluation in the West

How can we meet the call for more appropriate and robust evaluation? How do we generate more rigorous and relevant evidence? These were some of the questions explored by more than 30 people with an interest in evaluation, including commissioners, researchers and the public, at a workshop in December organised by the West of England Evaluation Strategy Group.

The interactive workshop explored the principles of pragmatic evaluation, and was led by Dr Peter Brindle, Leader for Commissioning Evidence Informed Care at the West of England AHSN and Evaluation Lead at the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care West (NIHR CLAHRC West).

It was jointly organised by CLAHRC West, West of England AHSN, Avon Primary Care Research Collaborative (APCRC) and Bristol Health Partners.

Peter set the scene of the workshop as a chance to learn, listen and discuss the opportunities and challenges for evaluation. He was clear that this was the beginning of a collaborative effort to create a shared common vision, strategy and, especially, an action plan for evaluation in the West of England with the potential for collaboration with similar initiatives across the country. He went on to provide his own reflections on why Evaluation is important, the barriers to evaluation and some of solutions going forward, explaining that we need to: “Choose the right tool for the job whether it is quality improvement, evaluation or research.”

The key note speaker for the day was Professor Jo Rycroft-Malone, Director of the National Institute for Health Research (NIHR) Health Services and Delivery Research (HS&DR) Programme.  Jo described some of the challenges, opportunities and implications of pragmatic evaluation for the Programme. These included the implication for research methods, the need to agree what is ‘good enough’ evaluation, how to bridge the gap between those knowing and those doing, and what the rules of engagement are.

Lunch was followed by round table discussions on the following topics:

  • How do we best involve patients, carers and the public in evaluation?
  • How do we ensure that evaluation is of value to health and social care?
  • How do we build a culture of evaluation?
  • How do we create an ethical approach to evaluation?
  • How do we make the trade-off between rigour and relevance?

These table sessions inspired a broad range of discussions and reflections as well as a chance to share good practice and innovative ideas and solutions. These sessions were fed back to the room for further discussion. Themes emerging included the need for:

  • genuine and early co-production in evaluation
  • good early evaluation planning with all the right stakeholders and information
  • development of capacity, skills and understanding of evaluation
  • both rigorous and relevant evaluations.

There was also interest in the Researcher-in-Residence model being driven by Martin Marshall at University College London, Peter Brindle through his work at the Avon Primary Care Research Collaborative and Lesley Wye at the University of Bristol. This was acknowledged as an excellent way of bridging the ‘know-do’ gap and supporting putting evidence into practice.

The final step involved participants making a commitment to action as a result of the workshop discussions, whether something they personally intended to do or that they would take back to their organisation. A large number of actions were pledged and these will be pulled together and followed up in the coming weeks. Examples include:

I am going to “lobby for equal status of evaluation and research”

I am going to “ensure evaluation is embedded in transformation at the outset”

I am going to develop a “key guidance sheet”

Dr Peter Brindle said: “I feel that the event has helped to create an energetic and supportive community of action in the West of England to overcome the barriers to integrating evaluation into service change and innovation.”

The organisers would like to say a big thank you to all those who participated for their excellent contributions and commitment to actions to help drive this agenda forward.

The full workshop and evaluation report is being pulled together and will be available in the coming weeks. This report will be used to inform the future vision, strategy and action plan for evaluation across the West of England.

For more information or to get involved contact Jo Bangoura, Evaluation and Commissioning Lead on j.bangoura@nhs.net.