Using a dark logic model to explore adverse effects in audit and feedback A qualitative study of gaming in colonoscopy

Funded by

The Health Foundation Logo

10 December 2021

Published journal: BMJ Quality and Safety

Abstract

Background

 Audit and feedback (A&F) interventions improve patient care but may result in unintended consequences. To evaluate plausible harms and maximise benefits, theorisation using logic models can be useful. We aimed to explore the adverse effects of colonoscopy A&F using a feedback intervention theory (FIT) dark logic model before the National Endoscopy Database Automated Performance Reports to Improve Quality Outcomes Trial study.

Methods

We undertook a qualitative study exploring A&F practices in colonoscopy. Interviews were undertaken with endoscopists from six English National Health Service endoscopy centres, purposively sampled for professional background and experience. A thematic framework analysis was performed, mapping paradoxical effects and harms using FIT and the theory of planned behaviour.

Results 

Data saturation was achieved on the 19th participant, with participants from nursing, surgical and medical backgrounds and a median of 7 years' experience.When performance was below aspirational targets participants were falsely reassured by social comparisons. Participants described confidence as a requirement for colonoscopy. Negative feedback without a plan to improve risked reducing confidence and impeding performance (cognitive interference). Unmet targets increased anxiety and prompted participants to question messages' motives and consider gaming.Participants described inaccurate documentation of subjective measures, including patient comfort, to achieve targets perceived as important. Participants described causing harm from persevering to complete procedures despite patient discomfort and removing insignificant polyps to improve detection rates without benefiting the patient.

Conclusion

Our dark logic model highlighted that A&F interventions may create both desired and adverse effects. Without a priori theorisation evaluations may disregard potential harms. In colonoscopy, improved patient experience measures may reduce harm. To address cognitive interference the motivation of feedback to support improvement should always be clear, with plans targeting specific behaviours and offering face-to-face support for confidence.

Citation 

Catlow J, Bhardwaj-Gosling R, Sharp L, Rutter MD, Sniehotta FF. Using a dark logic model to explore adverse effects in audit and feedback: a qualitative study of gaming in colonoscopy. BMJ Qual Saf. 2021.

You might also like...

Blog

Data-driven tools in health and care

Blog

Ellen Coughlan reflects on a recent workshop, exploring key questions about how to develop...

Blog

Five recommendations for strengthening NHS management and leadership

Blog

With the Messenger review nearing publication, we draw on our recent research – including interviews...

Blog

Working as a GP through the pandemic: using online tools as part of a hybrid model of care to meet the needs of patients and staff

Blog

Dr Minal Bakhai reflects on how the recent IAU study of patients at general practices using digital...

Kjell-bubble-diagramArtboard 101 copy

Get social

Nurses trained outside the UK have long played a vital role in delivering NHS services. This week's data from… https://t.co/LB82AZrCpF

Follow us on Twitter
Kjell-bubble-diagramArtboard 101

Work with us

We look for talented and passionate individuals as everyone at the Health Foundation has an important role to play.

View current vacancies
Artboard 101 copy 2

The Q community

Q is an initiative connecting people with improvement expertise across the UK.

Find out more