Lessons and limitations
We learnt a number of lessons from carrying out this project. Firstly, we found personal interactions with HBC staff to explain our interventions to be more effective than putting up posters and sticker reminders, emphasising the importance of good staff communication in quality improvement. By attending the handovers and promoting the loyalty card scheme we were able to emphasise the importance of confirming that VTE score had been assessed on EPR and demonstrate how to do so if individuals were unsure. Moreover, by talking to staff we were able to identify their issues with the interventions and address any concerns they had.
We felt that our loyalty card scheme worked well to highlight our campaign and generate interest, without taking away what was being achieved already - the assessment of patients. Introducing the EPR system to staff who were not familiar with it and interacting with the team as a whole is an established practise for any system change in the NHS.
Through discussion with staff we found the the largest barrier to be the lack of integration between the IT systems on the HBC. Staff now had to complete VTE assessment on EPR as well as BadgerNet, so it was difficult to implement a change when it required duplication of work. To reinforce this finding, data collection and quantification of the problems surrounding VTE assessment on EPR would have improved and strengthened our project. Maintaining the effect of an intervention was also a challenge, as seen by the drops in our run chart (see figure 2). Although we promoted the magnetic dot system on the board and the loyalty cards scheme for a week, the shear breadth of the HBC staff roster inevitably meant that not all healthcare professionals were informed of the interventions happening. Over time enthusiasm wanes and it is difficult to change routine.
Although the direct impact of our interventions, particularly our reward scheme, may lessen over time, overall the project greatly raised awareness regarding VTE assessment and the importance of its correct documentation for patient safety, and we hope that this in itself will lead to sustainable improvement. Our PDSA cycles involved lots of training interventions which were well received by staff, generating discussions and providing important continuous learning. Through discussions with staff we recognised the IT issues and empathised with their frustrations, feeding back suggestions such as including an ‘intra-partum’ column on the VTE assessment form and trying to integrate the BadgerNet and EPR systems for efficiency.
In terms of sustainability, the magnets remain on the HBC whiteboard and are still being used by the midwives in-charge. The stickers and posters we placed on the department also remain in place and the loyalty card scheme will continue until all cards have been used up. All staff will continue to have education and reminders on completing VTE assessment on EPR because it remains a vital area of improvement with the 95% target not yet achieved.
Furthermore, the hospital trust is looking at implementing a system where VTE assessment on EPR will be mandatory before any prophylaxis can be prescribed. In the meantime, the three doctors who supervised this project remain in the department and are able to both oversee the continuation of our changes and continue raising awareness of the importance of correctly completing assessments.
To further enhance sustainability, we are looking into nominating an individual/group of individuals (ie, the obstetric senior house officer or midwife in-charge) to oversee and promote the interventions on their shifts. We feel that this would be particularly effective with with regards to the magnetic dot system, because during this initiative there was some confusion over whose responsibility it was to update the board. Ideally, we would like to continue to collect data in the future in order to assess the sustainability of our interventions. Alternatively, this project could be continued by a new team of medical students when they rotate into the department next year, and further interventions could be trialled to build upon our work.
We anticipate the push to improve VTE scoring on EPR to continue due to the clinical importance of VTE prevention and hope that the issues we identified with staff will be resolved. Although we did not reach our target of 95%, we have shown a vast improvement from baseline measurements.
There were a number of limitations with our project and data collection methods. Although we collected data over three consecutive dates to monitor our interventions at the end of each cycle, continuous data collection daily throughout the project would have strengthened our findings and eliminated any bias. The data would have been more representative and excluded fluctuations in normal variance over project period. Furthermore, because we always collected our data on a Wednesday, Thursday, and Friday for continuity, continuous data collection would have excluded any bias on those days and allowed us to see if our improvements were maintained over the weekend. A full week was excluded from our data analysis due to the to the junior doctors' strike - a decision influenced by the fact that we felt results would have been skewed by additional stress on the department due to reduced staffing levels. Additionally as formal statistical analysis was not undertaken, there is a possibility that our results could have been due to chance.
Another limitation of our data collection when we were recording whether the VTE score assessment was completed on EPR we only took a ‘snap-shot’ when auditing and checked at 5:00pm. However, HBC has a high patient turnover and VTE assessment needs to be completed within 24 hours; therefore, looking at one-time point may not be entirely representative and an under-estimation. This could have been improved by also recording whether VTE assessment had been completed for postnatal patients who had been admitted in that 24 hour period. However, any patient sent home within those time limits (for example spontaneous vaginal delivery in a well woman, discharged six hours later) would have been missed. We also did not check for patient overlap day to day, although the high turnover on HBC means that this should be minimal and it is unlikely to have had a significant impact on results.
In hindsight, there were many improvements we could have made, particularly to our methods of data collection, that would have strengthened our project. We also recognise that the problems we discovered regarding recording VTE assessment on EPR are intrinsic to GSTT and may not be directly applicable to other trusts. Despite this, we feel we have had a significant impact on VTE assessment documentation rates, and we hope that we, and readers of this paper, will be able to take what we have learnt from this reflection and apply it to future projects. Improving VTE assessment rates is an important issue for all trusts, and we hope that applying similar, if not identical, have an impact elsewhere. We hope in particular that our project has proved the importance of raising awareness and staff education in successful quality improvement.