Article Text
Abstract
Background Improving timely access in primary care is a continued challenge in many countries. We used positive deviance to try and identify best practices for achieving timely access in our primary care organisation in Toronto, Canada.
Methods Semistructured interviews were used to identify practice strategies used by physicians who successfully maintained a low third next available appointment (TNA) (positive deviants, n=6). We then conducted a cross-sectional survey to understand the prevalence of identified promising practices among all physicians (n=70) in the practice. We used χ2 testing to understand whether uptake of promising practices among survey respondents was different for those with a median TNA of 7 days or less vs a median TNA over 7 days.
Results We identified seven promising practice strategies used by positive deviants: adjusting the appointment template based on demand; reviewing the appointment schedule in advance; max-packing of visits; using phone, email and secure messaging; customising care for complex patients; managing planned absences; and involving the interprofessional team. 65 of 70 physicians responded to the survey on promising practices. Uptake of the promising practices was variable among survey respondents. In general, we found no association between uptake of promising practices and median TNA. One exception was that those with a median TNA of 7 or less were more likely to review the schedule in advance to potentially mitigate a visit using phone/email (62% vs 31%, p=0.0159).
Conclusion Promising practices used by a small group of physicians (‘positive deviants’) to maintain good access were generally not associated with timely access among a larger sample of physicians in the practice. Our findings highlight the difficulty of untangling physician practice style and its contribution to timely access in primary care.
- general practice
- primary care
- quality improvement
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information. De-identified participant data is available on request from the corresponding author.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Introduction
Timely access is critical to achieving first contact and continuous care—two of the four pillars of primary care defined by Barbara Starfield three decades ago.1 Yet timely access remains a challenge in many countries, including both Canada and the USA, where only 41% and 48% of patients, respectively, report they could see their primary care provider on the same day or the next day when sick and needing care.2 Experts suggest that the problem is not lack of system capacity but rather system design.3 The Advanced access philosophy was considered a promising strategy to improve timely access,4 but real-world implementation has been difficult and improvements in wait-times modest.5
For the last few years, our large primary care organisation has tried to measure and improve access to booked physician appointments as part of a broader strategy to improve timely access. We have routinely collected and fed back to individual physicians their third next available appointment (TNA), a common and accepted measure of timely access in primary care.6 7 The TNA is the number of calendar days from the time a patient requests an appointment with a physician to the third open appointment in the schedule. It captures the patient perspective of delay when seeking an appointment. The third open appointment is seen as a more reliable measure of system availability than the first or second as the latter may be related to a last-minute cancellation or other unpredictable event. In addition to reporting TNA, we offered physicians personalised coaching to improve using elements of the advanced access philosophy. Despite these efforts, we noted a persistently large variation in TNA between physicians. We also found no relationship between TNA and panel size, time in clinic or the ratio of panel size to time in the clinic, suggesting physician practice style was a critical driver of access.8
We sought to take a fresh approach to improving timely access in our primary care organisation using positive deviance. Positive deviance seeks to identify individuals, organisations and communities that have exceptionally good performance and learn from and spread their approaches.9 Positive deviance has its roots in public health, but its application in healthcare quality is relatively new and untested in primary care.10 We aimed to identify practice strategies used by family physicians who successfully maintained timely access to booked physician appointments and test whether these strategies were correlated with timely access among all family physicians in the organisation.
Methods
Setting and context
The St. Michael’s Academic Family Health Team is a primary care organisation that serves over 49 000 enrolled patients at six clinics in downtown Toronto, Canada. At the time of study, the team included 70 staff physicians, 40 resident physicians and over 60 non-physician health professionals. Since 2015, TNA has been collected biweekly through manual audit of staff physicians’ appointment schedule with individual measures fed back to staff physicians in real time via email. Day of collection is rotated and data are maintained in a Microsoft Access database. Between May 2016 and April 2017, the mean TNA for staff physicians was 10.5 days (n=74, SD=10.3, range=0–74). The mean roster size was 577 patients and staff averaged 5.5 days in clinic. At the time of the initiative, patients could book clinic appointments by phone or in person.
Study design
We used a mixed-methods approach based on the positive deviance methodology outlined by Lawton and colleagues10 (figure 1). The term ‘positive deviance’ was first coined in public health and defined as ‘the observation that in most settings a few at risk individuals follow uncommon, beneficial practices and consequently experience better outcomes than their neighbours who share similar risks’. Public health programmes have historically used this approach to identify and spread beneficial practices in a community to, for example, improve the nutritional status of children. More recently, the positive deviance approach has been used successfully in healthcare to drive improvements on topics ranging from hand hygiene11 to care for people with diabetes.12 At its core, positive deviance hinges on systematically identifying individuals, teams or organisations with exemplary performance, learning from their practices and context, and then spreading what was learnt to others.10 The premise is that solutions to complex problems lie within the tacit knowledge and wisdom of the clinical communities where the problem exists rather than with managers or policy makers.
The first step in the methodology is to identify the positive deviants—individuals, teams or organisations with exemplary performance. These positive deviants are then studied using in-depth qualitative methods to generate hypotheses about potential practices that lead to high performance. Next, the hypotheses are tested among a larger, representative sample. Finally, the newly identified best practices are spread. We adapted this approach for our primary care setting: we identified physicians with consistently low TNA (positive deviants). We used semistructured individual interviews to identify promising practices related to the low TNA. We conducted a cross-sectional survey among family physicians in the group to understand uptake of these promising practices. Finally, we correlated whether there was a correlation between the promising practices and TNA.
Identification of positive deviants
We identified six staff physicians with consistently low TNA in the year prior to September 2016 (positive deviants; median annual TNA ranged from 2 to 5). We aimed to identify individuals with diversity in clinical site, size of practice, time in clinic, age and gender.
Semistructured interviews to identify promising practice strategies
We asked physicians in our organisation identified as positive deviants to participate in semistructured qualitative interviews and all agreed. All physicians were interviewed between September 2016 and January 2017 by the lead author (MDR), a practising physician in the department. The interview probed for strategies used to maintain timely access to booked appointments, use of specific strategies such as adoption of e-communication and use of the interprofessional team, and barriers to maintaining timely access. The interview also probed for a sense of provider values regarding access. The interviewer used handwritten notes to record responses, which were transcribed into typed format following the interview. The study team used thematic analysis13 to analyse responses iteratively coding the data and then identifying themes and related practice strategies.
Cross-sectional survey to understand physician practice patterns
We developed a survey to assess the prevalence of promising practices identified in the semistructured interviews and physician attitudes towards timely access (online supplemental appendix 1). The survey was hosted on Qualtrics and administered via email to all staff physicians (n=70) in April 2017. Staff physicians received a unique survey link and up to two individual reminders over a 6-week period. We conducted a descriptive analysis of survey data to understand the proportion of physicians reporting they never, rarely, sometimes, often or always used a strategy. All surveys were included in the analysis.
Supplemental material
Correlation of promising practices with physician TNA
We calculated physicians’ median TNA during the period from May 2016 to April 2017. We then performed two types of analyses to assess the association between adoption of promising practices and physicians’ median TNA. In the first analysis, we stratified physicians using TNA quintiles (quintile 1=lowest median TNA; quintile 5=highest median TNA). For each TNA quintile, we calculated the proportion of physicians who reported always or often using a practice strategy and looked for crude associations. Due to small cells, we did not assess for statistical significance when data were stratified by TNA quintiles.
The second analysis dichotomised physicians based on whether their median TNA was (1) 7 days or less or (2) over 7 days. For each group, we calculated the proportion of physicians who reported always or often using a practice strategy. We then used χ2 testing (and Fischer’s exact test for cell size <5) to assess whether observed differences were statistically significant. All analyses were conducted in SAS V.9.
Patient and public involvement
Our team’s focus on improving timely access was driven by feedback from our patient experience survey. Although patients were not involved in the design or conduct of this study, we will be sharing and discussing our findings with our patient partners to inform future work in our practice to improve access.
Results
Semistructured interviews with positive deviants
We interviewed six physicians with consistently low TNA (‘positive deviants’). Interviews revealed seven themes and related practice strategies used to support timely access to booked appointments: (1) adjusting the appointment template based on demand; (2) reviewing the appointment schedule in advance; (3) max-packing of visits; (4) using phone, email or secure messaging; (5) customising care for complex patients; (6) managing planned absences; and (7) involving the interprofessional team (table 1).
The following strategies were used by most or all of the positive deviants. First, most positive deviants noted that they would add new appointment slots based on when their reported TNA increased. Second, all had approaches for managing planned absences, including informing patients in advance of their absence, ensuring appropriate coverage through practice sharing or collaborating with clerical staff to limit non-urgent appointments (eg, routine diabetes reviews, well-baby visits and period health visits) until a week or two after their return to clinic. Finally, most collaborated with non-physician team members to improve timely access, deliberately sharing the care to free up time in their own schedule.
Interviews also revealed some differences in approaches to maintaining timely access. Some began their day as early as possible to maximise their availability, while others mentioned that it was important to have administrative time at the start of the day to deal with urgent issues. Some physicians identified electronic communication with patients (email or secure messaging) as an important tool for providing care, even when outside of the office, while others felt that this strategy was not required (or desired) to support timely access.
Cross-sectional survey to understand physician practice patterns
Sixty five of seventy staff physicians (93%) responded to the survey assessing practice patterns. Among respondents, the average years since graduation was 17.1 years (median=13 years) and 62% were female.
Most physicians reported always or often using strategies related to max-packing, use of faxed prescription renewals, spreading clinics across the week to maximise availability, use of proactive preventative health manoeuvres within an opportunistic visit and involving the interdisciplinary team for immunisations (table 1). There was variation in most other areas of practice.
The association between practice strategies and TNA quintile is summarised in figure 2. Stratified analysis did not show higher uptake of strategies in quintile 1 (median TNA=3 days) compared with quintile 5 (median TNA=15 days) with three exceptions. Compared with TNA quintile 5, more physicians in TNA quintile one reported adjusting their clinic schedule based on TNA (31% vs 15%), adjusting the number of same/next-day slots based on demand (31% vs 15%) and reviewing the schedule in advance to potentially mitigate a visit using phone or email (69% vs 39%).
Results were similar when physicians were dichotomised by TNA. There were no statistically significant differences in best practice uptake with one exception: those with a median TNA of 7 or less were more likely to review the schedule in advance to potentially mitigate a visit using phone or email (62% vs 31%, p=0.0159) compared with those with a TNA of less than 7 (online supplemental appendix 2).
Supplemental material
Discussion
We identified several practice strategies used by a small number of physicians who successfully maintained relatively short waits for booked appointments—our positive deviants. Promising practice strategies included adjusting the appointment template based on demand, reviewing the appointment schedule in advance, max-packing of visits, using phone, email or secure messaging, customising care for complex patients, managing planned absences and involving the interprofessional team. However, empiric testing in a larger sample of physicians in our practice found that there was, in general, no difference in the uptake of these strategies among physicians with longer versus shorter waits for booked appointments as measured by median TNA.
The promising practice strategies we identified from positive deviants are consistent with those recommended by quality improvement experts as approaches to improve timely access and are consistent with principles used in advanced access to have supply of appointments meet demand.14 This consistency is not surprising, given our practices efforts to educate physicians about advanced access in the years prior to the study. Our cross-sectional study design may partly explain why we found no association between uptake of the strategies and TNA quintile. It is possible that physicians with high TNA have seen an improvement in their waits over time with adoption of the strategies—something we were not able to assess. Our study also only focused on understanding reasons behind physician variation, and it is possible that timeliness would be more consistently improved by more systematically involving clerical staff in improvement efforts.
We did find a correlation between TNA and three practice strategies. Physicians with lower median TNA were more likely to adjust their schedule based on TNA and adjust their same/next-day slots based on patient demand. This correlation was not statistically significant but may reflect the value of TNA feedback for physicians who accept and use the feedback. Physicians with lower median TNA were more likely to use telephone or email to mitigate an office visit. This finding is consistent with research from other jurisdictions noting improvements in timely access with adoption of e-communication.15 16 Prior to COVID-19, e-communication between physicians and patients was relatively uncommon in Canada despite its appeal to patients,17 and practice and policy changes are needed to further increase and sustain their use.
Our study has several strengths. We used a unique approach—positive deviance—to identify practical strategies physicians could adopt to improve timely access. We had a high response rate to our physician survey and were able to leverage routine collection of TNA in our practice setting, a unique data holding. However, our study also has limitations. First, we relied on physicians to self-report practice strategies. Second, our study was observational and cross-sectional and so cannot infer causation; physicians with higher TNA may have used some of the identified strategies to improve over time. Third, our study was conducted in a large interprofessional primary care organisation engaged in improving timely access for a few years; the setting may limit generalisability of some findings (eg, promising practices) but not our positive deviance approach. Finally, our study relied on TNA as a measure of access to booked physician appointments—a measure accepted in the literature but sometimes questioned by physicians in our organisation.
Our findings highlight the variation in individual physician practice, even within a single organisation, and the known challenge of improving timely access to booked physician appointments. Although we identified several promising strategies used by positive deviants, physician practice style may be too complex to break down into component parts. Instead, we are now trialling mentorship by positive deviants, allowing physicians to choose mentors that most closely reflect their own practice style. We are also working to strengthen the building blocks for achieving access including engaged leadership, data-driven improvement and team-based care.18 Our survey of physicians revealed variation within and across our clinics in how physicians collaborate with other health professionals to share the care—a known strategy to improve access.19 Finally, we recognise the inherent limitations of TNA as a measure of access and have now moved to collecting and confidentially reporting physician-level indicators of access from our patient experience survey.
Conclusion
We used positive deviance to identify promising practice strategies among physicians who consistently maintained timely access to booked appointments as measured by TNA. These promising practice strategies were consistent with known expert advice but were generally not associated with timely access among a larger sample of physicians in the practice. Our results reflect the difficulty of untangling physician practice style and its contribution to timely access in primary care.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information. De-identified participant data is available on request from the corresponding author.
Ethics statements
Patient consent for publication
Ethics approval
This initiative was formally reviewed by institutional authorities at St. Michael’s Hospital and deemed to neither require research ethics board approval nor written informed consent from participants.
Acknowledgments
We thank Amy McDougall for her contributions to data collection and insights; Chris Meaney and Rahim Moineddin for their statistical advice; and our colleagues who participated in this initiative and strive to make our clinics more accessible.
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Twitter @tara_kiran
Contributors All authors conceived of the initiative, designed the study, were involved in data collection, and interpreted the findings. SD conducted the quantitative analysis. MDR and TK wrote the first draft of the manuscript and all authors critically reviewed it. All authors read and approved the final manuscript.
Funding This study received no direct funding. TK is supported as a clinician scientist by the Department of Family and Community Medicine at the University of Toronto and at St. Michael’s Hospital. She is the Fidani Chair in Improvement and Innovation at the University of Toronto. At the time of writing, she was also supported by the Canadian Institutes of Health Research and Health Quality Ontario as an embedded clinician researcher. The opinions, results and conclusions reported in this article are those of the authors and are independent from the funding sources.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.