Article Text

Download PDFPDF

Improving patient portal enrolment in an academic resident continuity clinic: quality improvement made simple
  1. Courtney Rhudy1,
  2. Jane Broxterman1,
  3. Sara Stewart2,
  4. Victoria Weaver2,
  5. Cheryl Gibson2,
  6. Caylin Shankweiler1,
  7. Branden Comfort1,
  8. Becky Lowry1
  1. 1 Department of General Internal Medicine, The University of Kansas Medical Center, Kansas City, Kansas, USA
  2. 2 Department of Internal Medicine, University of Kansas Medical Center, Kansas City, Kansas, USA
  1. Correspondence to Dr Courtney Rhudy, Department of General Internal Medicine, The University of Kansas Medical Center, Kansas City, Kansas, USA; crhudy{at}


Electronic health record patient portal usage has been associated with improvement in chronic disease parameters, patient functional status and patient satisfaction. Our institution’s patient portal is a secure, online health management tool that connects patients to portions of their electronic health record.

Our quality improvement project aimed to increase patient portal enrolment significantly in our Internal Medicine resident patient panels.

This study was conducted in a large, multisite health system in Kansas City, Kansas that serves a diverse patient population. Our clinic includes 65 resident patient panels. We followed a subset of 16 resident patient panels in this quality improvement project. A baseline audit showed that 35% of the 1628 patients in these panels were enrolled in the patient portal system. A standardised, nurse-initiated portal sign-up process following patient rooming was implemented. Initial results indicated a 9.6% increase in patient portal sign-up at the end of the first 4-week cycle. We then implemented educational sessions for our clinic nurses as well as attending physicians, and achieved a 15.1% increase from baseline to the end of the second 4-week cycle, resulting in 86 patient portal activations (p<0.01).

Resident physicians worked with clinic nurse partners in two formats for this project. Nurses assigned to patient rooming for residents during the clinic sessions being studied (rooming nurses) initiated the portal sign-up process. Nurses assigned to partner with the resident for longitudinal patient care management, anchor nurses, worked with residents on items such as phone messages or portal messages. Semi-structured interviews of the four anchor nurses aligned with the 16 residents were conducted at the end of the study and revealed that nursing staff perceived increased patient portal activity to be associated with a decrease in nursing workload and an increase in patient engagement.

  • ambulatory care
  • quality improvement
  • patient satisfaction

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See:

Statistics from


A frequent challenge faced in resident continuity clinics is a lack of timely communication of test results to patients. Delays in timely action on test results lead to patient dissatisfaction and have been identified as a serious quality gap in the management of test results.1 We hypothesised that increasing enrolment in the patient portal (MyChart; Epic Systems Corporation, Verona, WI, USA), associated with our electronic health record (Epic Systems; Epic O2, Verona, WI, USA) would streamline result communication between resident physicians and patients. We also expected that increased patient portal enrolment would lessen the nursing workload and decrease nursing telephone call volume.

Our internal medicine (IM) clinic supports 65 resident patient panels and is housed on the main campus of a large, multisite health system in Kansas City, Kansas. In this educational structure, a resident physician refers to a learner who has completed medical school and is completing post-graduate IM residency training. Residents have a goal patient panel size of 90 patients balanced across age, gender, complex medical comorbidities, as well as payor sources. At our institution, our residents rotate on an ‘x+y’ block schedule, which separates their educational rotations to traditional 3 week inpatient rotations when they do not have continuity clinic, followed by a 1 week dedicated continuity clinic rotation. Each resident is assigned to a specific faculty along with an anchor nurse for their longitudinal continuity clinic education over the length of their residency. Their anchor nurse handles all telephone calls, refills and other administrative duties in support of the resident’s practice—both while the resident is seeing patients during their continuity clinic week and while the resident is on a different rotation. To streamline clinic workflow, the anchor nurse does not always ‘room’ scheduled clinic patients for their aligned resident physicians. There is a cohort of ‘rooming’ nurses that follow standard protocols for this activity in a busy clinic setting.

During a resident’s non-continuity clinic rotations, there is often a delay in clinic result communication to patients. Results from tests ordered in the residents’ clinic can be communicated to patients in a variety of ways: (1) in person at a follow-up visit, (2) via a telephone call from the resident physician to the patient, (3) via a telephone call from the anchor nurse to the patient after the resident has entered electronic comments and recommendations, (4) via a letter to the patient, or (5) via the patient portal associated with the electronic health record (EHR).

Our primary aim was to increase patient portal enrolment in the General Internal Medicine resident continuity clinic by at least 10% over 1 month, representing a statistically significant and clinically meaningful increase. Our secondary aim was to assess anchor nurse perceived workload in result communication as a direct consequence of improved patient portal enrolment.


Recent reports have shown that patient access to the EHR via patient portals can help facilitate medication refills, coordinate appointments and billing activities,2 and can increase patient satisfaction by making clinical information, assessments and results readily available.3–5 Patient portal usage has been associated with improvement in chronic disease parameters6 and patient functional status,7 as well as with a reduction in high-cost healthcare utilisation in primary care practices.7 We are not aware of any published studies addressing the unique complexities of EHR patient portal use in a resident continuity clinic.


Baseline measurement

A baseline audit showed that 35% or 570 patients out of 1628 total patients in 16 resident patient panels were enrolled in the patient portal. Anchor nurses completed surveys at baseline to determine the facilitators and potential barriers to effective implementation of the project. Survey items addressed their perceptions of their aligned residents’ timeliness of result notification and the frequency of patient concerns related to timeliness of result notification. Other survey items addressed the nurses’ current telephone call volume, time spent making and answering calls about patient test results, and time spent answering patients’ clarifying questions regarding test results. Nurses also were asked for suggestions to improve their workload as it related to patient results. At the end of the study, the same nurses also participated in semi-structured interviews to explain how the patient portal intervention affected (1) how residents responded to patient results, (2) patient call volume and (3) the amount of time spent making and answering telephone calls about patients’ test results.


Our primary intervention was to introduce a standard patient portal sign-up process at the end of the patient rooming process. Nurses identified that one major barrier to patient portal enrolment was difficulty remembering the sign-up process in a long list of tasks necessary for ‘rooming’ a patient. Many intervention projects have used visual reminders to improve or change the behaviour of healthcare professionals.8–11 Similarly, to address this barrier, we implemented a visual reminder for the nurse to increase patient portal sign-ups. Further, by having the nurse launch an electronic sign-up page for patients at the end of the typical rooming process, it allowed the patient an opportunity to sign up while waiting for the physician, so the patients’ wait time would not be lengthened significantly.

Specific components of the intervention included: (1) placement of a visual reminder on exam room computer monitors (see figure 1), (2) creation of a script with visual aids to help nurses speak to patients about sign-up and find the sign-up button in the EHR, (3) placement of patient portal brochures with space to record the patient’s chosen log-on information in each exam room, and (4) education on the project for all nurses and attending physicians via email and regularly scheduled meetings.

Figure 1

Visual reminder to enrol patients into portal system.

The primary end point was to increase patient enrolment significantly at the end of the first cycle.


Our objective was to increase the number of patient portal enrolments in the IM resident continuity clinic at a large, academic medical centre using two distinct Plan-Do-Study-Act (PDSA) cycles. A PDSA cycle is a guide for improvement that maps small tests of change by planning the intervention, doing the intervention, studying the intervention for outcomes and modifying the intervention based on observation of outcomes.12 To reach our goal of a clinically meaningful and statistically significant increase in patient portal enrolments in the eligible resident clinic population, the two PDSA cycles were conducted over a 3-month period. Baseline data were gathered, identifying 570 patients of the 1628 eligible patients with active patient portal access (35%). To assess the change between baseline and 3-month follow-up in the proportion of patients who were enrolled in the portal system, a χ2 test of independence was performed. Statistical analysis was performed using SPSS (IBM SPSS Statistics V.21.0; New York, NY, USA), and significance was determined at the 0.05 alpha level. Additional baseline data in the form of surveys were gathered from four specific anchor nurses of the targeted resident continuity panels.

Pre-intervention survey results of anchor nurses revealed that they believed residents have difficulty responding to patient results in a timely fashion. Anchor nurses rated their call volume as moderate (not too many calls but a steady flow) to excessive (very high with too many calls). Two out of four nurses reported that they took too much time answering clarifying questions when calling patients about their test results. All nurses perceived that too much time is spent answering clarifying questions when calling patients about their test results. When asked for suggestions to reduce the nursing workload, the nurses shared that they believed that patient portal sign-up would help reduce the amount of time spent related to result communication.

PDSA cycle 1

Given baseline data, we identified four resident continuity clinic panels including 16 IM residents to study for a 4-week period. Specifically, we chose one panel of four residents to study each of the 4 weeks. This allowed us to learn each week what was going well and what our challenges were. Each week, four residents received preparatory refresher education on patient portal utility and function from their aligned attending. This occurred in person and via email. All nurses were reminded of the leadership initiative of 100% patient portal enrolment during a standing scheduled staff meeting. Visual reminders were placed on examination room monitors reminding the rooming nurses of our project initiative. All rooming nurses were directed to activate the portal-enrolment screen at the completion of the standard rooming process and invite the patient to enrol in the portal while awaiting their physician. Additionally, patients were offered an information card from nursing on the benefits of enrolment.

PDSA cycle 2

Given the positive results in cycle 1, our direct focus for cycle 2 was educational outreach to continue to enhance patient portal enrolment. At standing staff meetings, we provided additional education to clinic nurses. We also met with the attending physicians who supervise the residents in clinic and provided training on the sign-up process. Results from cycle 1 were relayed to all care team members. We heard feedback from the nursing team on ways to improve the process, many of which were implemented. For example, nurses relayed that signing patients up using a tablet instead of a desktop computer introduced complexity to the process. We shifted to only using desktop computers for sign-ups after hearing this feedback. Overall, the nursing team gave positive feedback about our interventions. We continued to monitor the specific 16 resident physician–patient panels for a duration of 4 weeks.


Patient portal enrolment was measured for the 16 IM resident panels weekly. A Health Information Technology Services analyst provided electronic reports detailing the number of clinic patients who signed up for the portal during their appointment. Our team reported the enrolment numbers for each resident physician and compiled them for the two cycles.

At the end of PDSA cycle 1, patient portal enrolments increased from 570 to 625, representing a 9.6% increase over a 4-week period (X2(1)=1.19, p=0.27). Anchor nurse interviews indicated that the nursing workload was reduced significantly with the additional patient portal enrolments, which was perceived to be due to the decreased amount of time that was required to answer patients’ clarifying questions. Additionally, anchor nurses offered that the direct communication of clinical result information from the resident to the patient was valuable and enhanced the doctor–patient relationship.

At the end of PDSA cycle 2, 656 patients were active on the patient portal, which represents a 15.1% increase from baseline (X2(1)=7.37, p<0.01) (see figure 2). Interviews with the anchor nurses revealed several common themes about the implementation of the patient portal intervention. Nurses noticed positive changes in resident responsiveness to results in the form of increased patient portal messages and decreased telephone encounters. Nurses perceived improved patient understanding regarding results communication, noting fewer patient result-related questions. No patients reported concerns with patient portal communication of results. Further, nurses stated that patients shared unsolicited positive feedback about how happy they were with the prompt results. Nurses were pleased that the patient portal intervention seemed to decrease the time spent making and answering phone calls regarding patient results and clarifying questions.

Figure 2

Patient portal enrolment.

Retrospectively, we looked at patient portal enrolment via portal activation rates across all 65 resident patient panels and compared it with the subset of 16 resident patient panels (figure 3). Patient portal activation rates were obtained using reportable data from the EHR. The rate of portal activation was calculated based on the number of patients with active patient portal status out of the number of patients with an IM resident listed as their primary care provider in the EHR. Baseline data showed that the activation rate across the entire resident patient population was 37% compared with a 35% activation rate for the subset of 16 residents in the study. One-month postcompletion of two PDSA cycles, the activation rate was 38% for all resident providers and the subset of 16 residents.

Figure 3

All resident panel activation rate.

Lessons and limitations

The project aim was twofold: to significantly increase patient portal enrolment and to evaluate nursing perceptions about patient portal utilisation on their workload in the ambulatory setting. Our findings demonstrated success in both aims with a simple, low-cost intervention. We encountered a few barriers. Some of our rooming nurses work in more than one clinic, and the intervention only occurred at our main campus location. We found that some nurses needed reminders from our clinic manager to continue to offer portal sign-ups. Our clinic manager sent reminders to nurses often, which is not a sustainable intervention. Additionally, we encountered patients who prefer more traditional means of communication from their physician, and we discussed a more realistic goal of having the majority of our patients enrolled in the portal, as opposed to all of them.

Our quality improvement project was conducted at a single academic medical centre, which is a limitation. However, this intervention would be easy to implement in other primary care academic settings that have similar hurdles with timely communication of patient test results in a resident continuity clinic setting.

This quality improvement project highlighted many positive lessons. Specifically, the use of two PDSA cycles allowed for the adaptability and reassessment of the project. Choosing a project that was important to leadership, clinicians and nurses functioned as a key component to the success of this project. A future investigation could include the effect of various incentives for physicians and nurses on enrolment rates. Future efforts should expand this quality initiative project to include multiple providers across different clinic settings to determine if our findings can be replicated. Additionally, while patient portal activation rates continue to increase, a future direction will be to evaluate how well patients manage their care and medical conditions once they actively engage via the patient portal.


This is the first report of an EHR patient portal enrolment intervention in a resident clinic patient population. Previous studies have evaluated patient portal use in academic specialty clinics,13 academic and non-academic primary care clinics,5 6 Veteran’s Health Administration clinics14 and other clinic settings, but studies involving resident primary care clinics are lacking.

Resident clinics pose unique challenges regarding provider to patient communication. We demonstrated that EHR patient portal enrolment in a large resident continuity clinic can be increased with a standardised, simple, low-cost intervention. We utilised existing clinic workflows and capitalised on previously unused patient wait time. We demonstrated how this intervention improved nursing satisfaction and nursing perception of phone call burden.

Because of the simplicity of the intervention, our clinic has continued sign-ups using this new workflow, and dissemination of the intervention has been achieved by incorporation of the process into onboarding and training of new nurses.

Future direction will be to continue to assess patient portal access and sustainability of the intervention. We plan to expand the analysis to include all 65 resident’s patient panels. Additionally, we plan to monitor the nursing workload as more patients are enrolled on the patient portal, potentially using more quantitative measures, such as electronic telephone call logs. We also plan to use the new academic year as a test of change for sustainability of the intervention.

Future PDSA cycles could also include involving residents in signing up their own patients, front desk staff assisting in sign-up and patient self-enrolment prior to their appointment.


The authors are particularly grateful to Beth Geist and Bethany Crum for their assistance and valuable suggestions during the development and implementation of this QI project. They thank Megan Larson for providing data regarding patient portal sign-up percentages. Special thanks go to anchor nurses, Kimberly Beem, Trisha Finn, Tracy McBratney and Sarah Wargin.


  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.


  • Contributors BL and CR: initiated the project. BC, BL, CG, CR, CS and JB: study design. BL, CS, JB, SS and VW: performed the literature review. CG, CR and CS: designed the data collection tools. BL, CR, JB and VW: completed the abstract. CG: completed the nurse interviews; designed and conducted the statistical analysis, and wrote the strategy and results sections. CR and CS: facilitated the nursing surveys. BC, BL, CR, JB and SS: manually collected data regarding portal sign-ups weekly during cycle 1. CS: collected and managed the computerized data. All authors reviewed/edited all sections of the manuscript and approved the final version.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Ethics approval According to the Kansas University Medical Center (KUMC) Human Subjects Committee, this work met criteria for quality improvement activity exempt from ethics review.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Patient consent for publication Not required.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.