You are here

  • Home
  • Archive
  • Volume 13, Issue 2
  • Patient and healthcare professional perspectives on the Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC): analysis of open-ended responses from patients and healthcare professionals

Article Text

Article menu
Original research
Patient and healthcare professional perspectives on the Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC): analysis of open-ended responses from patients and healthcare professionals
  1. Rakhshan Kamran1,
  2. Liam Jackman2,
  3. Anna Laws3,
  4. Melissa Stepney4,
  5. Conrad Harrison1,
  6. Abhilash Jain1,
  7. Jeremy Rodrigues5,6
  1. 1Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford, UK
  2. 2Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
  3. 3Northern Region Gender Dysphoria Service, Cumbria Northumberland Tyne and Wear NHS Foundation Trust, Newcastle upon Tyne, UK
  4. 4Department of Psychiatry, University of Oxford, Oxford, UK
  5. 5Department of Plastic Surgery, Buckinghamshire Healthcare NHS Trust, Amersham, UK
  6. 6Warwick Clinical Trials Unit, University of Warwick, Coventry, UK
  1. Correspondence to Dr Rakhshan Kamran; rakhshan.kamran{at}hertford.ox.ac.uk

Abstract

Importance Several international calls have been made for evidence-based patient-reported outcome measure (PROM) implementation for gender-affirming care. The Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC) is a resource which can help guide PROM implementation efforts, developed using a three-phase participatory research approach with transgender and gender-diverse (TGD) patients and gender-affirming healthcare professionals. However, thoughts and perspectives from TGD patients and gender-affirming healthcare professionals on the PG-PROM-GAC need to be investigated.

Objective Investigate patient and healthcare professional perspectives on the PG-PROM-GAC through analysis of open-ended survey results.

Design Qualitative study analysing open-ended responses from TGD patients and gender-affirming healthcare professionals.

Setting Participants were recruited from a UK National Health System (NHS) gender clinic.

Participants Patients receiving care at an NHS gender clinic and healthcare professionals working at an NHS gender clinic were eligible for participation. Eligible participants were invited to participate in this study via email.

Intervention Participants were sent an open-ended survey to collect responses on the PG-PROM-GAC.

Main outcome(s) and measure(s) Data were thematically analysed by two independent researchers and interpreted following guidance from established methods in implementation science.

Results A total of 64 TGD patients and 9 gender-affirming healthcare professionals responded to the open-ended survey (mean (SD) age: 35 (16) and 48 (8), respectively). Four main themes emerged from the data: overall opinions and support for the PG-PROM-GAC, presentation of the PG-PROM-GAC, impact of gender clinic resources on PROM implementation and impact of PROM selection on implementation. Data were used to iterate the PG-PROM-GAC in response to participant feedback.

Conclusions and relevance The PG-PROM-GAC is an acceptable and feasible resource that can be used by clinicians, researchers and policymakers to guide PROM implementation for gender-affirming care settings, helping to align gender-affirming care with patient needs.

  • Implementation science
  • Healthcare quality improvement
  • Health services research
  • Patient Reported Outcome Measures

Data availability statement

Data are available upon reasonable request. Requests for data can be made to the corresponding author.

https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

https://doi.org/10.1136/bmjoq-2023-002721

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    WHAT IS ALREADY KNOWN ON THIS TOPIC

    • The Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC) is a resource which can help implement patient-reported outcome measures (PROMs) in gender-affirming care. However, thoughts and feedback from patients and healthcare professionals on the PG-PROM-GAC are currently unknown.

    WHAT THIS STUDY ADDS

    • This qualitative study analysing open-ended responses demonstrates that transgender and gender-diverse (TGD) patients and gender-affirming healthcare professionals viewed the PG-PROM-GAC as a thoughtfully constructed and needed resource for gender-affirming care. Feedback was also used to iterate the PG-PROM-GAC to become more user-friendly.

    HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY

    • The iterated PG-PROM-GAC is a resource which can help implement PROMs for gender-affirming care, and improve gender-affirming healthcare quality and delivery.

    Introduction

    Gender-affirming care is a key clinical area which can benefit from systematic and evidence-based implementation of patient-reported outcome measures (PROMs).1 PROMs are self-report questionnaires quantifying how patients feel and function.2 Implementation of PROMs for gender-affirming care can help to ensure care is provided in line with international clinical guidelines,3 align care with patient needs, improve patient-centredness, and challenge bias in treatment or poor patient care where appropriate.1 4 However, in numerous clinical settings, the benefits of PROMs are not realised to their full potential due to implementation challenges.5 Evidence-based PROM implementation strategies offer a solution to maximise PROM implementation.6 Improving gender-affirming care quality is an international healthcare priority, and implementing PROMs can help to achieve this.1 3

    The Practical Guide to Implementing PROMs in Gender-Affirming Care (PG-PROM-GAC) is a resource which can help clinicians, researchers and policymakers implement PROMs more effectively and consistently for their gender-affirming care setting.7 Over 200 different PROMs for adult gender-affirming care and 38 different PROMs for paediatric gender-affirming care have been identified which have the potential to be implemented into clinical practice.1 8 This large number of existing PROMs contributes to potential redundancy and complexity with PROM implementation as guidance is lacking on the best PROMs to implement for gender-affirming care. Local service improvement initiatives can be used to help guide selection of the best PROMs to use relevant to local settings. The PG-PROM-GAC contains two tables with sections which can help guide PROM implementation: one section focuses on patient-relevant strategies, and another section focuses on healthcare professional (HCP)-relevant strategies.7 The PG-PROM-GAC is also being used by the leads of a National Health System (NHS) England workstream for PROMs in gender clinics to help implement PROMs in NHS gender clinics. The PG-PROM-GAC has been developed over the past 3 years and is an output of previously reported projects from a University of Oxford doctorate including the following:

    • A systematic review of 286 international articles (representing 85 395 transgender and gender-diverse (TGD) patients).1

    • A qualitative study representing 14 TGD patients and 10 interdisciplinary gender-affirming HCPs.9

    • Iteration and refinement with seven TGD patients and a gender-affirming HCP.7

    • Measurement of acceptability, appropriateness and feasibility of the guide through a cross-sectional study using validated implementation surveys, based on 132 TGD patients and 13 gender-affirming HCPs.10

    • Future research will encompass real-world deployment of the PG-PROM-GAC and measuring its effectiveness when used to implement PROMs at an NHS gender clinic.

    While quantitative data supporting the acceptability, appropriateness and feasibility of the PG-PROM-GAC exist, why patients and HCPs chose to score this way is not clear.10 Measurement of patient perspectives is essential in ensuring implementation strategies are relevant and meaningful to patients.11 The aim of this study was to address this gap through investigating patient and HCP perspectives on the PG-PROM-GAC through analysis of open-ended survey results. This is an independent study to build on previous PROM implementation work and fill a literature gap for gender-affirming care.

    Methods

    Patient and public involvement

    Seven patient and public members from the TGD community were involved with this research. This patient and public involvement group confirmed relevance and importance of this research, and confirmed the applicability and relevance of findings. Patient and public members were recruited through local and national TGD charity organisations and community support groups.

    Reporting

    The Standards for Reporting Qualitative Research guideline12 was followed for this article.

    Approach and research paradigm

    We used an interpretive description approach as this focuses on generating knowledge relevant to clinical contexts and applied health disciplines.13–15 Interpretive description approaches have been previously applied for studies on PROM development,16 and have relevance to this study which aims to generate knowledge on participant thoughts and perspectives on the PG-PROM-GAC (online supplemental appendix 1). We used thematic analysis to analyse the data and normalisation process theory (NPT)17 18 as a guiding theory as it is a key implementation science theory which aims to understand how an innovation (eg, PROMs) may become routinised in practice. NPT is a middle-range theory which was used to support the development of the research question and focus, aid with interpretation of the results (keeping interpretation focused on implementation concepts), and to guide and structure conclusions and recommendations.17

    Supplemental material

    Researcher characteristics and reflexivity

    Data were analysed by a doctoral candidate formally trained in qualitative research and a research specialist in patient-reported outcomes (RK), and a master’s candidate with prior experience in PROM implementation and qualitative research (LJ). A relationship was not established with participants prior to this study. The researchers involved with data analysis were involved in designing the research question, qualitative approach, methods and reporting results. To aid reflexivity, memos and notes were drafted by researchers during data analysis to build awareness of their own positionality and how this affects the research process.

    Context

    The clinical context for this study is gender-affirming care. Gender-affirming care comprises of a broad range of psychosocial, hormonal and surgical treatments to help gender dysphoria; however, it is not uniformly available across the globe and for young TGD people in particular, has been increasingly subject to discriminatory legislation and medical mandates to limit gender-affirming treatment. Adult participants (aged 18 years or older) for this current study were recruited from the UK, where trans people experience a number of barriers to accessing gender-affirming healthcare.19

    Sampling strategy

    Participants at a gender clinic (n=1859) and HCPs at a gender clinic (n=32) were contacted via email with an invitation to participate in this study. The email outlined that participation involved reviewing the PG-PROM-GAC, a short introduction to the PG-PROM-GAC and how it was developed with service user input, and inviting participant feedback through three open-ended questions: (1) Are there any thoughts or comments you would like to share about the patient-relevant PROM Implementation Strategy Guide?; (2) Are there any thoughts or comments you would like to share about the HCP-relevant PROM Implementation Strategy Guide?; (3) Are there any final thoughts or comments you would like to share? The rationale for participants to provide comments via an open-ended survey was to capture a large number of perspectives from individuals representing a broad range of gender identities.20 A reminder email was sent 1 week after the initial participant recruitment email. Beyond the information included in the introductory email, participants had not been exposed to PROMs in the clinic before.

    A total of 64 TGD patients and 9 HCPs responded to the open-ended survey. The mean (SD) age of TGD participants is: 35 (16) with a range of ages between 18 and 71 years. TGD participants’ self-reported gender were mostly female (29, 45%) or male (16, 25%); and female (26, 41%) or male (37, 58%) sex assigned at birth. Most TGD participants were white (61, 95%) and British (52, 81%). For the HCP sample, participants had a mean (SD) age of 48 (8) with a range of ages between 29 and 57 years. Most HCP participants were female gender (7, 78%) and female (6, 67%) or male (3, 33%) sex assigned at birth. Most HCP participants were white (8, 89%) and British (8, 89%). Table 1 displays demographic information for study participants.

    View this table:
    Table 1

    Demographic information of study sample

    Data collection methods, instruments and technologies

    Data collected included demographic information of study participants (age, gender, sex assigned at birth) and responses to three open-ended questions. The data collection instrument (online survey) was pilot tested with a patient and public involvement group and a HCP. Data collection began on Thursday 7 September 2023 until Thursday 21 September 2023. Data were collected on Microsoft Forms. Data were analysed iteratively from 7 September 2023 to 27 November 2023.

    Data processing

    Data were managed and coded on Microsoft Excel (V.16.69) and stored on an encrypted cloud server based at the University of Oxford to ensure data security. Data were anonymised with participants being assigned a participant ID on Microsoft Forms during the data collection phase.

    Data analysis

    Data were thematically analysed with coding of open-ended responses occurring independently and in duplicate.20 In line with current recommendations for qualitative analysis of open-ended survey responses,20 the data for this study were analysed as one cohesive dataset with analytical patterns developed across the entire dataset rather than analysing responses to each question separately. The rationale for this is that although a specific question may direct participants to share a particular perspective, relevant perspectives to a particular question may be shared in responses to other questions as well.20 Regular debriefing meetings between researchers covering key concepts from data analysis were held to ensure rigour.21 NPT was used to help guide emerging interpretations, conclusions and recommendations from the data.17

    Techniques to enhance trustworthiness

    Results were provided to participants to check for accuracy to ensure credibility and trustworthiness.22 Results were also provided to patient and public partners to ensure relevance and meaningfulness of study results to the TGD community. Service users provided input to improve the simplicity of language used and overall comprehensibility of questions.

    Results

    A total of four main themes relating to: overall opinion on the PG-PROM-GAC, presentation of the PG-PROM-GAC, impact of gender clinic resources on PROM implementation and impact of PROM selection on implementation were identified (figure 1). These themes were interconnected and comprised of positive comments about the PG-PROM-GAC as well as suggestions for iteration. Participants also highlighted specific strategies mentioned in the PG-PROM-GAC that they felt were highly important for PROM implementation. Below, each theme will be illustrated, and the linking of concepts is discussed.

    Figure 1
    Figure 1

    Sunburst chart representing frequency of codes. PG-PROM-GAC, Practical Guide to Implementing PROMs in Gender-Affirming Care; PROM, patient-reported outcome measure.

    Overall opinion on the PG-PROM-GAC

    Overall, TGD participants and gender-affirming HCPs supported the PG-PROM-GAC as a whole. Specifically, participants described how the PG-PROM-GAC was needed for gender-affirming care, with some saying they welcomed the PG-PROM-GAC, and that they agreed with the content in the PG-PROM-GAC.

    The [PG-PROM-GAC] guide is what [gender-affirming care] patients need. (Female patient, aged 43 years)

    I understand and agree with the [PG-PROM-GAC] guide. (Female patient, aged 22 years)

    I support the [PG-PROM-GAC] initiative and welcome it. (Female patient, aged 59 years)

    We need this [PG-PROM-GAC] in gender healthcare. (Genderqueer female HCP, aged 50 years)

    I feel that the [PG-PROM-GAC] Guide has been written with a high level of consideration and empathy towards patients. (Non-binary patient, aged 30 years)

    Most participants supported and welcomed the PG-PROM-GAC, specifically writing support for the content in the PG-PROM-GAC and how this can be used to improve gender-affirming healthcare.

    I think this [PG-PROM-GAC] guide was a good idea on PROMs and helping people get better care that they need. (Transgender male patient, aged 29 years)

    Some participants went into greater detail on specific strategies within the PG-PROM-GAC they felt were highly important. Specific strategies felt to be important from the PG-PROM-GAC (available in online supplemental appendix 1) by participants include PROM accessibility and timing of PROM administration:

    I hope it is administrated to patients in an appropriate manner as gender clinic sessions for example can be very emotionally loaded for patients, so perhaps as a follow up email would give patients time to wind down and collect their thoughts beforehand. (Male patient, aged 21 years)

    I think the idea of having different accessible versions is really good. I think if someone needs support then there needs to be an independent source that can help eg, peer support workers if they are not directly being asked about. (Genderqueer patient, aged 35 years)

    This same participant (genderqueer patient, aged 35 years) also felt the strategy on sharing knowledge and information between clinics (see online supplemental appendix 1) should be undertaken with care and sensitivity. They had concerns about data sharing:

    Sharing information between clinics seems really important in terms of sharing learning but it would be need to be very clear for patients whether they want that to happen. Which could prove problematic if it leads to a skew in the data that is shared. (Genderqueer patient, aged 35 years)

    The view that data consent and security was important was shared by many participants. The importance of ensuring transparency of data handling was a shared theme among many participants and expanded beyond the strategy of sharing information between clinics to cover all aspects of general PROM implementation:

    Explanation of how the data will be used, how it will be kept secure and not used against the patient or service at a later date is a key part of engaging patients. A lot of trans patients are suspicious of healthcare processes and how information can be used to gatekeep services and obstruct their treatment pathway. (Female patient, aged 41 years)

    Overall, these comments suggest that the strategies of education around PROM implementation, ensuring and communicating information on data transparency, and confirming patient consent with who they would like PROM data to be shared with are highly important and should potentially be viewed as linked strategies rather than discrete entities.

    PG-PROM-GAC presentation

    The presentation of the PG-PROM-GAC (eg, layout of text) was commonly discussed by participants. Participants discussed positive elements of the presentation of the PG-PROM-GAC. Positive comments for how the PG-PROM-GAC was presented included participants feeling that the PG-PROM-GAC was clear, comprehensive and covered various areas of relevance for PROM implementation in gender-affirming care.

    I like that it [PG-PROM-GAC] has covered various areas of accessibility, information governance and education. (Female HCP, aged 29 years)

    Participants mentioned that the benefits of PROMs are important to explain, specifically how PROMs may benefit patients and gender-affirming healthcare. Participants feeling that the information in the PG-PROM-GAC helped them understand the reasons for PROM implementation and how this could be helpful are illustrated below. This also links to the themes of trust with PROM implementation and engaging participants to complete PROMs, as highlighting PROM benefits may help to increase trust and engagement.

    I think this [PG-PROM-GAC] is a good idea because being a trans person is difficult at times because of the insecurity that you weren’t born female/male and always comparing yourself to others. I think a PROM is a good thing to introduce to people because people need to know how trans people feel and how transitioning affects them either good or bad. (Female patient, aged 19 years)

    However, not everyone felt this way, and some individuals disagreed that the PG-PROM-GAC was clear and comprehensive. Some participants expressed confusion with the use of acronyms, and others felt the guide could benefit with evidence around the rationale for PROM implementation and evidence for PROM benefits.

    Whilst there’s some good content, it [PG-PROM-GAC] doesn’t explain or incentivise healthcare professionals to get involved or implement the recommendation. What’s in it for them? It should be putting forwards methods of delivering - good practice for example. Needs to be easy take on board and implement, at present this just looks like more work for them. (Patient)

    A few strategies within the PG-PROM-GAC relate to this participant comment, specifically the patient-relevant strategy of having educational information about PROMs and the HCP-relevant strategy of developing educational material on PROMs. This comment emphasises that communication of these strategies alone may not be enough, and that the PG-PROM-GAC should be amended to include some educational information which may help to incentivise PROM implementation. Some participants provided feedback on additional information that the PG-PROM-GAC should cover, specifically additional information on how the PG-PROM-GAC was developed and how the input of service users and HCPs was used.

    I would like to know how many trans service users have been involved in the creation of the [PG-PROM-GAC] guide as well as healthcare professionals. (Male patient, aged 25 years)

    In addition to transparency with PROM data handling, this comment exemplifies the need for transparency with how the PG-PROM-GAC was developed, specifically how trans service users have been involved in the process. When including additional information in the PG-PROM-GAC, it is important that the information be presented in an engaging way. Some participants felt that the PG-PROM-GAC in its current state was too wordy.

    I think the idea [PG-PROM-GAC] is a good one, however the document is very wordy and makes the process seem very complicated when it doesn’t need to be. (Female HCP, aged 44 years)

    Presentation style is very poor, it [PG-PROM-GAC] appears as a wall of words. It really needs to engage the audience. (Patient)

    These comments exemplify that when amending the PG-PROM-GAC to include additional information, care should be taken to present information in an engaging way. Strategies to improve presentation in the PG-PROM-GAC may include the use of graphics to reduce the document appearing as a ‘wall of words’, using colours to highlight key concepts within strategies and including alternative forms of communication (ie, videos) which may help to enhance presentation of the PG-PROM-GAC and engagement with participants who mentioned areas for improvement.

    Gender clinic resources

    Participants frequently discussed the impact of healthcare resources on real-world deployment of the PG-PROM-GAC. Specifically, while participants spoke to the theme of supporting the PG-PROM-GAC (as was discussed in a previous section), many were unsure as to what using the PG-PROM-GAC would look like. Specific concerns participants had were around the limited resources in gender-affirming care, with participants discussing that gender clinics may have limited staffing, funding and a high volume of patients being seen and on the waiting list which could potentially impact use of the PG-PROM-GAC.

    I feel like it [PG-PROM-GAC] is going to be a big change on already scarce resources, and will need more people power or a dedicated person to ensure this is done as it should be. (Female HCP, aged 45 years)

    Some things may be tricky, like dedicated rooms and support from staff. (Female patient, aged 44 years)

    Specific strategies in the PG-PROM-GAC which were mentioned as needing to be considered in relation to the resources a gender clinic has include having a dedicated and private space to complete PROMs, and identifying and preparing implementation champions to help with PROM implementation which may also include involving staff members. What these comments suggest is that viewing all strategies of the PG-PROM-GAC as mandatory to have in place may cause disengagement with the PG-PROM-GAC. These comments are also related to a strategy in the PG-PROM-GAC which highlights the importance of tailoring PROM implementation to local settings. Highlighting this information in a clearer way at the beginning of the PG-PROM-GAC, through including guidance on how the PG-PROM-GAC can be used, and that strategies should be considered within the local implementation context, may help to increase engagement.

    PROM selection

    Some participants discussed the impact PROM selection may have on the PG-PROM-GAC. It was important for participants who discussed this concept to have a PROM implemented which is viewed as inclusive and acceptable for TGD patients.

    [The] devil is in the detail of which PROM is selected, the nature and inclusivity of the selection process and the acceptability to patients. So, we need something in here about how we will use this to allow staff to reflect on their practice and provide evidence of their standard of care, we need something about how this might integrate with service development and improvement through audit and possibly research. We need to know how it will be resourced without taking resource away from patient care. (Male HCP, aged 57 years)

    I understand why they are used but some PROMs are quite dehumanising. My experience of using this style of survey for 18 years or so is that the questions no longer hold any meaning. (Trans masculine patient, aged 32 years)

    These comments link to the themes mentioned about trust and patient engagement, specifically trust in that PROM implementation can help to improve gender-affirming healthcare. These comments illustrate that some participants feel it is important that PROM implementation does not add to the burden of clinicians providing care, and that the benefits of PROMs to patients need to be clear. A few participants also commented on the importance of selecting a PROM that is not overly burdensome to administer and score.

    I think the detail of what is used will make or break this [PG-PROM-GAC]. If it [PROM] is 20 pages of tick boxes or a meaningful attempt to capture feedback. (Female HCP, aged 57 years)

    Participants felt that patients would not feel engaged to complete PROMs if they were overly burdensome or viewed as unacceptable. This highlights an important concept relevant to the PG-PROM-GAC, that the PROM selected for use may impact the effectiveness of the listed implementation strategies.

    Discussion

    This study presents the perspectives of 64 TGD patients and 9 gender-affirming HCPs on the PG-PROM-GAC. Key suggestions moving forward with the PG-PROM-GAC include selecting a PROM which patients find accessible and relevant to local gender-affirming care settings. This can be achieved through service improvement initiatives aiming to determine patient acceptability of a shortlist of PROMs which have been identified by staff in a gender-affirming care clinic.23 Second, additional information supporting the development of the PG-PROM-GAC can be presented when using the PG-PROM-GAC.1 7 9 10 Third, the PG-PROM-GAC can be adaptable and tailored to meet the needs based on local needs of gender-affirming care settings. This can be done through local service improvement initiatives using the voices of patients and HCPs for a specific gender-affirming care setting to refine the PG-PROM-GAC for their local context. The PG-PROM GAC is also developed to work alongside whichever PROM a gender-affirming care setting chooses to implement. The PG-PROM-GAC includes suggestions on PROM selection to consider participant burden, and including service user input for the specific gender-affirming care setting aiming to implement PROMs. Fourth, the strategies in the PG-PROM-GAC should be viewed as complementary to address key implementation concerns local gender-affirming care settings may have. Rather than viewing each strategy in the PG-PROM-GAC as a discrete entity, clinicians, researchers and policymakers should consider that using a combination of strategies together can potentially maximise effectiveness of PROM implementation. While the PG-PROM-GAC was developed following studies in gender-affirming care settings, and is an overall ready-to-use resource which can help to implement PROMs for gender-affirming care, it has potential generalisability to other specialist areas. Other specialist areas beyond gender-affirming care implemented in PROM implementation can use the PG-PROM-GAC to help guide their own implementation initiatives.

    This study demonstrates overlap between what patients and HCPs discussed when giving feedback for the PG-PROM-GAC. Participants mentioned overall support for the PG-PROM-GAC and discussed that the PG-PROM-GAC was needed for gender-affirming healthcare, and thoughtfully constructed. However, an important consideration for participants was transparency with data handling, and the implications this can have on patient trust and engagement. This underscores the importance of the first patient-relevant strategy within the PG-PROM-GAC around education and the importance of the third HCP-relevant implementation strategy within the PG-PROM-GAC around staff responsibility for integrity with data processing and collection.

    When comparing the results of this research with other clinical fields, there is some overlap. In a qualitative study of PROM implementation for general practitioner practice, it was found that evidence on PROM implementation benefits is important to communicate with end-users to enable uptake of implementation plans, in line with our findings.24 In a qualitative study of PROMs for oncology practices, it was found that having guidance for PROM implementation can improve uptake.25 This is in line with our findings demonstrating the need and usefulness of the PG-PROM-GAC to help guide PROM implementation. In a qualitative study of PROM implementation in rheumatology, a key finding was providing resources and programmes to help integrate PROMs as part of care.26 This finding is also in line with the theme of support for the PG-PROM-GAC which was found in this study, as well as the concepts of coherence/sense-making and collective action, covered under NPT.17 As there are several PROM implementation initiatives ongoing in diverse clinical areas, consolidation of initiatives may help to improve consistency of strategy design and sharing of knowledge and resources.

    Regarding the theme of selecting a PROM to use alongside the PG-PROM-GAC, potential instruments which may be valuable to gender-affirming care settings include: the Gender Congruence and Life Satisfaction Scale,27 the Utrecht Gender Dysphoria Scale,28 and the Gender Identity/Gender Dysphoria Questionnaire for Adolescents and Adults.29 These PROMs have been developed and validated for gender-affirming care settings. Reducing the burden of PROMs can be done through techniques in computerised adaptive testing, which can make PROMs shorter and easier to administer and score while retaining accuracy.30 Creating computerised adaptive testing versions of PROMs is feasible, with methods outlined elsewhere,30 and can be done by researchers/clinicians with familiarity of psychometrics.

    Strengths of this study include: the inclusion of a large sample of TGD patients and HCPs diverse in age and gender identity. This study sample represented participants from an English NHS gender clinic. Future research should seek to investigate perspectives from outside the UK; however, this study does have representativeness of a diverse range of gender identities. Further, we used established theories in implementation science to guide the research design and in interpretation of results.31 Limitations of this study include a lack of racial and ethnic diversity. Future studies should aim to include the feedback of racial and ethnic minority populations on feedback for the PG-PROM-GAC. Second, there was a high rate of non-respondents for this study, and future research should seek to improve sampling to potentially increase response rates. It is possible that the non-respondents may be more reluctant to accept PROM implementation. This study did not analyse the demographic information of non-respondents as they did not provide this information/consent for it to be used in this way. Future research should seek to investigate demographic information of non-respondents to investigate the full extent that study participants represent diverse perspectives.

    Conclusion

    The key reasons that the PG-PROM-GAC is considered acceptable and feasible are feedback from gender-affirming care patients and HCPs mentioning support for the PG-PROM-GAC as a resource that is needed, welcomed and thoughtfully constructed. Participants also felt the PG-PROM-GAC was comprehensive and covered various aspects of relevance for gender-affirming care PROM implementation. Future work with the PG-PROM-GAC should consider its real-world clinical application and use alongside a PROM for gender-affirming care.

    Data availability statement

    Data are available upon reasonable request. Requests for data can be made to the corresponding author.

    Ethics statements

    Patient consent for publication

    Ethics approval

    This study involves human participants and was reviewed by the Clinical Trials and Research Governance Department, University of Oxford, classified as service improvement and exempt from university sponsorship or ethics committee review. Under UK policy, this exempted the study from university sponsorship or ethics committee review. This classification was independently ratified by the Cumbria, Northumberland, Tyne and Wear NHS Foundation Trust where it was registered as a service improvement project (SER-23-192). Participants gave informed consent to participate in the study before taking part.

    References

    1. ↵
      1. Kamran R,
      2. Jackman L,
      3. Chan C, et al
      . Implementation of patient-reported outcome measures for gender-affirming care worldwide: a systematic review. JAMA Netw Open 2023;6:e236425. doi:10.1001/jamanetworkopen.2023.6425
    2. ↵
      1. Nelson EC,
      2. Eftimovska E,
      3. Lind C, et al
      . Patient reported outcome measures in practice. BMJ 2015;350:g7818. doi:10.1136/bmj.g7818
    3. ↵
      1. Coleman E,
      2. Radix AE,
      3. Bouman WP, et al
      . Standards of care for the health of transgender and gender diverse people, version 8. Int J Transgend Health 2022;23:S1–259. doi:10.1080/26895269.2022.2100644
      OpenUrlCrossRefPubMed
    4. ↵
      1. Black N
      . Patient reported outcome measures could help transform healthcare. BMJ 2013;346:bmj.f167. doi:10.1136/bmj.f167
    5. ↵
      1. Stover AM,
      2. Haverman L,
      3. van Oers HA, et al
      . Using an implementation science approach to implement and evaluate patient-reported outcome measures (PROM) initiatives in routine care settings. Qual Life Res 2021;30:3015–33. doi:10.1007/s11136-020-02564-9
      OpenUrl
    6. ↵
      1. Wagle NW
      . Implementing patient-reported outcome measures. Catalyst Carryover 2017;3. doi:10.1056/CAT.17.0373
    7. ↵
      1. Kamran R,
      2. Jackman L,
      3. Laws A, et al
      . Developing feasible and acceptable strategies for integrating the use of patient-reported outcome measures (Proms) in gender-affirming care: an implementation study. PLOS One 2023. doi:10.1371/journal.pone.0301922
    8. ↵
      1. Jackman L,
      2. Chan C,
      3. Jacklin C, et al
      . Patient-reported outcome measures for pediatric gender-affirming care: a systematic review [Under review]. Paediatrics & Child Health 2023.
    9. ↵
      1. Kamran R,
      2. Jackman L,
      3. Laws A, et al
      . Patient and healthcare professional perspectives on implementing patient-reported outcome measures in gender-affirming care: a qualitative study. BMJ Open Qual 2023c;12:e002507. doi:10.1136/bmjoq-2023-002507
    10. ↵
      1. Kamran R,
      2. Jackman L,
      3. Laws A, et al
      . A practical guide to implementing patient-reported outcome measures in gender-affirming care: evaluating acceptability, appropriateness, and feasibility [Under review]. BMJ Open Qual 2023d.
    11. ↵
      1. Cappelleri JC,
      2. Zou KH,
      3. Bushmakin AG, et al
      . Patient-reported outcomes: measurement, implementation and interpretation. CRC Press, 2013.
    12. ↵
      1. O’Brien BC,
      2. Harris IB,
      3. Beckman TJ, et al
      . Standards for reporting qualitative research: a synthesis of recommendations. Acad Med 2014;89:1245–51. doi:10.1097/ACM.0000000000000388
      OpenUrlCrossRefPubMed
    13. ↵
      1. Thorne S
      . Interpretive description: qualitative research for applied practice. Routledge, 2016.
    14. ↵
      1. Pabel A,
      2. Pryce J,
      3. Anderson A
      . Research paradigm considerations for emerging scholars. Channel View Publications, 2021.
    15. ↵
      1. Hunt MR
      . Strengths and challenges in the use of interpretive description: reflections arising from a study of the moral experience of health professionals in humanitarian work. Qual Health Res 2009;19:1284–92. doi:10.1177/1049732309344612
      OpenUrlCrossRefPubMedWeb of Science
    16. ↵
      1. Kamran R,
      2. Longmire NM,
      3. Rae C, et al
      . Concepts important to patients with facial differences: a qualitative study informing a new module of the FACE-Q for children and young adults. Cleft Palate Craniofac J 2021;58:1020–31. doi:10.1177/1055665620969589
      OpenUrl
    17. ↵
      1. Murray E,
      2. Treweek S,
      3. Pope C, et al
      . Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med 2010;8:63. doi:10.1186/1741-7015-8-63
    18. ↵
      1. Carter H,
      2. Beard D,
      3. Harvey A, et al
      . Using normalisation process theory for intervention development, implementation and refinement in musculoskeletal and orthopaedic interventions: a qualitative systematic review. Implement Sci Commun 2023;4:114. doi:10.1186/s43058-023-00499-z
    19. ↵
      1. Wright T,
      2. Nicholls EJ,
      3. Rodger AJ, et al
      . Accessing and utilising gender-affirming healthcare in England and Wales: trans and non-binary people's accounts of navigating gender identity clinics. BMC Health Serv Res 2021;21:609. doi:10.1186/s12913-021-06661-4
    20. ↵
      1. Braun V,
      2. Clarke V,
      3. Boulton E, et al
      . The online survey as a qualitative research tool. Int J Soc Res Methodol 2021;24:641–54. doi:10.1080/13645579.2020.1805550
      OpenUrl
    21. ↵
      1. McMahon SA,
      2. Winch PJ
      . Systematic debriefing after qualitative encounters: an essential analysis step in applied qualitative research. BMJ Glob Health 2018;3:e000837. doi:10.1136/bmjgh-2018-000837
    22. ↵
      1. Candela A
      . Exploring the function of member checking. Qual Rep 2019;24:619–28. doi:10.46743/2160-3715/2019.3726
      OpenUrl
    23. ↵
      1. Al Sayah F,
      2. Jin X,
      3. Johnson JA
      . Selection of patient-reported outcome measures (PROMs) for use in health systems. J Patient Rep Outcomes 2021;5:99. doi:10.1186/s41687-021-00374-2
    24. ↵
      1. Litchfield I,
      2. Greenfield S,
      3. Turner GM, et al
      . Implementing PROMs in routine clinical care: a qualitative exploration of GP perspectives. BJGP Open 2021;5:bjgpopen20X101135. doi:10.3399/bjgpopen20X101135
    25. ↵
      1. Graupner C,
      2. Breukink SO,
      3. Mul S, et al
      . Patient-reported outcome measures in oncology: a qualitative study of the healthcare professional’s perspective. Support Care Cancer 2021;29:5253–61. doi:10.1007/s00520-021-06052-9
      OpenUrl
    26. ↵
      1. Kasturi S,
      2. Wong JB,
      3. Mandl LA, et al
      . “Unspoken questions”: a qualitative study of rheumatologists’ perspectives on the clinical implementation of patient-reported outcome measures. J Rheumatol 2020;47:1822–30. doi:10.3899/jrheum.200232
      OpenUrlAbstract/FREE Full Text
    27. ↵
      1. Jones BA,
      2. Bouman WP,
      3. Haycraft E, et al
      . The Gender Congruence and Life Satisfaction Scale (GCLS): development and validation of a scale to measure outcomes from transgender health services. Int J Transgend 2019;20:63–80. doi:10.1080/15532739.2018.1453425
      OpenUrl
    28. ↵
      1. McGuire JK,
      2. Berg D,
      3. Catalpa JM, et al
      . Utrecht Gender Dysphoria Scale - Gender Spectrum (UGDS-GS): construct validity among transgender, nonbinary, and LGBQ samples. Int J Transgend Health 2020;21:194–208. doi:10.1080/26895269.2020.1723460
      OpenUrl
    29. ↵
      1. Singh D,
      2. Deogracias JJ,
      3. Johnson LL, et al
      . The gender identity/gender dysphoria questionnaire for adolescents and adults: further validity evidence. J Sex Res 2010;47:49–58. doi:10.1080/00224490902898728
      OpenUrlPubMed
    30. ↵
      1. Kamran R,
      2. Rodrigues JN,
      3. Dobbs TD, et al
      . Computerized adaptive testing of symptom severity: a registry-based study of 924 patients with trapeziometacarpal arthritis. J Hand Surg Eur Vol 2022;47:893–8. doi:10.1177/17531934221087572
      OpenUrl
    31. ↵
      1. Nilsen P
      . Making sense of implementation theories, models and frameworks. Implement Sci 2015;10:53. doi:10.1186/s13012-015-0242-0

    Supplementary materials

    • Supplementary Data

      This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Footnotes

    • Twitter @RakhshanKamran

    • Contributors RK conceptualised the study. RK and LJ designed data collection instruments. RK and AL were involved with data collection. RK and LJ were involved with data analysis and interpretation. RK, LJ, AL, MS, CH, AJ and JR were involved with critical revision of the manuscript. RK is responsible for the overall content of this article as the guarantor. All coauthors approve of the submission.

    • Funding RK is funded by an NIHR Doctoral Research Fellowship (NIHR301792).

    • Disclaimer The funding source had no involvement in the conduct of this study.

    • Competing interests None declared.

    • Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.