You are here

  • Home
  • Archive
  • Volume 9, Issue 2
  • What is the feasibility and observed effect of two implementation packages for stroke rehabilitation therapists implementing upper limb guidelines? A cluster controlled feasibility study

Article Text

Article menu

Download PDFPDF

XML
Original research
What is the feasibility and observed effect of two implementation packages for stroke rehabilitation therapists implementing upper limb guidelines? A cluster controlled feasibility study
  1. Laura Jolliffe1,2,3,
  2. Tammy Hoffmann4,
  3. Leonid Churilov5,
  4. Natasha A Lannin1,2,3
  1. 1Occupational Therapy, Alfred Health, Melbourne, Victoria, Australia
  2. 2Department of Neuroscience, Monash University, Melbourne, Victoria, Australia
  3. 3College of Science, Health and Engineering, La Trobe University, Melbourne, Victoria, Australia
  4. 4Faculty of Health Sciences & Medicine, Bond University, Gold Coast, Queensland, Australia
  5. 5Medicine, Dentistry and Health Sciences, The University of Melbourne, Melbourne, Victoria, Australia
  1. Correspondence to Laura Jolliffe; l.jolliffe{at}alfred.org.au

Abstract

Background Hand and arm activity after stroke improves with evidence-based rehabilitation. Therapists face known barriers when providing evidence-based rehabilitation and require support to implement guidelines. The aim of this study was to investigate the feasibility of two implementation packages on guideline adherence by occupational therapists and physiotherapists, and explore effect on patient upper limb outcomes.

Method This was a non-randomised clustered feasibility study of occupational and physiotherapy rehabilitation services (n=3 inpatient and n=3 outpatient services). Services were allocated to one of three groups: (group A) facilitator-mediated implementation package, (group B) self-directed implementation package or (group C) usual care (control); we recruited n=1 inpatient and n=1 outpatient service per group. Outcomes of feasibility, adherence to guidelines (medical file audits) and patient upper limb impairment (Fugl-Meyer Upper Extremity Assessment), activity (Box and Block Test) and practice (minutes/week) were collected at baseline and after 3 months of intervention.

Results 29 therapists (8 in group A, 13 in groups B and 8 in group C) and 55 patients participated. Both the facilitator-mediated and the self-directed implementation packages were feasible to deliver in the rehabilitation setting. Therapists in group A improved with respect to guideline adherence (medical file audits; median within-group proportion difference of 0.29 (95% CI 0.22 to 0.36, p<0.0001) preintervention to postintervention). No significant within-group differences from baseline to postintervention were found in group B or group C, and no between-group differences were found for upper limb outcomes.

Conclusion A facilitator-mediated package was acceptable to therapists working in stroke rehabilitation, and feasibility data suggest increased guideline uptake following implementation. An adequately powered study is planned to understand how to support therapists to provide evidence-based upper limb rehabilitation after stroke.

Trial registration number Australian New Zealand Clinical Trials Registry (ACTRN12619000596101).

  • cluster trials
  • continuing education
  • evidence-based practice
  • implementation science
  • rehabilitation
  • continuing professional development
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

https://doi.org/10.1136/bmjoq-2020-000954

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Background

    In stroke rehabilitation, implementable evidence exists for arm and hand interventions,1 synthesised in clinical practice guidelines.2 Despite this, research indicates that such guidelines in stroke rehabilitation are often not followed.1 3 This variability in adherence suggests a problematic gap between what is known (as cited in the guidelines) and therapist decision-making in stroke rehabilitation practice. To support therapists to deliver evidence-based care and thus improve adherence to guidelines in practice, an active implementation approach is often required.4

    Implementation science seeks to understand the science behind knowledge translation models and activity efforts, so as to improve the likelihood of successful translation of research into clinical practice. We acknowledge that no ‘gold standard’ implementation activities have been identified5 6; however, it has been suggested that active and multifaceted activities are likely to work best.7 8 There are many theories, models and frameworks in the implementation literature to guide efforts9 10 and all encourage researchers and end users to employ a structured and theoretical approach.11 12 Despite the availability of these theories, it is estimated that only 10% of guideline implementation studies describe their theoretical rationale for selecting knowledge translation activities.13 In an effort to understand health professionals’ behaviour, previous studies have mapped the perceived barriers and enablers of health professionals to frameworks such as the Theoretical Domains Framework14–16; however, few subsequently develop behaviour change interventions. One can conclude from research to date that to change behaviour, understanding perceived barriers to address is important, mapping these to a model or framework to identify implementation activities, and developing a multifaceted package of active interventions maximises likelihood of therapist adherence to guideline recommendations.

    In stroke rehabilitation, there is now a good understanding of the issues faced by health professionals who seek to implement upper limb guideline recommendations.17–19 However, much work is still needed to develop and test the effectiveness of behaviour change interventions. Organisations seeking to implement clinical guidelines do not yet know what activities to fund and how they should be delivered, so as to improve therapist adherence. Active and multicomponent approaches that are grounded in theory are suggested as most likely to achieve behaviour change.20 21 In a recent systematic review that explored the benefit of implementation strategies in stroke rehabilitation, Bird et al 21 included 11 randomised controlled trial. According to Grades of Recommendation Assessment, Development and Evaluation (GRADE) criteria, the quality of included studies was low, and no studies explored the difference between high-resource investment (financial and non-financial) and low-resource investment implementation package of interventions (compared with no implementation interventions) for achieving behaviour change. Understanding the feasibility and effectiveness of high-resource and low-resource investment for implementation strategies (underpinned by behaviour change intervention mapping) would inform clinical trialists, service providers, funding bodies and therapists.22 To improve adherence to upper limb rehabilitation guidelines,1 we developed implementation strategies to specifically target the knowledge, belief in consequences and skill barriers identified in Australian stroke rehabilitation therapists.19 The aim of this study was to test the feasibility and potential efficacy of two tailored implementation packages for improving adherence to upper limb stroke rehabilitation guidelines, and to understand the acceptance from the therapists’ perspective. The following research questions were therefore addressed:

    1. Feasibility: What numbers of eligible therapists (ie, the occupational therapists and physiotherapists; target users of guidelines) consent to participate in the study? Is it feasible and acceptable to recruit patients (ie, recipients of guideline interventions) during their rehabilitation? How feasible is it to deliver the two packages (ie, facilitator-mediated implementation package and the self-directed implementation package)? Were both packages delivered per protocol?

    2. Efficacy: What is the observed effect of the two implementation packages (facilitator-mediated or self-directed) implementation packages on (a) adherence to stroke rehabilitation guidelines for upper limb rehabilitation; and (b) patient upper limb recovery? In addition, the study will provide estimates to inform future power calculations, including estimates of variability of the proposed outcomes and CI around observed treatment effects.

    3. Acceptance: What was the experience of receiving the allocated package from the perspective of the therapists?

    Method

    Design

    This was a non-randomised three-arm cluster-controlled longitudinal feasibility study, with assessment at three time-points. Participating healthcare services provided neurological rehabilitation within inpatient (ie, hospital ward-based) and/or outpatient (ie, community-based) contexts in Melbourne, Australia. Given the scope and nature of this study (ie, feasibility), sample size calculations were not conducted. Power calculations for future trials will be informed by the results generated from this work. Three organisations were approached (and agreed) to take part in this study. Of the three participating organisations, six sites (three inpatient and three outpatient) took part. Sites were pragmatically allocated (ratio 1:1:1) to one of three intervention groups:

    Group A: facilitator-mediated implementation package.

    Group B: self-directed implementation package.

    Group C: usual care.

    This study recruited both therapist and patient participants. To address the feasibility research questions, we purposively recruited one inpatient and one outpatient team per group (A, B, C). Further, we sought to recruit five or more therapists per group. Together, these purposive site recruitment decisions influenced our patient participant recruitment (ie, recipients of guideline interventions), although this remained open during the 3-month intervention period such that new admissions who were being seen by an enrolled therapist would be invited to participate in the study. Figure 1 outlines the flow of participants through the study. Figure 2 outlines the inclusion criteria for the selection of therapist and patient participants.

    Figure 1
    Figure 1

    Flow of participants through the study (therapist and patient participants).

    Figure 2
    Figure 2

    Study inclusion criteria applied for the selection of therapist and patient participants.

    For the purposes of this study, an acquired brain injury included stroke, traumatic brain injury, intracerebral haemorrhage and any other kind of brain injury acquired after birth. It did not include degenerative brain conditions such as Alzheimer’s type dementia, multiple sclerosis or Parkinson’s disease.23

    Intervention

    Using data collected from prior focus groups completed with therapists from participating organisations on the barriers and enablers for implementing the best practice arm and hand interventions,19 behaviour change intervention mapping was undertaken using the Theoretical Domains Framework,24 Behaviour Change Wheel25 and method outlined by French et al.26 Online supplementary 1 outlines the planned knowledge translation activities that contributed towards the ‘implementation package’ for each of the intervention groups. Strategies in the self-directed group were designed to be low cost, and implementable with distance (ie, no direct intermediary contact by the research team). This was the primary difference between group A (facilitator mediated) and group B (self-directed). Intervention content for group B, therefore, was delivered via ‘Trello’. Trello is an online, closed-group collaborative tool that allows a team of people to organise projects into ‘boards’, share files and post comments. Each topic area delivered to group B had a designated ‘board’ and participants were encouraged to use/read the uploaded files and post any comments/questions to the research team. Over the 12-week intervention period, implementation packages covering six key topics related to upper limb rehabilitation guidelines were delivered fortnightly (ie, one topic, each fortnight) to participants in groups A and B. Topics areas were selected based on the knowledge and skill gaps identified in focus groups, and included: task-specific motor training, setting up patient practice, functional electrical stimulation (FES), whole upper limb programme, modified constraint-induced movement therapy (CIMT) and behaviour monitoring. Two of the study investigators (LJ and NL) were responsible for delivering the face-to-face interventions to group A, and LJ was responsible for ensuring intervention delivery via Trello for group B.

    Supplemental material

    Outcome measures

    Feasibility

    1. Study recruitment of occupational therapists and physiotherapists (ie, target users of the guidelines), assessed by determining the proportion of consented/those approached.

    2. Study recruitment of patient participants, assessed by calculating the total number of patients who consented.

    3. Time commitment for study participation, assessed by calculating the total time reportedly spent on implementation activities per group.

    4. Therapists perspectives on intervention feasibility, assessed via a survey of participating therapists at completion of study.

    5. Protocol adjustments, assessed by logging the numbers and description of changes.

    Efficacy

    1. Guideline adherence by therapists, assessed using medical file audits preintervention and postintervention.

    2. Upper limb outcomes of participating patients, assessed preintervention and postintervention (administered by a researcher) using the Box and Block Test (BBT),27 Fugl-Meyer Upper Extremity Assessment,28 assessed by a research assistant. Self-reported minutes of weekly therapy (patient reported and therapist reported) were also collected.

    Acceptance

    1. Therapist participants’ acceptance of the intervention assessed by survey and a focus group. Therapist participants in groups A and B were invited by email to complete an anonymous online survey. A focus group with therapists in group A (allocated to receive the facilitator-mediated implementation package) was then conducted to further explore intervention acceptance (given this group had more time-intensive commitment to the study).

    Data analysis

    Descriptive statistics were used to describe participant characteristics, recruitment rates and responses to multiple choice survey items. Focus group data (tape recorded and transcribed verbatim) and free-text survey responses were thematically coded (10% double coded by second reviewer to establish coding reliability) and themes generated. Free-text survey responses with the highest frequency were reported in results. Summary statistics for patient outcome measures and medical file audits, broken down by group, were analysed for medians (IQR), within group proportion differences (medians with 95% CI) and between-group proportion differences (median and 95% CI) using Wilcoxon’s signed rank tests. Estimates of variability of the proposed outcomes and CI around treatment effects were reported to permit future sample size calculations. Given our patient recruitment method (ongoing recruitment throughout intervention period), patient participants enrolled after day 35 and allocated to groups A and B were removed from the analysis of ‘baseline’ adherence audits in an attempt to control for intervention contamination.

    Results

    Feasibility

    A total of 29 therapists participated (8 in facilitator mediated, 13 in self-directed and 8 in usual care groups). Of these, 11 (38%) therapists primarily worked in the outpatient setting and 18 (62%) within the inpatient setting. The majority of therapist participants were occupational therapists (87% across all groups).

    Feasibility: study recruitment of occupational and physiotherapists (target users of the guidelines)

    There was excellent participation by therapy teams, 50% of invited therapists consented to group A (facilitator mediated), 41% consented to group B (self-directed) and 47% consented to group C (usual care).

    Feasibility: study recruitment of patient participants

    A total of 55 patient participants were recruited (20 in group A, 17 in group B and 18 in group C). Of these, 19 (35%) were recruited from the outpatient setting, and 36 (65%) from the inpatient setting. Table 1 shows therapist and patient characteristics.

    View this table:
    Table 1

    Characteristics of therapist participants (n=29) and patient characteristics (n=55) in each of the three groups

    Feasibility: time commitment for study participation

    Therapists in groups A and B reported that intervention participation was time feasible within their work schedule. Group A dedicated 94 min/week on average (range 20–120) to intervention content. Group B dedicated 49 min/week on average (range 0–180) to intervention content. The majority (71%) of therapists reported the interventions to be time feasible, and did not perceive activities to take up too much of their time. Therapists’ preferences were to spend more time on the topic areas of CIMT and FES than other topic areas. In the free-text section of the survey, one therapist commented on their selection of CIMT and FES, saying “[these] were areas that I could improve upon in terms of knowledge and practical application”.

    Feasibility: therapists perspectives on intervention feasibility

    Most active intervention therapist participants (groups A and B) completed the postintervention survey (completion rate 78%). The majority (responses of ‘always’ and ‘most times’) of therapists from both groups reported that interventions made available to them were used (54%), helpful (80%), relevant (86%) and assisted them to provide evidence-based practice (EBP; 72%). Group B participants reported the use of ‘Trello Boards’ (share point for intervention content) was easy to access and navigate. Online supplementary 2 shows additional survey results and free-text responses.

    Supplemental material

    Feasibility: protocol adjustments, assessed by logging the numbers and description of changes

    Group B (self-directed) and group C (control) had no protocol adjustments. Group A required more time from the facilitator than expected and/or planned for in the protocol. The protocol adjustments were all related to requests for tailored resources (ie, development of five additional/unplanned patient handouts) and/or additional modelling/demonstration sessions with patient participants (six in total, each of 60 min duration). No harm or unintended effect was evident in any group throughout the study.

    Efficacy

    Efficacy: guideline adherence by therapist participants

    Significant behaviour change was observed between preintervention and postintervention audits in group A (facilitator mediated), with a median within-group proportion increase to guideline adherence of 0.29 (95% CI 0.22 to 0.26, p<0.0001). No observed effect for within-group differences were found in group B or group C between preintervention and postintervention audits. Group A adhered to guidelines significantly more than and group B, with a median between-group difference of 0.26 (95% CI 0.16 to 0.34, p<0.0001). Effect estimates in adherence to guidelines was also found between group A (facilitator mediated) and group C (usual care), with a median difference of 0.29 (95% CI 0.21 to 0.37, p<0.0001). No observed effect for between-group differences was found between groups B (self-directed) and C (usual care).

    Efficacy: upper limb outcomes of participating patients

    An increase in minutes of practice (105, 95% CI −20 to 345) of upper limb activities for patient participants was observed from pre-to post-intervention (ie, within group changes) in group A (facilitator mediated) and group C (usual care; 87.5, 95% CI −5 to 177.5). No increase in time was observed in group B participants (self-directed). There were also no between-group observed effects. All groups improved preintervention to postintervention on the BBT; however, no observed effects were found for between-group differences. Observed effect for within-group improvements on the Fugl-Meyer Upper Extremity Assessment was found for groups A (facilitator-mediated) and C (usual care). See table 2 for full results.

    View this table:
    Table 2

    Median (IQR) of groups, median within group change (95% CI) and median difference between change scores (95% CI; p value)

    Acceptance

    Acceptance of implementation packages (groups A and B)

    Both groups reported the implementation packages to be helpful and used; however, free-text comments in survey responses suggest that therapists allocated to group B (self-directed) would have found the intervention more beneficial if additional structure in the form of face-to-face sessions with hands on demonstration was provided. The free-text comments from participants in group A (facilitator mediated) positively reflected on the benefit of face-to-face sessions and audit and feedback, and expressed gratitude for their involvement. There was a high attendance to group A’s (facilitator mediated) postintervention focus group (75%). Five themes emerged from the focus group: provision of tailored and accessible resources was valuable; equipment and resource availability allowed timely intervention provision; skilled behaviour monitoring incentivised EBP; direct modelling prioritised and facilitated optimal learning and study participation increased skill, knowledge and confidence. Therapists spoke positively about the usefulness of tailored resources (such as patient handouts and/or therapist workbooks) which they felt saved them time in the longer term. Audit and feedback sessions were reported to be motivating, with therapists commenting that “The [facilitator] broke it down really well” and feedback described as “very encouraging…I think that’s what helped that motivation”. Therapists reported that modelling of interventions by the facilitator promoted learning and confidence; “It means you can have a go, like hands-on, someone there to support you. Rather than just watching [a video]. Because sometimes with patients, there are those slight [differences], so you can problem solve with the [facilitator]”. Overall, therapists felt their involvement in the study had changed their practice; “It’s 100 per cent changed my practice, and the study is still very much at the forefront of my mind when I’m doing [upper limb rehabilitation]. It’s absolutely had a flow-on effect and a really positive one” and “I have changed what I do with a patient’s upper limb. I think I am more efficient in time as well”. Figure 3 outlines themes and subcategory themes.

    Figure 3
    Figure 3

    Feasibility focus group themes and subcategories from facilitator-mediated implementation group therapist participants (n=6). EBP, evidence-based practice.

    Discussion

    This study’s main finding is that providing a facilitator-mediated implementation package to occupational and physiotherapists was feasible and acceptable. Observed improvements in guideline adherence by therapists who received the facilitator-mediated package, inclusive of multiple implementation strategies, suggest that it may also lead to therapist behaviour change in provision of upper limb rehabilitation after stroke. No changes in therapist behaviour were found in either the self-directed implementation package or usual care groups, suggesting that providing a low-resource implementation package may be no more effective than usual care in terms of delivering guideline-based upper limb rehabilitation after stroke. While significant improvements in patient upper limb outcomes were found within groups, there were no between-group differences on any measure.

    Our study was able to recruit well within each site, with around half of eligible therapists individually consenting to be active participants in the study (and 100% of eligible occupational therapists taking part at three of the six sites). This high recruitment rate may indicate therapists’ self-identified need to improve their knowledge and skills in upper limb therapy provision after stroke. The large representation of occupational therapists in our study is not surprising given that the role of upper limb rehabilitation is an occupational therapy domain of practice.29 30 We do, however, acknowledge that this may be contextually different in countries outside of Australia.

    Findings also provide guidance for the development of other rehabilitation implementation interventions beyond upper limb therapy. Discussions and themes generated from the focus group held with participants of the facilitator-mediated group suggest that: (1) use of a facilitator; (2) interactive and regular education sessions; (3) targeted resources; (4) role modelling and (5) behaviour monitoring (fortnightly audit and feedback) were activities perceived by participants to contribute to their own changes in behaviour. While the self-directed group also received targeted resources and regular written education packs, the key differences were regular interactions with a facilitator and behaviour monitoring. This finding has important implications for future implementation efforts. Both intervention groups required financial and non-financial resources (eg, equipment and facilitator time); however, the facilitator-mediated group required significantly more investment than the self-directed group. Given that the self-directed implementation package was no more effective in achieving therapist behaviour change than our usual care group, investment in implementation activities without facilitation and audit feedback (as such received by the self-directed group) may not yield behaviour change. Results demonstrate that therapists are less prepared to implement knowledge gained through online approaches. One potential reason is that they spend comparatively less time in the virtual world than other professions (for example, academics or managerial staff) potentially contributing to the disconnect between screen learning and practice. More likely, however, is the physical and practical nature of the learning content. Most therapeutic interventions are complex, nuanced and require physical application (ie, therapists handing/positioning equipment or the physical position of the patient). Given this, such therapies need to be physically practised or role modelled to ensure comprehensive learning for accurate replication (or application) with patients. It is therefore unsurprising that therapists have a preference for learning in small group environments and/or through demonstrations with patients,19 further supported by the acceptability feedback we received from both groups of this study. More time commitment was also required by therapists in the facilitator-mediated group, yet despite this, therapists reported interventions to be time feasible and perceived it to save them time in other ways (eg, establishing patient programmes). This perceived ‘time tradeoff’ is likely to also contribute to the positive acceptance of the study intervention, with therapists reporting personal and clinical benefits (increased skill and confidence, and clinical changes observed in their patients). Therapists in the self-directed group also reported their involvement to be time feasible (although they spent less time engaged in study interventions); however, they were not as satisfied with the time investment tradeoff for perceived increased skill and confidence.

    Due to the small sample and lack of randomisation, no conclusion about patient upper limb outcomes between the three clusters can be made (no estimate of effect between-group differences was found). Patients in the facilitator-mediated inpatient group were on average 176 days post injury at the time of recruitment, compared with an average of 40 and 36 days in the self-directed and usual care groups, respectively. This may be a contributing factor to limited between-group differences of upper limb outcome measures. Few implementation studies measure patient outcomes, and future studies should incorporate this into their protocol design.

    Previous allied health studies investigating the effectiveness of knowledge translation activities have reported little to no effect,31 which may be due in part to lack of explicit rationale for (1) intervention choice and (2) inappropriate methods to design translation activities.22 32 Our study interventions (ie, implementation packages) were informed by implementation theory,24 25 and underpinned by behaviour change implementation mapping.26 In this way, our knowledge translation activities were theoretically developed (explicitly) as opposed to pragmatically developed33 or conceptually based, and this may have contributed towards our successful study findings. As indicated by Davis et al,22 greater use of explicit theories in understanding barriers and designing interventions is required to advance the science of implementation. Additionally, promising knowledge translation activities reported in previous research or recommended for use in systematic reviews were incorporated into our intervention designs. For example, learnings from successful behaviour change trials such as Bekkering et al34 and Martin et al35 suggested the use of interactive education sessions, role modelling, rehearsal and performance feedback activities. Novel approaches were also employed such as the use of a facilitator (or ‘knowledge broker’ as described by Dobbins et al36) to establish a relationship between research producers and end users via interactive and face-to-face contact.

    Two recent and notable behaviour change studies in stroke, the out and about trial37 and implementation of the Assessment for Rehabilitation Tool38 did not lead to behaviour change of therapists. In a cluster randomised control study, Lynch et al38 delivered active, multimodal knowledge translation activities (informed by conceptual theory) over 2 weeks, followed by phone call reminders in the month following intervention. While they conducted a barrier and enabler workshop and facilitated the development of ‘action plans’, they relied on site-based opinion leaders to implement and enact the action plans. In contrast, our study developed translation activities explicitly informed by theory, and supported implementation within the workplace context using a facilitator (knowledge broker). Additionally, we conducted fortnightly audit and feedback to therapists (12 rounds in total) about their compliance to guideline recommendations, whereas Lynch et al38 and McCluskey et al37 completed audit and feedback on one occasion, respectively. Strategies employed by both studies, while active and multimodal in approach, were not delivered with the same frequency (ie, interaction ‘dose’) and did not contain the same type of face-to-face activities (ie, modelling and rehearsal) as our study did (in the facilitator-mediated group). This is likely to be a contributing factor to the differences in behaviour change outcomes. Activities used in our self-directed implementation package group also contained active and multimodal approaches, yet were less interactive than activities used in Lynch et al38 and McCluskey et al37 trials. As concluded by Bird et al,21 the use of a facilitator appears to be a successful implementation intervention component within an implementation strategy. This finding is consistent with the findings of our study. The use of a facilitator (or knowledge broker) often removes championing tasks from busy therapists, and as identified in this study may lead to time saved in other work tasks.39 Frequency and dose of face-to-face interaction may be an important factor in successful behaviour change. While the use of opinion leaders is thought to promote EBP,40 asking therapists to champion change on top of their current workload is not ideal.

    There are some limitations of this study. First, the sample size is small and caution needs to be taken when interpreting results. Grimshaw et al41 suggest that a randomised cluster controlled trial is the ideal design for implementation allowing head-to-head comparisons of activities; however, multiple arm groups are compromised by a loss of statistical power. Second, given the scope of this study (feasibility), we were unable to randomise the clusters, which would have greatly strengthened the design. Third, our method of recruitment (ongoing patient recruitment during the 3-month intervention period) meant that some patients were enrolled mid-way through the study, so given that the treating therapist was receiving study interventions, the baseline medical file audit for that patient may not be a true reflection of the therapist ‘preintervention’ behaviour. We attempted to control for this by removing baseline audits of patient participants enrolled after day 35 in the facilitator-mediated and self-directed implementation groups. Finally, the majority of therapist participants were occupational therapists, which may reduce generalisability of the results to physiotherapists.

    Conclusion

    This study provides novel findings about high-resource and low-resource investment in implementation packages. Low-resource investment into knowledge translation activities was found to be no more effective than usual care for behaviour change with rehabilitation therapists working with stroke survivors. Given the results of this feasibility study, a randomised trial is warranted to test effectiveness of these intervention packages on therapist behaviour change and patient upper limb outcomes.

    References

    1. ↵
      1. Stroke Foundation,
      . Clinical guidelines for stroke management 2017. Melbourne, Australia: Stroke Foundation, 2017.
    2. ↵
      1. Jolliffe L,
      2. Lannin NA,
      3. Cadilhac DA, et al
      . Systematic review of clinical practice guidelines to identify recommendations for rehabilitation after stroke and other acquired brain injuries. BMJ Open 2018;8:e018791.doi:10.1136/bmjopen-2017-018791pmid:http://www.ncbi.nlm.nih.gov/pubmed/29490958
      OpenUrlAbstract/FREE Full Text
    3. ↵
      1. Smaha LA, American Heart Association
      . The American heart association get with the guidelines program. Am Heart J 2004;148:S46–8.doi:10.1016/j.ahj.2004.09.015pmid:15514634
      OpenUrlCrossRefPubMedWeb of Science
    4. ↵
      1. Grimshaw JM,
      2. Thomas RE,
      3. MacLennan G, et al
      . Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess 2004;8:1–72.doi:10.3310/hta8060pmid:http://www.ncbi.nlm.nih.gov/pubmed/14960256
      OpenUrlPubMed
    5. ↵
      1. Grimshaw JM,
      2. Eccles MP,
      3. Lavis JN, et al
      . Knowledge translation of research findings. Implement Sci 2012;7:50.doi:10.1186/1748-5908-7-50pmid:http://www.ncbi.nlm.nih.gov/pubmed/22651257
      OpenUrlCrossRefPubMed
    6. ↵
      1. Grol R,
      2. Grimshaw J
      . From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003;362:1225–30.doi:10.1016/S0140-6736(03)14546-1pmid:http://www.ncbi.nlm.nih.gov/pubmed/14568747
      OpenUrlCrossRefPubMedWeb of Science
    7. ↵
      1. Prior M,
      2. Guerin M,
      3. Grimmer-Somers K
      . The effectiveness of clinical guideline implementation strategies--a synthesis of systematic review findings. J Eval Clin Pract 2008;14:888–97.doi:10.1111/j.1365-2753.2008.01014.xpmid:http://www.ncbi.nlm.nih.gov/pubmed/19018923
      OpenUrlCrossRefPubMedWeb of Science
    8. ↵
      1. Menon A,
      2. Korner-Bitensky N,
      3. Kastner M, et al
      . Strategies for rehabilitation professionals to move evidence-based knowledge into practice: a systematic review. J Rehabil Med 2009;41:1024–32.doi:10.2340/16501977-0451pmid:http://www.ncbi.nlm.nih.gov/pubmed/19893996
      OpenUrlCrossRefPubMedWeb of Science
    9. ↵
      1. Moullin JC,
      2. Sabater-Hernández D,
      3. Fernandez-Llimos F, et al
      . A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Res Policy Syst 2015;13:16.doi:10.1186/s12961-015-0005-zpmid:http://www.ncbi.nlm.nih.gov/pubmed/25885055
      OpenUrlCrossRefPubMed
    10. ↵
      1. Michie S, et al
      . ABC of behaviour change theories. Great Britain, UK: Silverback Publishing, 2014.
    11. ↵
      1. Grol RPTM,
      2. Bosch MC,
      3. Hulscher MEJL, et al
      . Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q 2007;85:93–138.doi:10.1111/j.1468-0009.2007.00478.xpmid:http://www.ncbi.nlm.nih.gov/pubmed/17319808
      OpenUrlCrossRefPubMedWeb of Science
    12. ↵
      1. Damschroder LJ,
      2. Aron DC,
      3. Keith RE, et al
      . Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci 2009;4:50.doi:10.1186/1748-5908-4-50pmid:http://www.ncbi.nlm.nih.gov/pubmed/19664226
      OpenUrlCrossRefPubMed
    13. ↵
      1. Michie S,
      2. Abraham C
      . Interventions to change health behaviours: evidence-based or evidence-inspired? Psychol Health 2004;19:29–49.doi:10.1080/0887044031000141199
      OpenUrlCrossRefWeb of Science
    14. ↵
      1. Sakzewski L,
      2. Ziviani J,
      3. Boyd RN
      . Delivering evidence-based upper limb rehabilitation for children with cerebral palsy: barriers and enablers identified by three pediatric teams. Phys Occup Ther Pediatr 2014;34:368–83.doi:10.3109/01942638.2013.861890pmid:http://www.ncbi.nlm.nih.gov/pubmed/24303800
      OpenUrlPubMed
    15. ↵
      1. Lawton R,
      2. Heyhoe J,
      3. Louch G, et al
      . Using the theoretical domains framework (TDF) to understand adherence to multiple evidence-based indicators in primary care: a qualitative study. Implement Sci 2015;11:113.doi:10.1186/s13012-016-0479-2
      OpenUrl
    16. ↵
      1. Craig LE,
      2. McInnes E,
      3. Taylor N, et al
      . Identifying the barriers and enablers for a triage, treatment, and transfer clinical intervention to manage acute stroke patients in the emergency department: a systematic review using the theoretical domains framework (TDF). Implement Sci 2016;11:157.doi:10.1186/s13012-016-0524-1pmid:http://www.ncbi.nlm.nih.gov/pubmed/27894313
      OpenUrlPubMed
    17. ↵
      1. McCluskey A,
      2. Vratsistas-Curto A,
      3. Schurr K
      . Barriers and enablers to implementing multiple stroke guideline recommendations: a qualitative study. BMC Health Serv Res 2013;13:323.doi:10.1186/1472-6963-13-323pmid:http://www.ncbi.nlm.nih.gov/pubmed/23958136
      OpenUrlCrossRefPubMed
    18. ↵
      1. Donnellan C,
      2. Sweetman S,
      3. Shelley E
      . Implementing clinical guidelines in stroke: a qualitative study of perceived facilitators and barriers. Health Policy 2013;111:234–44.doi:10.1016/j.healthpol.2013.04.002pmid:http://www.ncbi.nlm.nih.gov/pubmed/23643101
      OpenUrlCrossRefPubMedWeb of Science
    19. ↵
      1. Jolliffe L,
      2. Hoffmann T,
      3. Lannin NA
      . Increasing the uptake of stroke upper limb guideline recommendations with occupational therapists and physiotherapists. A qualitative study using the theoretical domains framework. Aust Occup Ther J 2019;66:603–16.doi:10.1111/1440-1630.12599pmid:http://www.ncbi.nlm.nih.gov/pubmed/31338859
      OpenUrlPubMed
    20. ↵
      1. LaRocca R,
      2. Yost J,
      3. Dobbins M, et al
      . The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health 2012;12:751.doi:10.1186/1471-2458-12-751pmid:http://www.ncbi.nlm.nih.gov/pubmed/22958371
      OpenUrlCrossRefPubMed
    21. ↵
      1. Bird M-L,
      2. Miller T,
      3. Connell LA, et al
      . Moving stroke rehabilitation evidence into practice: a systematic review of randomized controlled trials. Clin Rehabil 2019;33:1586–95.doi:10.1177/0269215519847253pmid:http://www.ncbi.nlm.nih.gov/pubmed/31066289
      OpenUrlPubMed
    22. ↵
      1. Davies P,
      2. Walker AE,
      3. Grimshaw JM
      . A systematic review of the use of theory in the design of guideline dissemination and implementation strategies and interpretation of the results of rigorous evaluations. Implement Sci 2010;5:14.doi:10.1186/1748-5908-5-14pmid:http://www.ncbi.nlm.nih.gov/pubmed/20181130
      OpenUrlCrossRefPubMed
    23. ↵
      1. Toronto ABI Network
      . Definition ABI, 2018. Available: http://www.abinetwork.ca/definition
    24. ↵
      1. Cane J,
      2. O'Connor D,
      3. Michie S
      . Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci 2012;7:37.doi:10.1186/1748-5908-7-37pmid:http://www.ncbi.nlm.nih.gov/pubmed/22530986
      OpenUrlCrossRefPubMed
    25. ↵
      1. Michie S,
      2. Atkins L,
      3. West R
      . The behaviour change wheel: a guide to designing interventions. Great Britain: Silverback Publishing, 2014.
    26. ↵
      1. French SD,
      2. Green SE,
      3. O'Connor DA, et al
      . Developing theory-informed behaviour change interventions to implement evidence into practice: a systematic approach using the theoretical domains framework. Implement Sci 2012;7:38.doi:10.1186/1748-5908-7-38pmid:http://www.ncbi.nlm.nih.gov/pubmed/22531013
      OpenUrlCrossRefPubMed
    27. ↵
      1. Platz T,
      2. Pinkowski C,
      3. van Wijck F, et al
      . Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer test, action research arm test and box and block test: a multicentre study. Clin Rehabil 2005;19:404–11.doi:10.1191/0269215505cr832oapmid:http://www.ncbi.nlm.nih.gov/pubmed/15929509
      OpenUrlCrossRefPubMedWeb of Science
    28. ↵
      1. Fugl-Meyer AR,
      2. Jääskö L,
      3. Leyman I, et al
      . The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand J Rehabil Med 1975;7:13–31.pmid:http://www.ncbi.nlm.nih.gov/pubmed/1135616
      OpenUrlPubMedWeb of Science
    29. ↵
      1. The American Occupational Therapy Association
      . The role of occupational therapy for rehabilitation of the upper extremity, 2018. Available: https://www.aota.org/About-Occupational-Therapy/Professionals/RDP/The%20Role%20of%20Occupational%20Therapy%20for%20Rehabilitation%20of%20the%20Upper%20Extremity.aspx
    30. ↵
      1. Wolf SL,
      2. Winstein CJ,
      3. Miller JP, et al
      . Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: the excite randomized clinical trial. JAMA 2006;296:2095–104.doi:10.1001/jama.296.17.2095pmid:http://www.ncbi.nlm.nih.gov/pubmed/17077374
      OpenUrlCrossRefPubMedWeb of Science
    31. ↵
      1. Scott SD,
      2. Albrecht L,
      3. O'Leary K,
      4. O’Leary K, et al
      . Systematic review of knowledge translation strategies in the allied health professions. Implement Sci 2012;7:70.doi:10.1186/1748-5908-7-70pmid:http://www.ncbi.nlm.nih.gov/pubmed/22831550
      OpenUrlCrossRefPubMed
    32. ↵
      1. Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG)
      . Designing theoretically-informed implementation interventions. Implement Sci 2006;1:4.doi:10.1186/1748-5908-1-4pmid:http://www.ncbi.nlm.nih.gov/pubmed/16722571
      OpenUrlCrossRefPubMed
    33. ↵
      1. Rothman AJ
      . "Is there nothing more practical than a good theory?": Why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. Int J Behav Nutr Phys Act 2004;1:11.doi:10.1186/1479-5868-1-11
      OpenUrlCrossRefPubMed
    34. ↵
      1. Bekkering GE, et al
      . Effect on the process of care of an active strategy to implement clinical guidelines on physiotherapy for low back pain: a cluster randomised controlled trial. Quality and Safety in Health Care 2005;14:107–12.doi:10.1136/qshc.2003.009357
      OpenUrlAbstract/FREE Full Text
    35. ↵
      1. Martin BA,
      2. Bruskiewitz RH,
      3. Chewning BA
      . Effect of a tobacco cessation continuing professional education program on pharmacists' confidence, skills, and practice-change behaviors. J Am Pharm Assoc 2010;50:9–18.doi:10.1331/JAPhA.2010.09034pmid:http://www.ncbi.nlm.nih.gov/pubmed/20097634
      OpenUrlCrossRefPubMed
    36. ↵
      1. Dobbins M,
      2. Robeson P,
      3. Ciliska D, et al
      . A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implement Sci 2009;4:23.doi:10.1186/1748-5908-4-23pmid:http://www.ncbi.nlm.nih.gov/pubmed/19397820
      OpenUrlCrossRefPubMed
    37. ↵
      1. McCluskey A,
      2. Ada L,
      3. Kelly PJ, et al
      . A behavior change program to increase outings delivered during therapy to stroke survivors by community rehabilitation teams: the Out-and-About trial. Int J Stroke 2016;11:425–37.doi:10.1177/1747493016632246pmid:http://www.ncbi.nlm.nih.gov/pubmed/26906448
      OpenUrlCrossRefPubMed
    38. ↵
      1. Lynch EA,
      2. Cadilhac DA,
      3. Luker JA, et al
      . Education-only versus a multifaceted intervention for improving assessment of rehabilitation needs after stroke; a cluster randomised trial. Implement Sci 2016;11:120.doi:10.1186/s13012-016-0487-2pmid:http://www.ncbi.nlm.nih.gov/pubmed/27604792
      OpenUrlPubMed
    39. ↵
      1. Simms AM
      . A novel theory-based implementation intervention to increase prescription of inspiratory muscle training for people with chronic obstructive pulmonary disease. In: Rehabilitation sciences. University of British Columbia, 2010.
    40. ↵
      1. Flodgren G,
      2. Parmelli E,
      3. Doumit G, et al
      . Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev 2011;8:CD000125.doi:10.1002/14651858.CD000125.pub4pmid:http://www.ncbi.nlm.nih.gov/pubmed/21833939
      OpenUrlPubMed
    41. ↵
      1. Grimshaw J,
      2. Campbell M,
      3. Eccles M, et al
      . Experimental and quasi-experimental designs for evaluating guideline implementation strategies. Fam Pract 2000;17(Suppl 1):11S–16.doi:10.1093/fampra/17.suppl_1.S11pmid:http://www.ncbi.nlm.nih.gov/pubmed/10735262
      OpenUrlPubMed

    Footnotes

    • Twitter @natashalannin

    • Contributors NAL, LJ and TH contributed to the design of the study. LJ and NAL acquired the data, and all authors completed the analysis and interpretation of data. All authors participated in drafting the article or revising it critically for important intellectual content; and all give final approval of submitted article.

    • Funding National Health and Medical Research Council fellowships were received by LJ (GNT1114522) and NAL (GNT1112158) during this study. NAL is supported by a fellowship (102055) from the National Heart Foundation of Australia.

    • Competing interests None declared.

    • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

    • Patient consent for publication Not required.

    • Ethics approval The Alfred Health, La Trobe University and Peninsula Health’s Human Research Ethics Committee approved this study (HREC-16-Alfred-174, local reference 565/16). All participants gave written informed consent before data collection began.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data availability statement The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.