Skip to main content

Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework

Abstract

For the fields of implementation science and health equity, understanding and being responsive to local contexts is of utmost importance to better inform the development, implementation, and evaluation of healthcare and public health interventions to increase their uptake and sustainment. Contexts are multi-level and include political, historical, economic, and social factors that influence health, as well as organizational characteristics, reflecting the richness of members’ views, resources, values, and needs. Poor alignment between solutions and those contextual characteristics could have an impact on inequities. The PRISM (Practical Robust Implementation and Sustainability Model) is a context-based implementation science framework that incorporates RE-AIM outcomes (Reach, Effectiveness, Adoption, Implementation, Maintenance) and offers guidance to researchers, practitioners, and their patient and community partners on how to conceptualize, assess, and address contextual domains with a focus on health equity. Drawing from systems thinking, participatory engagement, and health equity principles, this commentary expands on previous work to 1) offer a novel perspective on how to align an intervention’s core functions and forms with the PRISM’s contextual domains, and 2) foster an ongoing and iterative engagement process with diverse partners throughout the research and practice process using a co-creation approach. We recommend intervention-to-context alignment through iterative cycles. To that end, we present the RE-AIM Framework’s ‘outcomes cascade’ to illustrate touch points of opportunity and gaps within and across each of the five RE-AIM outcomes to illustrate ‘where things go wrong’. We present a case study to illustrate and offer recommendations for research and practice efforts to increase contextual responsiveness, and enhance alignment with context before, during, and after implementation efforts and to ensure equity is being addressed. We strive to make a conceptual contribution to advance the field of pragmatic research and implementation of evidence-based practices through the application of the contextually-based PRISM framework with a focus on health equity.

Background

There is increased priority by communities, researchers, practitioners and funding agencies to design, implement, and evaluate interventions from a health equity and participatory focus [1, 2]. Having a good understanding of the local contexts where interventions are implemented is crucial to meeting this health equity goal [3]. Local contexts reflect not only the physical setting, richness of values, needs, priorities, resources, and healthcare systems, but also the political, historical, economic, and social factors that influence health [4].

We define intervention broadly. Our definition includes any program, training, treatment, policy, action or implementation strategy (i.e., activities supporting the adoption, uptake and sustainment of the intervention) [5] taken to prevent or treat disease, or improve health in other ways [6]. We also focus on a systems perspective to understand how complex interventions align with local dynamic contexts, and are centered on equity and inclusion. Complex interventions refer to those with multiple and interacting components that require coordinated action among implementers and flexibility in their implementation to capture the dynamic nature of diverse local contexts [7,8,9].

A co-creation engagement with diverse partners such as patients, caregivers, community members, policymakers and professional practitioners is needed to fully understand key contextual characteristics [10, 11]. For example, clinical personnel (e.g., providers, managers) can offer feedback on how an evidence-based intervention is best delivered within a local context and based on its characteristics (e.g., resources, infrastructure), as well as patients on how the intervention is presented and received. This contextual understanding is critical because even if an evidence-based intervention is available and shown to be effective, its impact could be limited by an unsuccessful and inequitable design, implementation, and evaluation. A contextual understanding can also foster an equitable implementation process and ultimately contribute to the attainment of equity outcomes (e.g., Reach and Representativeness) that matter to implementers (e.g., clinicians, public health staff) as well as to patients, caregivers, and communities impacted while preventing or reducing unintended consequences.

Implementation Science (IS) can offer guidance on aligning interventions to local contexts with an equity focus. IS is the study of “…methods to promote the systematic uptake of research findings and other evidence-based practice into routine practice, and hence, to improve the quality and effectiveness of health services.” [12]. IS underscores a need to understand local contextual domains such as community members’ priorities, needs, and values as well as organizational perspectives, resources, and infrastructure because these factors impact an intervention’s uptake, equitable implementation, and impact [13,14,15]. The IS emphasis on context is reflected in the use of frameworks and models to guide the identification of these key contextual domains [16].

The concept of engaging clinical and community partners in research and implementation efforts is not new. There are important contributions from adjacent fields such as health equity research [17, 18], CBPR [11, 19], and from methodology within the implementation field such as mapping [20, 21] and participatory systems modeling [22, 23]. Our approach broadens and contributes to these efforts by combining a pragmatic IS framework (PRISM) with a systems science-based concept (function-form), and emphasizing iterative application of a monitoring process for intervention-context alignment through a ‘RE-AIM cascade’ described below. Collective reflection on these iterative cycles may be aligned with Oscar Jara’s concept of the ‘Systematization of Experiences’ which applies critical reflection to better understand experiences within their historical context and link research and action in a single participatory process [24].

This paper proposes a model of interactions that could enhance an equitable implementation process. We expand our previous work from co-authors and others [4, 25,26,27] on the application of the Practical, Robust Implementation and Sustainability (PRISM) model from equity and systems perspectives. Our goal is to offer guidance to researchers and practitioners on the use of a) PRISM to align contextual needs with the design and evaluation of healthcare and public health interventions from a systems thinking perspective, b) a co-creation engagement approach to actively inform that alignment process [28], and c) the RE-AIM ‘Outcomes Cascade’, framed as a way to inform and support a formative evaluation, to achieve an intervention-to-context alignment using reflective micro-cycles. To illustrate these approaches, we present two case examples, discuss lessons learned, and provide suggestions for future research and practice.

The Practical Implementation Sustainability Model (PRISM)

PRISM was developed as a pragmatic and intuitive model to improve translation of research-tested interventions into health systems practice and ultimately population health impact [29]. PRISM is a context-oriented IS framework that can guide researchers and practitioners to understand, assess and address structural drivers of health inequities and be better informed to address them during design, implementation, and evaluation. PRISM is both a determinant and evaluation framework in the classification suggested by Nilsen [30] and has more recently also been used as a process framework in that is used in planning, implementing and evaluating projects as discussed in detail in Glasgow et al. (2019) [31] and Holtrop et al. (2021) [32]. As the top of Fig. 1 illustrates, PRISM addresses context by considering how 1) perspectives on the program, policy, or intervention; 2) the external environment; 3) the implementation and sustainability infrastructure; and 4) the characteristics of those involved in delivering and receiving a program influence program adoption, implementation, and maintenance.

Fig. 1
figure 1

Illustration of the Practical Implementation Sustainability Model (PRISM) and RE-AIM Outcomes

Within the intervention domain, PRISM incorporates the perspectives of community members who receive the intervention, and the implementation staff members – or implementers of an intervention—at different levels of influence (e.g., those in leadership positions, mid-level managers, and frontline staff who interface more directly with the public) [33] to help understand what factors need to be considered and addressed for successful implementation and sustainment of complex interventions [34, 35]. Inclusion of the Implementation and Sustainability Infrastructure domain was based on experience in healthcare settings in which those settings that were able to implement and sustain programs most consistently had infrastructure and support processes and resources to deliver the intervention.

As shown in Fig. 1, the PRISM contextual domains along with the selected implementation strategies are conceptualized to impact five RE-AIM implementation outcomes in the bottom of the Figure [32, 36, 37]. Space limitations preclude detailed review of the more widely known RE-AIM outcome dimensions However, we highlight two issues that are especially important for equity. The first is that PRISM includes RE-AIM- it is an extension of the earlier RE-AIM framework that adds contextual domains hypothesized to impact RE-AIM outcomes- rather than a different framework. The second point concerns representativeness (or equity) of results on the various RE-AIM outcomes. It is important to stress that representativeness- or equity- is important across all RE-AM dimensions- not just reach as is most commonly reported [38, 39].

The PRISM contextual domains pragmatically identify key factors relevant to equity. and when addressed, can enhanced equity within broader socio-political-historical-structural contexts that sustain or challenge inequities [4]. We also encourage ongoing assessment of PRISM domains during the pre-implementation, implementation, and post-implementation phases of specific factors relevant to equity. Using PRISM allows for equity and sustainability planning from the outset by acknowledging a need for tailoring implementation efforts and resources in a way that maintains equality and fairness [40].

As RE-AIM outcomes are inter-dependent, an intervention’s impact in one outcome may trigger cascading changes in other outcomes (e.g., uneven Adoption of interventions leading to unintended consequence of selective Reach). Thus, adaptations and tailoring are almost always needed through iterative cycles to address interdependence, and avoid unintended consequences [41, 42]. Tailoring can include local changes in policy, or a need to address potential unintended consequences early on as a way to increase the cultural and equity relevance of the intervention. See Fig. 2 depicting previous work on applying the PRISM and RE-AIM model to include equity considerations and that we use as a starting point in this paper.

Fig. 2
figure 2

PRISM (and RE-AIM Outcomes) with an equity lens

Use of PRISM to align interventions to local contexts from a systems perspective

Most often, complex health-related interventions are implemented in dynamic and diverse contexts [7, 43, 44]. Thus, the ongoing process of fit or alignment to local dynamic contexts is critical to the successful design, adoption, implementation and sustainment of health-related interventions [45]. Yet, there is a lack of guidance on specifying exactly how to align interventions to local contexts. We propose the use of two concepts from the complex systems literature to align intervention’s core functions and forms to contextual characteristics. An intervention’s core functions refer to “what the intervention was intended to do” [46], the structural or procedural goals designed to meet system and/or patients’ needs [7]. Using PRISM to align an intervention’s core functions to local contexts is critical to preserving the integrity and fidelity of the intervention and the change process [7, 46]. For example, for a clinical intervention where families are screened in primary care for psychosocial needs, a core function of that intervention is of increasing caregiver awareness and knowledge of the impact of toxic stress and trauma on children’s development. This function or goal could be negatively impacted by a history in the United States of negative experiences between minoritized families and local enforcing child protective service agencies [47].

An intervention’s forms refer to a flexible menu of activities, procedures, steps or implementation strategies that local communities or healthcare systems adopt to carry out a core function, to make it work for them in their setting (e.g., webinars, informational handouts, peer coaching, website). Forms can also be considered to be context-dependent adaptations or implementation strategies. They are also dependent on the level of function from a particular intervention (e.g., broad/macro-level public health function versus a specific health prevention education function). Forms then can change to adapt to the dynamic and diverse nature of local contexts, while preserving fidelity to the intervention’s core functions [7, 46]. Thus, Functions and forms are “ways to conceptualize an intervention’s change process (or mechanism) and specify its components…consistent with theory.” (P. Hawe, personal communication, October 11, 2023). In the example provided, forms could include trained peer partners during the implementation of pediatric screenings and subsequent service referrals to support families and overcome mistrust. Pérez Jolles and colleagues have suggested the creation of an aligned need-function-form matrix as a tool to guide this alignment process [7].

Co-creation engagement approach: Better informing the intervention-to-context alignment process

A key to a successful implementation of interventions is to tailor their implementation to local contextual characteristics. Thus, an active and participatory engagement with diverse partners that include patients and community members is suitable to better inform that tailoring. More specifically, researchers’ and practitioners’ efforts to promote a participatory co-creation engagement [48,49,50] approach throughout a research/practice process can ensure that the planning, development, and implementation of interventions reflect the needs, resources, priorities and values of local communities and healthcare systems [28, 51]. Co-creation with a focus on equity has been used in other fields (e.g., equity research, anthropology, civic engagement, community psychology and prevention science) [52,53,54,55] and defined asa group process where all partners actively share their knowledge, experiences, skills and resources [28, 51, 56]. It is important for the field of Implementation Science to learn from these fields with a history of using this concept of co-creation in the context of anti-colonial scholarship [57, 58].

We conceptualize co-creation as an overarching type of engagement, within the spectrum of Community-Based Participatory Research (CBPR), where researchers create the group conditions for all partners to contribute to building the knowledge and direction of all or some of these areas: (a) needs assessment and priority selection, (b) the intervention (e.g., design and development), (c) the research study or evaluation process, and (d) the implementation and dissemination plan [59,60,61].

Co-creation is well suited to inform the alignment of intervention-to-context process because historically under-represented and minoritized partners are empowered to share their experiences, preferences, and needs, be part of priority selection, and actively contribute to the knowledge built and to inform the direction of the research or practice process [28]. Previous research have identify five core functions of co-creation engagement that are rooted in equity, inclusion and justice (i.e., equity in relationship building, spaces for reflexivity, reciprocity and mutuality, personalized and transformative engagement experience for partners, and diverse and open social networks) [28]. From this perspective, a co-creation engagement is a multi-level engagement effort implemented in dynamic contexts. As such, the concepts of core functions and form is compatible with a co-creation engagement. Co-creation core functions (principles or goals) and concrete forms have been identified from the literature and discussions with national researchers and community members [50] as shown in Table 1 [28].

Table 1 Functions and forms matrix for a co-creation engagement strategy in engaged research

It is essential to structure a co-creation engagement through clear and iterative steps. We have implemented the following steps in our work [62]: (a) careful planning of the group process to promote co-creation core functions through concrete forms (Table 1); (b) perform a needs assessment with partners and informed by a framework such as the PRISM to align intervention to context; (c) design tailored strategies to support the implementation of the intervention; (d) evaluate the group process and its impact on implementation and outcomes. In addition, we acknowledge that engagement is an active process of activities among partners, and that it is important to consider the PRISM contextual domains continuously during this process to actively reflect on context at all times and to understand how context influences the implementation experience.

PRISM explicitly encourages strong representation of these groups throughout the research or practice process [38]. Formalized governance structures and accountability mechanisms such as memoranda of understanding and transparent budgeting can help address power differences among groups such as academic researchers and community partners. Last, a co-creation engagement can also be used to identify and measure (RE-AIM) outcomes in a way that matters to patients, families, and other partners. A co-creation engagement that includes the voices and priorities of patients and community members is not confined to a single implementation phase or area [38]. This participatory engagement should start early on and inform every aspect of the planning, design, implementation and evaluation of interventions (Fig. 3).

Fig. 3
figure 3

PRISM (and RE-AIM Outcomes) from a systems and co-creation perspectives

Context-intervention alignment using ongoing cycles: the RE-AIM Outcomes Cascade

The implementation of interventions in dynamic contexts requires an ongoing monitoring of the intervention-to-context alignment [7, 43]. This process is essential in promoting translational research because, when absent, an intervention can start with high potential for impact, but may gradually lose this potential at multiple key steps throughout the research process due to loss of clinical sites, study participations, implementation challenges or failure to sustain. We recommend managing this monitoring process through iterative implementation action cycles. To that end, we present the RE-AIM Outcomes Cascade in Fig. 4 to guide such cycles and with a focus on contributing to equitable and sustainable outcomes.

Fig. 4
figure 4

RE-AIM Outcomes Cascade starting with adoption

This figure illustrates the importance of considering sequential and multi-level impact at various stages of program planning and implementation. There are a number of ‘steps’ involved in a successful and equitable intervention. This begins with Adoption (the A in RE-AIM) in terms of which settings will elect to try an intervention. This is followed by Implementation planning and initiation of the delivery process. The next ‘step’ that is involved is the extent to which implementation (specifically recruitment) activities result in equitable reach among different subgroups. We acknowledge the sequence-iterative nature of the cascade and that is not a strictly unidirectional process (e.g., arrow from the RE-AIM dimension in the figure back to first) but recognize that it is helpful to understand the “voltage drops” that may occur with response to equity in an implementation experience. That is, there is a general sequence of steps (e.g., if Reach is low or there is no adoption of an evidence-based intervention, it cannot be effective or sustained) while also stressing the need to foster learning cycles (e.g., what it is learned from going through each of the steps informs new cycles of learning how to best adopt a new intervention and so on).

Importantly, at each of these ‘steps’, there is a potential for drop off or loss of impact across settings and individuals if key equity issues are not addressed at each step. For example, during the COVID-19 pandemic, the implementation of telehealth increased dramatically as a way to overcome social distancing public health policies during the pandemic. Yet, a history of inequities on access and trust on technology among patients [63, 64], as well as implementation efforts not ‘meeting some patients where they are’ created inequities on the Reach of this intervention. Evidence showed that Latinx and Asian populations were less likely to use telemedicine compared to other racial and ethnic groups [65]. This unequitable Reach in turn impacts the number and type of individuals benefiting from Telehealth during the pandemic. Thus the ‘cascade’ effect. The good news is that at each step there are also actions that can be taken to prevent or minimize drop-off or inequities at each step as noted in Fig. 4.Altough each RE-AIM outcome is important, they need to be integrated to estimate cumulative health equity impact. We recommend periodic assessments of progress on prioritized RE-AIM outcomes using brief pragmatic items completed by key team members to inform necessary adaptations [42, 66].

As programs cycle through these steps (on an annual basis for ongoing/sustained programs, for example), the RE-AIM cascade may continually enhance or reduce their focus on equity in future iterations. This may be thought of as positively reinforcing equity (a virtuous cycle) or a negatively reinforcing cycle that limits equity. The cascade underscores the importance of ongoing contextual insight and the need (and opportunities) to plan for infrastructure improvement, resource distribution, and policy changes to address persistent or emerging gaps and societal inequities at the various ‘steps’.

Throughout these ongoing cycles, information is fed back to all partners (e.g., committees, advisory boards, research or evaluation teams, patient and advocacy groups) so they can learn from the engagement process, capture contextual changes as they happen and adapt with the goal of informing future implementation efforts. These multiple learning cycles offer opportunities for a critical reflection process to gain perspective and understand experiences within the broader historical-social-political-cultural process/structures (or “the system”) [67].

Researchers and practitioners can assist change efforts by documenting context prior to, during, and post-implementation – in each cycle of the RE-AIM cascade [45]. Ideally, an equity lens should simultaneously consider: 1) the cycle of implementation and 2) the context, recognizing that efforts to promote equity on both will be mutually reinforcing. See Fig. 5. It is important to note that although the arrows in the RE-AIM outcomes cascade are unidirectional in this figure, but we conceptualize it as an ongoing cycle that does not end with maintenance but a process that inform and feed back into the next iteration – and into our broader learning that we bring to future implementation efforts.

Fig. 5
figure 5

Integrated PRISM (and RE-AIM Outcomes) from a systems and equity perspective

Application of concepts: illustration with a case example

We illustrate the various areas discussed in this paper through a case example as described in this section. See Table 2 for a summary of these applications.

Table 2 Intervention-to-context alignment processes using an example emphasizing key areas of illustration

Example: engaging patients and clinicians to co-create feasible and sustainable approaches to implement evidence-based cancer control

To guide cancer treatment decisions for older adults, geriatric and patient-centered risk assessments are recommended — including social determinants of health (SDoH) and behavioral risk factors that influence patient care. Such assessments can guide treatment discussions, inform the intensity of treatment, and identify supportive care needs; yet are not implemented routinely in oncologic clinics. The following pilot study example is guided by PRISM and uses co-creation engagementwith a multi-perspective steering committee, clinic-based workshops, and a diverse group of patients to inform and adapt a patient-centered web based multiple risk assessment and feedback system [68]. The goal is to use this diverse feedback during the planning and design of a screening tool to integrate screenings in areas relevant to older adult cancer patients in a way that is feasible, actionable, and sustainable. The resulting package is termed the “Integrated Aging Assessment for Action in Cancer Patients” tool or IA3-CP.

Use of PRISM contextual areas to inform the design of IA3-CP

The intervention’s design and implementation plan have been informed by PRISM contextual areas. For example, during the planning phase of the project (6 months), the organizational resources, capacity and perspectives from oncology clinics, through multiple partner roles such as providers, frontline support staff, and managers were included through 60-min co-creation workshops. During these sessions, we learned that the clinics preferred to implement the IA3-CP tool online of the tool online first to build a tailored workflow and capacity, and then add in-person implementation at the clinics. Partners actively co-created the IA3-CP intervention’s design and tailored clinic workflows to successfully embed the new intervention into the daily clinic routine [61].

Use of co-creation, informed by functions and forms concepts, to engage partners

The co-creation process began by convening diverse partners over several months during the pre-pilot funding phase. A steering committee included members of oncology clinics with representation from multiple roles (providers, managers, support personnel, and health system programmatic leadership). This group provided guidance to the research team on IA3-CP core functions (goals) and forms (actions) to inform the design and planning of the tool. The research team used that feedback to convene 60 to 90-min workshops with clinic personnel and patients. Sessions were held remotely using Zoom and facilitated by a clinician champion and by the first author. During the sessions, all partners co-created or refined IA3-CP core functions (goals) and forms (e.g., workflows with procedures to introduce the tool to clinics) with the goal of offering patients an equitable, coordinated, and patient-centered experience from screenings to referrals.

Focus on equity and use of the RE-AIM Cascade

The research team recruited a group of diverse patient partners (n= 7) based on ethnicity, language, race, cancer diagnosis, and place of residence. We included them early in the research process because patients, including those from minority backgrounds (i.e., race, ethnicity and older adults), have been historically excluded from research efforts, including clinical trials, and intervention planning and design efforts [69].

The patient partners for this study had no previous participation in clinical research or advisory boards. They were included in the crucial planning phase when key decisions were made, and to make sure multiple perspectives were represented. Partners participated in co-creation workshops lasting 45–90 min each in English and Spanish. Sessions were co-led by the first author and a clinician champion, as a way to actively inform how the intervention is presented to patients and to identify strategies to increase patient comfort and trust. Sessions focused on co-creating with patients the content included in the tool modules, language, and ways to make the tool user friendly. Examples of how partners co-created the IA3-CP tool include patients sharing with researchers that a cancer diagnosis can be traumatic for many patients and the recommendation for inclusion of a mental health section in the tool. Researchers fully adopted this recommendation and worked with the tool designer to add this information in a new module of the IA3-CP online tool intervention to acknowledge the distress and potential trauma that a new cancer diagnosis may have on a patient. In addition, based on patient feedback, we designed the system to be more flexible so patients could save their responses and complete the tool at their own pace. Summaries of each session were created by the project manager, based on detailed notes from each meeting with patients, and then shared with researchers for discussion and action. This action in turn was shared back with patients at the next co-creation session and using one or two iterative cycles.

Discussion

We propose an integration of PRISM, systems thinking perspective, and a co-creation engagement approach to guide practitioners and researchers on the alignment of complex interventions to local contexts that is centered on inclusion and equity. It is critical that researchers and practitioners complement integration efforts with pragmatic assessments that allow partners to evaluate the extent to which engagement has been equitable and co-creation has occurred [70]. Researchers and community partners can often have very different perceptions about how much this has happened.

This work contributes to the field by offering conceptual guidance on the application of the PRISM model to align intervention to context and with an equity focus through the use of complex systems concepts and a co-creation engagement with partners. PRISM is a suitable model to address equity because it is context-based and offers a practical and straightforward way for researchers and practitioners to address four contextual domains that have been shown to impact equity (e.g., structural domain with a history of lack of access to quality education, healthcare and economic opportunities for women, and among racial and ethnic minority groups in the United States) [71, 72]. This first step of elucidating conceptual linkages and practical application of the PRISM model can guide and inform future empirical efforts to test them. Although we have focused on the integration of co-creation with the PRISM framework, similar integration could likely be achieved with other implementation science frameworks.

This paper offers novel recommendations to this alignment process. First, a co-creation research engagement that supports the alignment of contextual needs, values, and resources to an intervention’s core functions and forms can better inform participatory research including which dimensions of equity will be prioritized (e.g., representativeness of participants reached by the intervention; or incorporation of equity-focused measures into the tracking/evaluation system) [73]. Second, we emphasize representativeness and reporting across all five RE-AIM outcomes and not simply reporting the most often used outcome (e.g., Reach (in its most basic form—the number of participants) [74]. Third, the concept of the RE-AIM ‘Cascade’ and examples of actions that can be taken to prevent or mitigate inequities that can emerge at any step in this sequential implementation cascade is novel. Finally, the emphasis on iterative applications of PRISM as operationalized most recently in the iterative PRISM (iPRISM) webtool [73] noted above is essential for long term success and sustainment of equitable outcomes [75].

Strengths and limitations

Strengths of this paper are based on the integration and expansion of previous work in IS and systems science. Specifically, it illustrates application of PRISM, function-form, and co-creation models and approaches to address health equity. As illustrated in the figures, related functions and forms publications and iterative RE-AIM resources are relatively accessible, concrete and understandable to community representatives. The concepts, approaches, and recommendations we summarize have not been compared to alternative approaches. Further work is needed to address issues such as 1) a need to further test the proposed relationships to enhance equity, including engagement (equitable partnership) and considering equity in all phases of the implementation process; 2) the optimal composition of multi-level community partner groups for different projects 3) the costs of implementing these methods; and 4) the types of settings, problems, and partners with which these approaches work best. Finally, the RE-AIM Cascade concept has conceptual appeal, it has not been tested and the optimal number of cycles that are most cost-effective are not known.

Recommendations for research and practice

We recommend additional research on several key areas discussed. First, research on key PRISM domains and how they relate to equity is needed such as the study of whether some domains are more strongly related to certain aspects of health equity (e.g., the domain of ‘Patient Perspectives’ may be more strongly related to equitable reach than other PRISM domains such as the Implementation and Sustainability Infrastructure). There is a need for more specific guidance for practitioners on the amount of time, facilitation, and guidance needed. More research is needed on implementation costs to apply PRISM co-creation engagement methods. Last, we ponder whether pragmatic measures of co-creation can be developed and validated, and whether greater intensities (dose) of recommended co-creation engagement are associated with more equitable intervention implementation and outcomes.

Conclusions

IS emphasizes a need to understand local contexts through ongoing participatory engagement to improve service delivery and address disparities. PRISM is a pragmatic accessible IS framework that can guide research efforts seeking to embed local contexts’ characteristics, including multi-level drivers of equity, into the design and evaluation of interventions. This ‘context to intervention alignment’ can help complex health interventions to achieve their goals [34]. PRISM and its iterative ‘RE-AIM Cascade’ component can help programs achieve key implementation outcomes (e.g., reach, adoption, sustainability) with an explicit focus on equity. In summary, we address future directions for the application of the PRISM RE-AIM framework [76] by presenting a concrete way to align an intervention to local contexts using a complex systems perspective with the concepts of functions and forms. We propose the use of co-creation processes in health-related research because it is a type of engagement to inform this alignment process, and contribute to equity being addressed. Therefore, ‘there is no equity without engagement, and no engagement without equity’.

Availability of data and materials

No datasets were generated or analysed during the current study.

Abbreviations

IS:

Implementation Science

PRISM:

Practical Robust Implementation and Sustainability Model

RE-AIM:

Reach, Effectiveness, Adoption, Implementation, Maintenance

CBPR:

Community-Based Participatory Research

iPRISM:

Iterative Practical Robust Implementation and Sustainability Model

IA3-CP:

Integrated Aging Assessment for Action in Cancer Patients

References

  1. Brownson RC, Kumanyika SK, Kreuter MW, Haire-Joshu D. Implementation science should give higher priority to health equity. Implement Sci. 2021;16:1–16.

    Article  Google Scholar 

  2. Villalobos A, Blachman-Demner D, Percy-Laurry A, Belis D, Bhattacharya M. Community and partner engagement in dissemination and implementation research at the National Institutes of Health: an analysis of recently funded studies and opportunities to advance the field. Implement Sci Commun. 2023;4(1):77.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Cordero JP, Mochache V, Boydell V, et al. Research and implementation interactions in a social accountability study: utilizing guidance for conducting process evaluations of complex interventions. Int J Equity Health. 2022;21(1):153. https://doi.org/10.1186/s12939-022-01718-0.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Fort MP, Manson SM, Glasgow RE. Applying an equity lens to assess context and implementation in public health and health services research and practice using the PRISM framework. Front Health Serv. 2023;3:1139788.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Rabin BA, Viglione C, Brownson RC. Terminology for dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. 3rd ed. Oxford: Oxford University Press; 2023. p. 712:chap 2.

  6. NIH National Cancer Institute. NCI dictionary terms page. U.S. Department of Health and Human Services; 2023. https://www.cancer.gov/publications/dictionaries/cancer-terms/def/intervention.

  7. Pérez Jolles M, Lengnick-Hall R, Mittman BS. Core functions and forms of complex health interventions: a patient-centered medical home illustration. J Gen Intern Med. 2019;34(6):1032–8. https://doi.org/10.1007/s11606-018-4818-7.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Guise J-M, Chang C, Viswanathan M, et al. Systematic reviews of complex multicomponent health care interventions. 2014. https://www.ncbi.nlm.nih.gov/books/NBK194846/. Accessed 8 Aug 2023.

  10. Ranjan KR, Read S. Value co-creation: concept and measurement. J Acad Mark Sci. 2016;44(3):290–315.

    Article  Google Scholar 

  11. Sánchez V, Sanchez-Youngman S, Dickson E, et al. CBPR implementation framework for community-academic partnerships. Am J Community Psychol. 2021;67(3–4):284–96. https://doi.org/10.1002/ajcp.12506.

    Article  PubMed  Google Scholar 

  12. Eccles MP, Mittman BS. Welcome to Implementation Science. Implement Sci. 2006;1(1):1. https://doi.org/10.1186/1748-5908-1-1.

    Article  PubMed Central  Google Scholar 

  13. Bauer MS, Kirchner J. Implementation science: what is it and why should I care? Psychiatry Res. 2020;283:112376.

    Article  PubMed  Google Scholar 

  14. Silver M, Coldit GA, Emmons KM. The promise and challenges of dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. 3rd ed. Oxford: Oxford University Press; 2023. p. 712:chap 1.

  15. Tabak RG, Nilsen P, Woodward E, Chambers DA. The conceptual basis for dissemination and implementation research: lessons from existing theories, models, and frameworks. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. 3rd ed. Oxford: Oxford University Press; 2023. p. 712:chap 4.

  16. Nilsen P, Bernhardsson S. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. BMC Health Serv Res. 2019;19(1):1–21.

    Article  Google Scholar 

  17. Purnell TS, Calhoun EA, Golden SH, et al. Achieving health equity: closing the gaps in health care disparities, interventions, and research. Health Aff (Millwood). 2016;35(8):1410–5. https://doi.org/10.1377/hlthaff.2016.0158.

    Article  PubMed  Google Scholar 

  18. Schlechter CR, Del Fiol G, Lam CY, et al. Application of community - engaged dissemination and implementation science to improve health equity. Prev Med Rep. 2021;24:101620. https://doi.org/10.1016/j.pmedr.2021.101620.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Minkler M, Wallerstein N. Community-based participatory research for health: from process to outcomes. San Francisco: Wiley; 2011.

  20. Pérez Jolles M, Fernández ME, Jacobs G, De Leon J, Myrick L, Aarons GA. Using Implementation Mapping to develop protocols supporting the implementation of a state policy on screening children for adverse childhood experiences in a system of health centers in inland Southern California. Front Public Health. 2022;10:876769. https://doi.org/10.3389/fpubh.2022.876769.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Fort MP, Steiner JF, Santos C, et al. Opportunities, challenges, and strategies for engaging family in diabetes and hypertension management: a qualitative study. J Health Care Poor Underserved. 2020;31(2):827–44. https://doi.org/10.1353/hpu.2020.0063.

    Article  PubMed  Google Scholar 

  22. Wheeler SB, Leeman J, Hassmiller Lich K, Tangka FKL, Davis MM, Richardson LC. Data-powered participatory decision making: leveraging systems thinking and simulation to guide selection and implementation of evidence-based colorectal cancer screening interventions. Cancer J. 2018;24(3):136–43. https://doi.org/10.1097/ppo.0000000000000317.

    Article  PubMed  Google Scholar 

  23. Zimmerman L, Lounsbury DW, Rosen CS, Kimerling R, Trafton JA, Lindley SE. Participatory system dynamics modeling: increasing stakeholder engagement and precision to improve implementation planning in systems. Adm Policy Ment Health. 2016;43(6):834–49. https://doi.org/10.1007/s10488-016-0754-1.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Education Global Research. Journal Page: Sistematización de experiencias, investigación y evaluación: aproximaciones desde tres ángulos./Systematization of experiences, research and evaluation: three different approaches. Education Global Research. 2023. https://educacionglobalresearch.net/en/issue01jara/. Accessed 15 Sept 2023.

  25. Rabin BA, Cakici J, Golden CA, Estabrooks PA, Glasgow RE, Gaglio B. A citation analysis and scoping systematic review of the operationalization of the Practical, Robust Implementation and Sustainability Model (PRISM). Implement Sci. 2022;17(1):1–26.

    Article  Google Scholar 

  26. Cooper LA, Purnell TS, Engelgau M, Weeks K, Marsteller JA. Using implementation science to move from knowledge of disparities to achievement of equity. In: The science of health disparities research. 2021. p. 289–308.

    Chapter  Google Scholar 

  27. Klepac Pogrmilovic B, Linke S, Craike M. Blending an implementation science framework with principles of proportionate universalism to support physical activity promotion in primary healthcare while addressing health inequities. Health Res Policy Syst. 2021;1:6.

    Article  Google Scholar 

  28. Pérez Jolles M, Willging CE, Stadnick NA, et al. Understanding implementation research collaborations from a co-creation lens: recommendations for a path forward. Perspective. Front Health Serv. 2022;2. https://doi.org/10.3389/frhs.2022.942658.

  29. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43. https://doi.org/10.1016/s1553-7250(08)34030-6.

    Article  PubMed  Google Scholar 

  30. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53. https://doi.org/10.1186/s13012-015-0242-0.

    Article  PubMed  PubMed Central  Google Scholar 

  31. McCreight MS, Rabin BA, Glasgow RE, et al. Using the Practical, Robust Implementation and Sustainability Model (PRISM) to qualitatively assess multilevel contextual domains to help plan, implement, evaluate, and disseminate health services programs. Transl Behav Med. 2019;9(6):1002–11.

    Article  PubMed  Google Scholar 

  32. Holtrop JS, Estabrooks PA, Gaglio B, et al. Understanding and applying the RE-AIM framework: clarifications and resources. J Clin Transl Sci. 2021;5(1):e126. https://doi.org/10.1017/cts.2021.789.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Weiner BJ, Clary A, Klaman SL, Turner K, Alishahitabriz A. Organizational readiness for change: what we know, what we think we know, and what we need to know. 2020.

    Google Scholar 

  34. Kwan BM, Brownson RC, Glasgow RE, Morrato EH, Luke DA. Designing for dissemination and sustainability to promote equitable impacts on health. Annu Rev Public Health. 2022;43:331–53. https://doi.org/10.1146/annurev-publhealth-052220-112457.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Skivington K, Matthews L, Simpson SA, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061. https://doi.org/10.1136/bmj.n2061.

    Article  PubMed  PubMed Central  Google Scholar 

  36. RE-AIM.org. What is PRISM? RE-AIM.org; 2023. https://re-aim.org/learn/prism/.

  37. Kessler RS, Purcell EP, Glasgow RE, Klesges LM, Benkeser RM, Peek CJ. What does it mean to “employ” the RE-AIM model? Eval Health Prof. 2013;36(1):44–66. https://doi.org/10.1177/0163278712446066.

    Article  PubMed  Google Scholar 

  38. Fort MP, Manson SM, Glasgow RE. Applying an equity lens to assess context and implementation in public health and health services research and practice using the PRISM framework. perspective. Front Health Serv. 2023;3. https://doi.org/10.3389/frhs.2023.1139788.

  39. Glasgow R, Harden S. A chat about Re-AIM and PRISM misconceptions. 2024. https://re-aim.org/presentations/reaimprism-common-misconceptions/.

  40. Carey G, Crammond B, De Leeuw E. Towards health equity: a framework for the application of proportionate universalism. Int J Equity Health. 2015;14:81. https://doi.org/10.1186/s12939-015-0207-6.

    Article  PubMed  PubMed Central  Google Scholar 

  41. University of Colorado Denver. PRISM: about US Page. University of Colorado Denver; 2023. https://prismtool.org/about-us/.

  42. Glasgow RE, Battaglia C, McCreight M, et al. Use of the reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) framework to guide iterative adaptations: applications, lessons learned, and future directions. Original Research. Front Health Serv. 2022;2. https://doi.org/10.3389/frhs.2022.959565.

  43. Hawe P. Lessons from complex interventions to improve health. Annu Rev Public Health. 2015;36:307–23.

    Article  PubMed  Google Scholar 

  44. Iyamu I, Gómez-Ramírez O, Xu AX, et al. Challenges in the development of digital public health interventions and mapped solutions: Findings from a scoping review. Digit Health. 2022;8:20552076221102256. https://doi.org/10.1177/20552076221102255.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8:117. https://doi.org/10.1186/1748-5908-8-117.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Hawe P. Interventions tested in randomised controlled trials can and should adapt to context: here’s how. In: Global handbook of health promotion research, vol 3: doing health promotion research. New York: Springer; 2023. p. 141–149.

  47. Cénat JM, McIntee S-E, Mukunzi JN, Noorishad P-G. Overrepresentation of black children in the child welfare system: a systematic review to understand and better act. Child Youth Serv Rev. 2021;120:105714.

    Article  Google Scholar 

  48. Loureiro SMC, Romero J, Bilro RG. Stakeholder engagement in co-creation processes for innovation: a systematic literature review and case study. J Bus Res. 2020;119:388–409. https://doi.org/10.1016/j.jbusres.2019.09.038.

    Article  Google Scholar 

  49. Hardyman W, Daunt KL, Kitchener M. Value Co-creation through patient engagement in health care: a micro-level approach and research agenda. Public Manag Rev. 2015;17(1):90–107. https://doi.org/10.1080/14719037.2014.881539.

    Article  Google Scholar 

  50. Pérez Jolles M, Willging CE, Stadnick NA, et al. Understanding implementation research collaborations from a co-creation lens: recommendations for a path forward. Front Health Serv. 2022;2. https://doi.org/10.3389/frhs.2022.942658

  51. Halvorsrud K, Kucharska J, Adlington K, et al. Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. J Public Health. 2021;43(1):197–208. https://doi.org/10.1093/pubmed/fdz126.

    Article  Google Scholar 

  52. Heimburg DV, Cluley V. Advancing complexity-informed health promotion: a scoping review to link health promotion and co-creation. Health Promot Int. 2021;36(2):581–600. https://doi.org/10.1093/heapro/daaa063.

    Article  PubMed  Google Scholar 

  53. Leask CF, Sandlund M, Skelton DA, et al. Framework, principles and recommendations for utilising participatory methodologies in the co-creation and evaluation of public health interventions. Res Involv Engagem. 2019;5:2. https://doi.org/10.1186/s40900-018-0136-9.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Minkler M, Wakimoto P. Community organizing and community building for health and social equity. 4th ed. New Brunswick: Rutgers University Press; 2021. p. 558.

  55. Haapanen KA, Christens BD. Community-engaged research approaches: multiple pathways to health equity. Am J Community Psychol. 2021;67(3–4):331–7. https://doi.org/10.1002/ajcp.12529.

    Article  PubMed  Google Scholar 

  56. Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving research impact through co-creation in community-based health services: literature review and case study. Milbank Q. 2016;94(2):392–429.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Tuhiwai Smith L. Decolonizing methodologies: research and indigenous peoples. 3 rd ed. New York: Bloomsbury Press; 2021. p. 240.

  58. Freire P. Pedagogy of the oppressed: 50 th anniversary edition. 4th ed. Bloomsbury Academic; 2018:232.

  59. Israel BA, Schulz AJ, Parker EA, Becker AB. Critical issues in developing and following community-based participatory research principles. In: Community-based participatory research for health. Crystal City: Jossey-Bass; 2008. p. 47–62.

  60. Seifer SD. Community-based participatory research for health: advancing social and health equity. In: Wallerstein N, Duran B, Oetzel JG, Minkler M, editors. Progress in Community Health Partnerships (3rd ed., pp. 219-221). Johns Hopkins University Press; 2019.

  61. Pérez Jolles M, Kessler E, Huebschmann A, Ford B, Glasgow R. Engaging patients and clinicians to co-create feasible and sustainable approaches to implement evidence-based cancer control. 2023.

    Google Scholar 

  62. Pérez Jolles M, Kessler A, Glasgow R, Huebschmann A. Engaging patients and clinicians to co-create feasible and sustainable approaches to implement evidence-based cancer control. Academy of Health; 2023.

  63. Rovner BW, Casten RJ, Chang AM, Hollander JE, Rising K. Mistrust, neighborhood deprivation, and telehealth use in African Americans with diabetes. Popul Health Manag. 2021;24(6):699–700. https://doi.org/10.1089/pop.2021.0094.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Clare CA. Telehealth and the digital divide as a social determinant of health during the COVID-19 pandemic. Netw Model Anal Health Inform Bioinform. 2021;10(1):26. https://doi.org/10.1007/s13721-021-00300-y.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Luo J, Tong L, Crotty BH, et al. Telemedicine adoption during the COVID-19 pandemic: gaps and inequalities. Appl Clin Inform. 2021;12(4):836–44. https://doi.org/10.1055/s-0041-1733848.

    Article  PubMed  PubMed Central  Google Scholar 

  66. Glasgow RE, Battaglia C, McCreight M, Ayele RA, Rabin BA. Making implementation science more rapid: use of the RE-AIM framework for mid-course adaptations across five health services research projects in the Veterans Health Administration. Front Public Health. 2020;8:194. https://doi.org/10.3389/fpubh.2020.00194.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Quiñones-Preciado JA, Peña-García ÁA, Vallecilla-Zambrano DG, Yama-Oviedo JA, Hernández-Gutiérrez NL, Ordoñez-Hernández CA. Strategies and educational needs of parents of premature infants in a third level hosptial in Cali, Colombia. Interface (Botucatu). 2023;27:17.

    Article  Google Scholar 

  68. Krist AH, Glenn BA, Glasgow RE, et al. Designing a valid randomized pragmatic primary care implementation trial: the my own health report (MOHR) project. Implement Sci. 2013;8:1–13.

    Article  Google Scholar 

  69. Julian McFarlane S, Occa A, Peng W, Awonuga O, Morgan SE. Community-Based Participatory Research (CBPR) to enhance participation of racial/ethnic minorities in clinical trials: a 10-year systematic review. Health Commun. 2022;37(9):1075–92. https://doi.org/10.1080/10410236.2021.1943978.

    Article  PubMed  Google Scholar 

  70. Goodman MS, Ackermann N, Pierce KA, Bowen DJ, Thompson VS. Development and validation of a brief version of the research engagement survey tool. Int J Environ Res Public Health. 2021;18(19). https://doi.org/10.3390/ijerph181910020.

  71. Crear-Perry J, Correa-de-Araujo R, Lewis Johnson T, McLemore MR, Neilson E, Wallace M. Social and structural determinants of health inequities in maternal health. J Womens Health. 2020;30(2):230–5. https://doi.org/10.1089/jwh.2020.8882.

    Article  Google Scholar 

  72. Homan P, Brown TH, King B. Structural intersectionality as a new direction for health disparities research. J Health Soc Behav. 2021;62(3):350–70. https://doi.org/10.1177/00221465211032947.

    Article  PubMed  PubMed Central  Google Scholar 

  73. University of Colorado Denver. PRISM: iPRISM Webtool Page. University of Colorado Denver; 2023. https://prismtool.org/getting-started/.

  74. Gaglio B, Shoup JA, Glasgow RE. The RE-AIM framework: a systematic review of use over time. Review. Am J Public Health. 2013;103(6):e38–46. https://doi.org/10.2105/AJPH.2013.301299.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Trinkley KE, Glasgow RE, D’Mello S, Fort MP, Ford B, Rabin BA. The iPRISM webtool: an interactive tool to pragmatically guide the iterative use of the practical, robust implementation and sustainability model in public health and clinical settings. Implement Sci Commun. 2023;4(1):1–15.

    Article  Google Scholar 

  76. Whelan J, Fraser P, Bolton KA, et al. Combining systems thinking approaches and implementation science constructs within community-based prevention: a systematic review. Health Res Policy Syst. 2023;21(1):85. https://doi.org/10.1186/s12961-023-01023-4.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Bryan Ford and Rosa Prieto: Adult and Child Center for Health Outcomes Research and Delivery Science (ACCORDS), University of Colorado School of Medicine, Anschutz Medical Campus, Aurora, CO, USA.

Elizabeth Kessler, MD: Associated Professor, Medicine-Medical Oncology. University of Colorado School of Medicine, Anschutz Medical Campus, Aurora, CO, USA.

Funding

This work is funded in part by the Colorado Implementation Science Center in Cancer Control (COISC3) support NCI 5P50CA244688.

Author information

Authors and Affiliations

Authors

Contributions

MPJ: Lead and had the main idea for this paper, wrote the first full draft of this manuscript and was responsible for all revisions and team discussions. Prepared all figures and tables. MF: Contributed to the scope of this paper, and was involved in all revisions. Reviewed and contributed to all figures and tables. REG: Contributed to the scope of this paper, and was involved in all revisions. Reviewed and contributed to all figures and tables. All authors have read, edited, and approved the final manuscript. Reviewed all figures and tables.

Corresponding author

Correspondence to Monica Pérez Jolles.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jolles, M.P., Fort, M.P. & Glasgow, R.E. Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework. Int J Equity Health 23, 41 (2024). https://doi.org/10.1186/s12939-024-02130-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12939-024-02130-6

Keywords