Skip to main content
Download PDF
Download ePub

A rapid realist review of patient engagement in patient-oriented research and health care system impacts: part one

Research Involvement and Engagement volume 7, Article number: 72 (2021) Cite this article

Abstract

Background

Patient-oriented research affords individuals with opportunities to genuinely contribute to health care research as members of research teams. While checklists and frameworks can support academic researchers’ awareness of patient engagement methods, less guidance appears available to support their understanding of how to develop and maintain collaborative relationships with their patient partners. This knowledge is essential as patient partners report that the social atmospheres of research teams significantly impacts the quality of their experiences. This study sought to develop theory regarding how academic researchers support and sustain patient engagement in patient-oriented research.

Methods

A six-step, rapid realist review was conducted: (1) research question development, (2) preliminary theory development, (3) search strategy development; (4) study selection and appraisal, (4) data extraction, analysis and synthesis (5) identification of relevant formal theories, and (6) theory refinement with stakeholders. Findings were additionally distilled by collective competence theory.

Results

A program theory was developed from 62 international studies which illuminated mechanisms supporting academic researchers to engage patient partners, contexts supporting these mechanisms, and resources that enabled mechanism activation. Interaction between seven contexts (patient-oriented research belief, prior interaction with a healthcare system, prior interaction with a particular academic researcher, educational background of patient partner, prior experience with patient-oriented research, study type, and time lived in a rural-urban setting) and seven mechanisms (deciding to become involved in patient-oriented research, recognizing valuable experiential knowledge, cultural competence, reducing power differentials, respectful team environment, supporting patient partners to feel valued, and readiness to research) resulted in an intermediate outcome (sense of trust). Trust then acted as an eighth mechanism which triggered the final-level outcome (empowered patient-centred lens).

Conclusions

Our theory posits that if patient partners trust they are a member of a supportive team working alongside academic researchers who authentically want to incorporate their input, then they are empowered to draw upon their experiential knowledge of health care systems and contribute as researchers in patient-oriented research. Our theory extends conceptual thinking regarding the importance of trust on patient-oriented research teams, how patient partners’ trust is shaped by team interactions, and the role that academic researchers have within those interactions.

Plain English Summary

Patient-oriented research gives patients, families, and caregivers opportunities to become members of health care research teams. Although academic researchers may be aware of what patient engagement is, they may not understand how to develop effective relationships with their patient partners. Academic researchers need this guidance because earlier research has shown that patient partners want to be supported to feel like they are important members of research teams. This support empowers them to feel confident to share their lived experiences and make suggestions and decisions about a research study. If patient partners believe their experiences and knowledge were not used or valued by academic researchers, then they may feel that their involvement was tokenistic. Tokenistic experiences discourage patient partners from participating in another research study.

We conducted a rapid realist review of 62 international studies to explore what works (and does not work) in patient-oriented research. This methodology supported us to examine existing research and better understand what contexts, how and why patient-oriented research led to outcomes on a health care system. The goal of this type of research study is to develop and refine a program theory that identifies how actions and activities lead to outcomes.

Our program theory emphasizes that patient partners need to trust the academic researchers they are working with. Several categories of actions (academic researcher’s behavior) helped researchers to gain the trust of their patient partners. Academic researchers were more (or less) likely to act in these ways depending on several contextual factors. Once patient partners trusted academic researchers on the team, they were empowered to draw upon their lived knowledge of health care systems and actively contribute as researchers. These findings are part of our complete theory about patient-oriented research impacts. They highlight why it is important to gain patient partners’ trust and how a complex set of actions are required by academic researchers to gain that trust.

Peer Review reports

Background

Patient-oriented research represents a paradigm shift in health care research [1,2,3,4,5]. Patient-oriented research aligns with moral, ethical and democratic principles advocating that the public has a fundamental right to be involved in research processes given that they are the ultimate end-user of healthcare research [6,7,8,9]. Rather than solely being sources of data for research studies, patient-oriented research provides patients, families, caregivers and other lay individuals with opportunities to join and genuinely contribute to health research teams (the public is collectively referred to as patient partners [2,3,4]).

In Canada and the United States, the central tenet of patient-oriented research is patient engagement [1, 4, 10]. While multiple interpretations of engagement exist [3, 4, 11], patient engagement in patient-oriented research intends to be a close equivalent of the United Kingdom’s concept of patient and public involvement [4]. These international definitions embrace patients as legitimate collaborators who take on active, meaningful roles alongside academic researchers, health care providers, and policy-makers in health research (professionals are collectively referred to as academic researchers [2, 10, 12]).

By bringing together individuals from diverse backgrounds who possess varying experiential and professional expertise, patient engagement adds a unique element to interdisciplinary teams engaged with health research practice. While checklists, frameworks and other tools are available to support academic researchers’ awareness of methods of engagement [13], less guidance is available to support them to understand how to develop and maintain effective collaborative relationships with lay researchers [14, 15]. Academic researchers need to develop new, and perhaps, unique skills to harness the benefit of involving patient partners on the research team because patient partners report that research teams’ social atmospheres significantly impact the quality of their experiences with patient-oriented research [16, 17]. Patient partners desire a team atmosphere to empower them to draw on and share their lived experiences with academic researchers [17]. Conversely, if patient partners perceive that their lived experiential knowledge is undervalued or under-utilized by academic researchers, they can believe their involvement in a study is tokenistic [18,19,20]. Tokenistic experiences discourage individuals from taking on future patient partner opportunities [16].

Limited efforts have been made to develop theory regarding the social processes that foster effective collaboration within patient-oriented research teams. Existing studies identified nurturing interpersonal relationships and feedback from researchers as mechanisms that supported teams to complete their work [21, 22]. Academic researchers developed relationships over time with their patient partners with effective communication and information sharing, utilizing both formal and informal group processes, being respectful and establishing trust [21, 22]. Feedback from academic researchers regarding their insight supported patient partners to feel they were valuable team members. These feelings were strengthened when patient partners saw how their contributions were incorporated into their team’s study [22].

While existing research has begun to illuminate the importance of social interaction within patient-oriented research teams, the lack of explicit theory regarding how patient engagement works, why, to what extent, and in what contexts continues to limit our ongoing capacity to implement successful patient-oriented research initiatives. The present study is part of a larger realist review which explored how, why, to what extent, and in what contexts does patient-oriented research produce impacts on individual collaborators, research processes, communities, and health care systems [23]. As our team worked on the data extraction, synthesis and analysis phases of our larger review, we recognized that our emerging program theory involved hypotheses regarding both the social processes that optimize collaboration on patient-oriented teams plus the impacts of patient partners’ involvement in patient-oriented research studies. In order to illuminate, and understand our full program theory, we felt it was best to present it within complementary articles. The present study aims to develop a program theory regarding how academic researchers support and sustain patient engagement in patient-oriented research. The guiding research questions were: 1) What mechanisms support academic researchers to engage patient partners on patient-oriented research teams; 2) What contexts support, or potentially hinder, these mechanisms; and 3) What resources support academic researchers involved in patient-oriented research to enable these mechanisms?

Review

Methodology

Study design – realist review methodology

Originally developed by Pawson and Tilley, a realist review is a type of narrative review that is grounded in the philosophical tradition of realism [24,25,26,27,28,29]. Realist reviews focus on interpretation, critique, and deepening of understanding of complex systems that occur across varied contexts and may be associated with varied, and potentially inconsistent, outcomes [29,30,31,32]. Realist reviews are not intended to provide generalized, prescriptive advice, but rather, seek to develop transferable program theory regarding when an intervention or program is more or less likely to be successful [26, 33].

A program theory is comprised of statements that link context, mechanism and outcome (commonly referred to as CMO [24, 28, 34]). Context refers to physical and social conditions that an intervention or program has been undertaken. Mechanisms are manifested as a shift in reasoning and/or response to the resources embedded in an intervention or program [24, 26, 27, 35,36,37] Outcomes are triggered by mechanisms. and an outcome can be explicit or hidden. Outcomes can involve intended or unintended consequences, and can be proximal, intermediate, or distal [35, 36]. Mechanisms can be explicit or hidden.

Realist reviews can follow a traditional or rapid approach. While both types involve the same research activities, a rapid realist review is intended to be responsive to limited time and resources for knowledge development around nascent issues [33]. Rapid realist reviews typically involve local stakeholders, including members of the lay public, during the review process. These stakeholders contribute local knowledge which, in turn, can potentially increase the transferability of the review’s findings [21, 33]. We selected the rapid review approach due to its emphasis on developing theory that can be valuable to policy-makers regarding an emerging issue, its recognition that members of the public should be considered as legitimate stakeholders, and that our study relied on a funding timeline of one year. Our review process was informed by the RAMESES guidelines and publication standards for a realist synthesis [38].

Stages of a realist review

Stakeholder team and research question development

In January 2019, a 12-member stakeholder team met to discuss, and prioritize, potential patient-oriented research topics to explore with a realist review [23]. Team members brought expertise in health services research, lived illness experience, patient care, patient-oriented research, policy-making, qualitative inquiry, and realist research. Written field notes captured group dialogue during the meeting. After an additional consultation with an academic realist research group, the guiding research question for the review was refined, and approved, by the stakeholder team.

Preliminary program theory development and search strategy

A preliminary program theory was mapped into themes based on stakeholders’ dialogue from the January 2019 team meeting [Additional file 1: Appendix A]. Eight hypotheses were brought forth from themes related to patient engagement in patient-oriented research:

  1. 1.

    Moral and ethical ideals ground patient-oriented research [H1].

  2. 2.

    Patient-oriented research can reduce differences in power that exist between the public and their health care system [H2].

  3. 3.

    Members of the public are empowered to participate in patient-oriented research in response to a negative experience(s) with their health care system [H3].

  4. 4.

    Researchers are responsible for authentically engaging patient partners on a patient-oriented research team [H4].

  5. 5.

    Researchers and patient partners shape the social environment of a patient-oriented team [H5].

  6. 6.

    Differences in power can exist between patient-oriented team members [H6].

  7. 7.

    Patient partners can sense when a judgment is made by a researcher(s) regarding whether they are perceived as an authentic member of the research team. [H7].

  8. 8.

    Patient partners will draw on their lived experiences if their empowerment is sustained during a research study [H8].

In May 2019, stakeholder team members were asked to recommend information sources, both published and from the grey literature, to support an initial search of patient-oriented literature in CINAHL, Ovid MEDLINE, and Scopus. The preliminary theory plus full-text and references of recommended articles were used to identify a set of words, concepts, phrases, and author-derived keywords. Stakeholders were provided with iterations of search terms plus several abstracts from articles identified by a given pilot search. Search terms were combined using Boolean and proximity operators, and database subject headings, such as MeSH, were utilized [Additional file 1: Appendix B]. The public websites of international patient-oriented research initiatives were also reviewed. Covidence software© was used to de-duplicate, collate, and screen bibliographic records.

Study selection and appraisal

An iterative process was used to screen and appraise information sources, and to extract and synthesize data. Abstracts were screened by their title and abstract by two raters. Full-text versions of those sources were sought if both raters perceived the source met inclusion criteria [23]. The full-text of eligible sources were then appraised with Pawson’s criteria of rigour and relevance under a ‘fitness to purpose lens’ [25,26,27,28]. Rigour relates to the perceived methodological quality of a study, while relevance refers to the extent that a research study can potentially contribute information towards the development of theory for the realist review [25,26,27,28]. A source was appraised to be a good fit to the review if it appeared to be credible, trustworthy, and contained descriptive information that could potentially support the development of theory.

Data extraction, analysis, and synthesis

Each source was read line-by-line and information regarding the study’s design, how the patient-oriented research team unfolded their study, and main study outcome(s) were recorded in an Excel© spreadsheet. Descriptions of activities undertaken by individual team members and interactions that occurred between patient partners and academic researchers were also extracted.

Explanatory accounts were then developed from extracted data. These are causal statements that identify an enabling or a constraining factor(s) that were present in a study, the impact of those factors on one or more mechanisms, and the outcome(s) that were produced ([28, 35, 43, 44], Additional file 1: Appendix C).

The set of explanatory accounts were then iteratively analyzed in order to look for demi-regularities [35, 36, 44, 45]. Emerging findings were discussed by team members. Demi-regularities were then synthesized into thematic groups, and a context-mechanism-outcome configuration (CMO) was developed for each thematic group [35, 36]. The CMO configurations were then used to develop, and refine, an initial program theory.

The middle-range theory of collective competence was selected as an additional, substantive lens to distill the review’s findings. This theory posits that teamwork or ‘collective’ competence is distinct from individual competence [39,40,41,42]. Collective competence is context-dependent, and members of a given team learn to work together in an evolving, interdependent manner [41]. Developing collective competence requires social interaction, cooperation, shared experiences, and communication [39].

Theory refinement

The final stage of our rapid realist review involved the presentation and testing of the initial program theory with stakeholder team [25,26,27,28]. Three stakeholder meetings were held during the months of April and May 2020. During these meetings, stakeholders were asked to review and provide feedback on the initial program theory. The first meeting was prioritized for the voices of patient partners (session involved one stakeholder who facilitated dialogue with the three patient partners while another stakeholder recorded field notes; next two meetings were open to the entire team). Stakeholder feedback from each meeting was used to iteratively refine the initial theory. After the third stakeholder meeting, stakeholders concluded that additional re-examination of data was unlikely to result in any other major modifications to the CMO or refined program theory. At this point, the stakeholder team sensed theoretical saturation [25, 26].

Results

Document characteristics

After screening and quality appraisal of 2633 information sources, a final sample of 72 articles describing 62 studies informed the review [several studies had multiple articles [2, 46,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,104,105,106,107,108,109,110,111,112,113,114,115, 119]; Additional file 1: Appendices D, E]. Twenty-two studies were from the United States (35.5%), 20 were from the United Kingdom (32.3%), 14 from Canada (22.6%), three from Australia (4.8%), and three involved international collaborations (4.8%). The studies were a mix of descriptive (52 studies, 83.9%) and interventional (10 studies, 16.1%) with diverse outcomes [Additional file 1: Appendices D, E].

Analysis and synthesis

A grand total of 287 explanatory accounts were developed from the 62 studies. From these, 26 context-mechanism-outcome (CMO) configurations were identified and synthesized into an initial program theory. After review, feedback, and refinement by stakeholders, the revised program theory consisted of seven contexts and eight mechanisms [Additional file 1: Appendices F, G]. Five mechanisms supported the hypotheses put forth by the preliminary program theory.

Mechanisms were predominantly associated with sets of contexts. Interactions between contexts and the mechanisms “deciding to become involved in patient-oriented research [M1],” “recognizing valuable experiential knowledge [M2],” “cultural competence [M3],” “reducing power differentials [M4],” “respectful team environment [M5],” “supporting patient partners to feel valued [M6],” and “readiness to research [M7]” resulted in the intermediate outcome of a “sense of trust [iO].” Trust then acted as a mechanism [M8] which triggered the final outcome, “empowered patient-centred lens [FO]”. The following sections describe the set of eight mechanisms and their respective triggering contexts. Embedded resources that enabled each mechanism were identified. The relationships between mechanisms and the outcomes are presented below. Individual hypotheses that were supported from the preliminary program theory are identified.

Deciding to become involved in patient-oriented research [M1]

Twenty-five articles revealed individuals are motivated to make a decision to become members of patient-oriented teams for various reasons [2, 46,47,48, 59, 65, 67, 68, 73, 74, 79, 81,82,83, 92, 93, 95, 97, 100, 107,108,109,110,111, 119]. Individually-centred motivations (potentially self-benefitting), and consistent with the first hypothesis [H1] of the preliminary program theory, altruistically-centred (potentially benefitting others) were identified for both patient partners and academic researchers. There was partial support of the third hypothesis [H3] in the preliminary program theory as both positive and negatively perceived health care experiences could motivate an individual to become a patient partner.

For patient partners, individually-centred motivations were the desire to learn new skills [68, 73, 110, 111] and to support the individual to reframe their self-identity away from being a sick person [73, 110, 111]. While honoraria did not appear to motivate individuals to participate in patient-oriented research, patient partner stakeholders of the review team further clarified that an unintended consequence of offering honoraria is that academic researchers may mistakenly perceive members of the public are predominantly drawn to patient-oriented research solely because of these funds.

Altruistically-centred motivations for patient partners included the desire to show gratitude and to ‘pay back’ their health care system for the good care they had received [107, 110, 111], desire to improve the living conditions of one’s community [74, 81, 92, 100, 107], and to improve the care of future patients [2, 47, 48, 59, 65, 73, 79, 82, 83, 93, 95, 97, 107, 110, 111]. Moreover, individuals can decide to become a patient partner after being a participant in a research study [46,47,48, 59, 108, 109, 119].

For academic researchers, individually-centred motivations were new opportunities for funding and for career advancement [73]. Altruistically-centred motivations included the potential for new knowledge creation, better understanding of patients’ perspectives, and improved patient care [73, 114].

Four articles identified disincentives for participating in patient-oriented research. Individuals who anticipated the work associated with being a patient partner or academic researcher would compete for time required in other aspects of their life, such as time required for family responsibilities, clinical duties, teaching, were less likely to participate in patient-oriented research [46, 67, 73, 107].

Recognizing valuable, experiential knowledge [M2]

Active, meaningful engagement of a patient partner(s) within a research study assumes that an academic researcher(s) has made two decisions: the patient partner(s) possesses experiential knowledge that is relevant to the study, and it is anticipated that this knowledge can be utilized by the team in a manner that will improve that research study.

Nineteen articles revealed contexts that appeared to trigger these decisions for academic researchers [46,47,48, 53, 55, 57, 59, 70, 81, 84, 92, 93, 96, 100, 102, 108, 109, 112, 113]. These contexts included that the patient partner was a highly-regarded member of a group or community [47, 48, 53, 81, 84, 93, 100, 102, 112], the patient partner had lived within a rural or urban community for many years [47, 48, 59, 84, 92, 96, 113], the patient partner was a member of a recognized patient group or healthcare-related charity with a history of conducting research [55, 57, 70], the patient partner was a former study participant of the academic researcher [46,47,48, 59, 108, 109, 119].

Developing cultural competency [M3]

Fourteen articles indicated the importance of cultural competency [46,47,48, 53, 66, 69, 73, 74, 79, 81, 87, 93, 95, 106]. Academic researchers who collaborate with vulnerable individuals and communities, but know little about the people, culture, and setting of their research, can face difficult interactions with groups and community members [53, 73, 74, 81, 87, 93]. For example, individuals who have endured discrimination and historical mistreatment can experience fear, anger, and/or be suspicious of researchers’ intentions in reaction to their presence within their community [73, 74, 87, 93]. Resources that supported academic researchers’ development of cultural understanding included their completion of cultural competency training [74, 87, 106], and their participation in a guided tour of the community early on during a study’s planning. During the tour, academic researchers listened to first-hand accounts from residents and community leaders about how their history and environment had negatively affected them [87]. Resources that supported patient partners to feel more comfortable included having academic researchers’ formally acknowledge to community leaders at the onset of study planning that historical mistreatment underlies community’s mistrust of their presence [87], having balanced representation of patient partners and academic researchers on the research team [74, 79, 87], rotating team meetings between community-based and academic-based locations [69] and providing informal opportunities for patient partners and academic researchers to try to get to know each such as sharing a meal prior to the start of a team meeting or taking time after a meeting ends to socialize with one another [46,47,48, 66, 74, 87, 95].

Reducing power differentials [M4]

Twenty-three articles focussed on supporting groups and communities facing social inequities [46,47,48, 53, 65, 66, 68, 69, 72,73,74, 79, 81, 84, 87, 89, 93, 95, 97, 100, 102, 112, 114] Citizens of these groups and communities have endured historical discrimination and mistreatment, lived in impoverished communities and under-serviced areas, and/or are living with a stigmatized medical condition [47, 48, 53, 65, 68, 73, 81, 84, 87, 93, 97, 100, 102, 112, 114].

Consistent with the second and sixth hypothesis [H2, H6] of the preliminary program, a resource that afforded some power back to vulnerable groups and communities was the establishment of an advisory council which represented their collective interests during the study. Highly-regarded individuals within these groups and communities such as Indigenous tribal leaders, tribal elders, traditional healers, clergy, parents, and a rural mayor held membership on advisory councils [47, 48, 53, 81, 84, 93, 100, 102, 112]. Advisory committees made decisions throughout the course of a study granting of permission for outsiders to enter their community, providing insight to academic researchers regarding their community’s structure, and ensuring that activities introduced as part of the study were culturally-appropriate for their members. Several advisory councils also prepared a formal memorandum, or agreement, of understanding [47, 48, 72, 81, 100, 112]. This resource supported collective clarification of the roles, responsibilities, and deliverables that were required of the advisory council, patient partners, academic researchers and any other parties that were to be involved in the research study. A team may refer back to its memorandum of agreement if any questions or concerns arise [72].

Beyond the establishment of advisory councils, other resources were used to reduce perceived differentials in power between team members. These included having equal numbers of patient partners and academic researchers on the research team [74, 79, 87], rotating team meetings between community-based and academic-based locations [69] and requiring that academic researchers attend each team meeting [73]. Two sets of field notes, one recorded by patient partners and one recorded by academic researchers were included as official records of team meetings [89]. Informal activities such as sharing a meal before a team meeting afforded opportunities for team members to try to get to know each other [46,47,48, 66, 74, 87, 95].

Respectful team environment [M5]

Consistent with the fourth hypothesis [H4] of the preliminary theory, ten articles indicated academic researchers used resources to cultivate, and maintain, team environments that were perceived by patient partners as being respectful and safe to participate in [2, 46, 63, 70, 73, 80, 97, 108, 109, 111]. Examples included scheduling research team meetings at times that were convenient for patient partners to attend [46, 73, 80], formally delegating protected time during team meetings where a patient partner(s) could speak to whatever topic they saw fit [108, 109], and recognizing that a patient partner’s medical condition can require them, in the moment, to have additional time to express their thoughts [80, 97]. Academic researchers also made efforts to explain medical jargon and avoid using acronyms as much as possible when interacting with their patient partners [46, 70]. Feelings of vulnerability can occur for patient partners who have endured discrimination and historical mistreatment, are living with a stigmatized medical condition, and/or are experiencing deteriorated health [2, 63, 110, 111]. During these moments, it was important patient partners were provided with emotional support from team members.

Supporting patient partners to feel valued [M6]

Ten articles supported the hypothesis that patient partners are vigilant of cues from academic researchers that appeared to signal whether those academics valued them as authentic team members [66, 67, 74, 79, 80, 82,83,84, 108, 109]. Travelling to a patient partner’s home in order to meet [80], formally delegating protected time during research team meetings where a patient partner(s) was free to talk about topic(s) they perceived as being important [108, 109], and providing patient partners with individual honoraria and/or covering their travel and childcare costs [66, 67, 79, 84, 108, 109] were actions made by academic researchers that demonstrated to patient partners that their input was valued. A community-based organization could also be recognized with an honorarium [74].

The value of patient partners’ expertise was also memorialized on study-related brochures and other text-based information sources. These information sources identified patient partners as official members of a care team [82, 83], announced ongoing achievements made by members of a community during a study [81] and repeatedly emphasized that patient partner expertise enabled the study to thrive [97]. Patient partners were also formally identified as a co-investigator or co-author of the study [66, 108, 109].

Readiness to research [M7]

The preliminary program theory did not take into account patient partners’ preparedness for patient-oriented research. Four articles indicated that when moments of tension were reported between academic researchers and patient partners, these appeared to be triggered by academic researchers’ perceptions regarding patient partners’ lack of methodological knowledge and/or inexperience with processes required for the study ([73, 85, 87, 119]; Additional file 1: Appendix C).

Twenty articles revealed that educational background and previous experience with patient-oriented research were contexts that appeared to signal, to academic researchers, that an individual was either ‘research ready’ or would likely require only minimal training to become ready to research [53, 55, 57, 60, 62, 63, 68,69,70, 73, 76, 82,83,84,85, 87, 90, 96, 97, 106]. Educational backgrounds signaled a patient partner was research ready if the individual had previously completed training in a reputable, patient-oriented research program [76], the individual was a member of a recognized patient group or healthcare-related charity with a history of conducting research [55, 57, 70]. Individuals with a medical degree or medical background were also perceived as being research ready [97]. Academic researchers provided training during the course of the study in order to prepare patient partners without research backgrounds [53, 60, 62, 63, 68, 69, 73, 82,83,84, 87, 90, 96, 106]. The review team’s patient partner stakeholders further advocated the advancement of patient partner expertise requires that individuals have ongoing opportunities for collaboration with academic researchers in patient-oriented research.

Developing a sense of trust [iO1/M8] and empowering a patient-oriented lens [FO]

Fifteen studies revealed that the development of a sense of trust was important for maintaining cooperative relationships between patient partners and academic researchers [47, 48, 66, 67, 72, 74, 79, 84, 87, 95, 102, 106, 108, 109, 119]. Resources used by academic researchers to develop patients’ sense of trust included providing honoraria to patient partners [66, 67, 79, 84, 108, 109], seeking the consensus of all team members during decision-making [106], incorporating patient partner input into the study [108, 109], making visible efforts to try to get to know members of the community where a study was set [47, 48], and being willing to engage in open, frank discussion with community members about their intentions in the community [74].

While the preliminary program theory emphasized empowerment of patient partners [H3, H8], it did not overtly position a role for trust. The review team’s patient partner stakeholders recognized, and emphasized, this was an important omission because just as patients, families, and caregivers need to perceive a sense of trust during any interaction with their health care system, trust also lies at the centre of the patient partner-academic researcher relationship. These stakeholders cautioned that if patient partners do not develop a sense of trust with academic researchers, a patient-oriented research study will not achieve its full potential. This is because members of the public, including experienced patient partners, will not be empowered to feel confident to fully open up to researchers regarding their lived health journeys, how they perceive their personal health experiences can be of benefit to the research study, and make suggestions and decisions about a research study.

Discussion

This rapid realist review outlined mechanisms which enabled academic researchers to develop trusting relationships with patient partners; recognizing valuable experiential knowledge, cultural competence, reducing power differentials, respectful team environment, supporting patient partners to feel valued, and readiness to research. These mechanisms interacted with contexts, and resources used by academic researchers to enable activation of mechanisms were identified. Our program theory posits that if patient partners trust they are part of a supportive research team working alongside academic researchers who authentically want to incorporate their input, then they are empowered to draw upon their experiential knowledge of health care systems and contribute as researchers in patient-oriented research.

Consistent with other studies, our review found that patients, families, and caregivers are empowered to become involved in patient-oriented research in order to better themselves and for the greater good of others [116,117,118]. Once they have joined patient-oriented research teams, their empowerment can be supported and sustained by academic researchers’ behavior. While other studies have identified the importance of developing trust between team members [21, 22], our rapid realist review extends conceptual thinking regarding the facets of trust, how trust is shaped for patient partners by both formal and informal team interactions, and the role that academic researchers have within those interactions.

While an emerging area of patient-oriented research involves identifying competencies from the perspective of individual stakeholders [5], the formal theory of collective competence reminds us that most work involves complex sets of activities performed by individuals and groups [39,40,41]. For this reason, a solely individualistic stance regarding competence is inadequate, and this theory incorporates an additional team-based lens.

Collective competence is context-dependent, and members of a given team learn to work together [41]. To be “collectively competent” teams’ enact three processes dependent on communication; making collective sense of events, developing a collective knowledge base, and maintaining a sense of interdependency [41]. While these processes do not fully explain how patient partners are empowered, they do provide support towards six mechanisms within our program theory.

A team needs to develop a collective understanding of the goal(s) of their joint activity [41]. Team members co-construct their understanding of what they wish to achieve by engaging in task talk [41, 110]. Dialogue can also reduce team members’ feelings of uncertainty, doubt and fear. Collective understanding underpins the establishment of advisory councils seen in the mechanism “reducing power differentials.” Advisory councils were a resource that afforded vulnerable communities to negotiate a shared understanding of the roles, responsibilities and deliverables of a research study with academic researchers. Meeting minutes and formal memorandum or agreements of understanding served as artifacts of co-constructed understanding.

Teams also need to develop a collective knowledge base that their members can draw on throughout their work [41]. Collective knowledge requires team members’ share their individual expertise with each other. By doing so, the teams’ level of consolidated knowledge exceeds knowledge brought by its individual members. Expertise of individual team members may introduce multiple lay and professionalized languages to the team. In order to avoid misunderstandings, discussion of language differences between team members is important [41, 110]. The mechanisms “recognizing valuable experiential knowledge,” “developing cultural competence,” “respectful team environment,” and “readiness to research” are supported by development of collective knowledge. Academic researchers sought patient partners from varied contextual backgrounds because they anticipated these individuals would contribute valuable experiential knowledge to their research team. Academic researchers also attempted to better understand the people, culture, and setting of their research study by undergoing didactic cultural competency training and listening to first-hand accounts from members of a vulnerable community. Academic researchers reserved time for patient partners to speak freely during team meetings. They also explained medical jargon to lay users and avoided using acronyms.

Academic researchers’ explicit acknowledgment to community members that they understood the community had endured historical mistreatment and understanding why a patient partner’s medical condition can require them to need extra time to express their thoughts were artifacts of collective knowledge. While academic researchers provided training to patient partners who did not have research backgrounds, the moments of tension that arose in some teams due to patient partners’ apparent lack of methodological expertise signalled, conversely, the team may have under-developed shared understanding in this area.

Most teams organize their work with a division of labour. Team members need to cooperate and share a sense of interdependency [40, 41]. Interdependency becomes fragmented when team members act without considering each other’s needs or the team’s purpose [40]. Resources that triggered the mechanisms “reducing power differentials,” “supporting patient partners to feel valued,” and “readiness to research” were supported by a sense of interdependency. Advisory councils monitored the involvement of academic researchers with members of vulnerable communities. Academic researchers enabled patient partners’ participation with a visit to their home, scheduling meetings that took into account their availability, and provided an individual honorarium and/or reimbursement of travel and childcare costs. Academic researchers also provided training to patient partners without research backgrounds. Memoranda of agreement, announcements that emphasized the importance of patient partner expertise, and formally identifying a patient partner as a co-investigator or co-author were artifacts of the interdependency between academic researchers and patient partners.

Practical implications

The program theory advanced in this rapid realist review presents an opportunity for increasing understanding of the complexity involved in patient-oriented research. Our program theory emphasizes the importance of developing patient partners’ trust, how trust is shaped for patient partners as they collaborate with academic researchers, and its relationship to patient partners’ empowerment. If patient partners do not develop trust in the academic researcher members on the team, they will not feel confident to fully open up to academic researchers regarding their lived health journeys and how they perceive these experiences can be of benefit to the research study, and make suggestions toward and decisions about it.

We anticipate that our program theory will support researchers, clinicians, and policy-makers, including individuals working with national-level patient-oriented research initiatives, to reflect on their practices of engaging patient partners, and in combination with their own experiences and insight into their own contexts, to be able to refine their strategies for patient engagement. We also advocate that designers of training for patient-oriented research consider advancing their curriculum regarding the mechanisms that support academic researchers to optimize their collaborative relationships with lay researchers. This education may be especially important for researchers who have limited experience interacting with patients, families, and caregivers.

Future research

We have developed a novel program theory which reveals academic researchers undertake a complex set of actions and responsibilities as they attempt to support and sustain the engagement of patient partners in patient-oriented research. We acknowledge the dissemination of our program theory is a first step to the application of our findings by other researchers. We anticipate future research will test the transferability of our program theory. Future research should explore, and illuminate, the development of academic researchers’ trust of patient partners.

Strengths and limitations

Patient partners were full research partners and their engagement was informed by an engagement framework co-designed with patient partners by the provincial-level, patient-oriented research support centre [120].

Patient partners supported the development of our guiding research question, recommended literature to contribute to our review, and reviewed our set of search terms. During theory refinement, patient partners were asked to review, evaluate and reflect on our initial program theory in light of their personal, lived expertise. Stakeholder feedback, including feedback from patient partners, was used to iteratively refine the initial theory. Patient partners also contributed to the conceptualization and writing-review of the manuscript. Patient partners were offered honoraria, and their travel expenses were reimbursed. Honoraria and travel were funded consistent to provincial guidelines.

As with any other review article, our research cannot comprehensively consider the entire discourse for patient-oriented research. Our review was limited to English-disseminated information sources. Realist reviews are not intended to identify pathways to achieving all possible outcomes, nor can this methodology exhaustively explain all mechanisms that are capable of generating changes.

Conclusions

Using rapid realist review methodology, we have conducted a realist review of the social processes utilized by academic researchers to support and sustain engagement of patient partners in patient-oriented research. We have disseminated a program theory, which identified mechanisms that can support academic researchers to foster an optimal team environment when collaborating with members of the lay public. Our findings allow us to better understand how interactions with academic researchers affect the empowerment of patient partners within patient-oriented research.

Availability of data and materials

Data supporting the findings of this study are available from the lead author upon a reasonable request.

Abbreviations

CMO:

context-mechanism-outcome configuration

References

  1. Canadian Institutes of Health Research. Canada’s strategy for patient-oriented research: improving health outcomes through evidence-informed care. 2011. Available from: https://cihr-irsc.gc.ca/e/44000.html. Accessed 03 Feb 2020.

    Google Scholar 

  2. INVOLVE. Exploring the impact of public involvement on the quality of research: examples. Eastleigh: INVOLVE, National Institute of Health Research; 2013.

    Google Scholar 

  3. Mallidou AA, Frisch N, Doyle-Waters MM, MacLeod ML, Ward J, Atherton P. Patient-oriented research competencies in health (PORCH) for patients, healthcare providers, decision-makers and researchers: protocol of a scoping review. Syst Rev. 2018;7(1):101. https://doi.org/10.1186/s13643-018-0762-1.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Bell T, Vat LE, McGavin C, Keller M, Getchell L, Rychtera A, et al. Co-building a patient-oriented research curriculum in Canada. Res Involv Engagem. 2019;5(1):1–3.

    Article  Google Scholar 

  5. Frisch N, Atherton P, Doyle-Waters MM, MacLeod ML, Mallidou A, Sheane V, et al. Patient-oriented research competencies in health (PORCH) for researchers, patients, healthcare providers, and decision-makers: results of a scoping review. Res Involv Engagem. 2020;6(1):1–14.

    Article  Google Scholar 

  6. Aubin D, Hebert M, Eurich D. The importance of measuring the impact of patient-oriented research. CMAJ. 2019;191(31):E860–4. https://doi.org/10.1503/cmaj.190237.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Esmail L, Moore E, Rein A. Evaluating patient and stakeholder engagement in research: moving from theory to practice. J Comp Eff Res. 2015;4(2):133–45. https://doi.org/10.2217/cer.14.79.

    Article  PubMed  Google Scholar 

  8. Entwistle VA, Renfrew MJ, Yearley S, Forrester J, Lamont T. Lay perspectives: advantages for health research. BMJ. 1998;316(7129):463–6.

    Article  CAS  Google Scholar 

  9. Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14(1):1–9.

    Article  Google Scholar 

  10. Patient Centred Outcomes Research Institute. The value of engagement. 2018. Available from https://www.pcori.org/engagement/value-engagement. Accessed 01 Aug 2020.

    Google Scholar 

  11. Harrison JD, Auerbach AD, Anderson W, Fagan M, Carnie M, Hanson C, et al. Patient stakeholder engagement in research: a narrative review to describe foundational principles and best practice activities. Health Expect. 2019;22(3):307–16. https://doi.org/10.1111/hex.12873.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Canadian Institutes of Health Research. Strategy for patient-oriented research. 2019. Available from: www.cihr-irsc.gc.ca/e/41204.html. Accessed 30 Jun 2019.

    Google Scholar 

  13. Greenhalgh T, Hinton L, Finlay T, Macfarlane A, Fahy N, Clyde B, et al. Frameworks for supporting patient and public involvement in research: systematic review and co-design pilot. Health Expect. 2019;22(4):785–801. https://doi.org/10.1111/hex.12888.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Shen S, Doyle-Thomas KA, Beesley L, Karmali A, Williams L, Tanel N, et al. How and why should we engage parents as co-researchers in health research? A scoping review of current practices. Health Expect. 2017;20(4):543–54. https://doi.org/10.1111/hex.12490.

    Article  PubMed  Google Scholar 

  15. de Wit M, Beurskens A, Piškur B, Stoffers E, Moser A. Preparing researchers for patient and public involvement in scientific research: development of a hands-on learning approach through action research. Health Expect. 2018;21(4):752–63. https://doi.org/10.1111/hex.12671.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Black A, Strain K, Wallsworth C, Charlton SG, Chang W, McNamee K, et al. What constitutes meaningful engagement for patients and families as partners on research teams? J Health Serv Res Policy. 2018;23(3):158–67. https://doi.org/10.1177/1355819618762960.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Dudley L, Gamble C, Allam A, Bell P, Buck D, Goodare H, et al. A little more conversation please? Qualitative study of researchers’ and patients’ interview accounts of training for patient and public involvement in clinical trials. Trials. 2015;16(1):190. https://doi.org/10.1186/s13063-015-0667-4.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Jinks C, Carter P, Rhodes C, Taylor R, Beech R, Dziedzic K, et al. Patient and public involvement in primary care research-an example of ensuring its sustainability. Res Involv Engagem. 2016;2(1):1. https://doi.org/10.1186/s40900-016-0015-1.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Hahn DL, Hoffmann AE, Felzien M, LeMaster JW, Xu J, Fagnan LJ. Tokenism in patient engagement. Fam Pract. 2017;34(3):290–5. https://doi.org/10.1093/fampra/cmw097.

    Article  PubMed  Google Scholar 

  20. Bally JM, Mcharo SK. Research reflection. Research in pediatric oncology: engaging parents to strengthen research processes, outcomes and knowledge translation. Can Oncol Nurs J. 2020;30(3):220–2.

    PubMed  PubMed Central  Google Scholar 

  21. McNeil H, Elliott J, Huson K, Ashbourne J, Heckman G, Walker J, et al. Engaging older adults in healthcare research and planning: a realist synthesis. Res Involv Engagem. 2016;2(1):10. https://doi.org/10.1186/s40900-016-0022-2.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Evans D, Coad J, Cottrell K, Dalrymple J, Davies R, Donald C, et al. Public involvement in research: assessing impact through a realist evaluation. Southampton (UK): NIHR journals. Library. 2014;2(36).

  23. Zibrowski E, McDonald S, Thiessen H, VanDusen R, Boden C, Carr T, et al. Developing a program theory of patient engagement in patient-oriented research and the impacts on the health care system: protocol for a rapid realist review. CMAJ Open. 2020;3:E530–4.

    Article  Google Scholar 

  24. Pawson R, Tilley N. Realistic evaluation. Thousand Oaks (CA): Sage Publications Ltd.; 1997.

    Google Scholar 

  25. Pawson R. Assessing the quality of evidence in evidence-based policy: why, how and when? ESRC research methods Programme working paper no 1. Economic & Social Research Council: Swindon UK; 2003.

    Google Scholar 

  26. Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review — a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10(Suppl 1):21–34. https://doi.org/10.1258/1355819054308530.

    Article  PubMed  Google Scholar 

  27. Pawson R. Evidence-based policy: a realist perspective: Sage Publications Ltd; 2006. https://doi.org/10.4135/9781849209120.

  28. Rycroft-Malone J, McCormack B, Hutchinson AM, DeCorby K, Bucknall TK, Kent B, et al. Realist synthesis: illustrating the method for implementation research. Implement Sci. 2012;7(1):33. https://doi.org/10.1186/1748-5908-7-33.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Greenhalgh T, Thorne S, Malterud K. Time to challenge the spurious hierarchy of systematic over narrative reviews? Eur J Clin Investig. 2018;48(6):e12931. https://doi.org/10.1111/eci.12931.

    Article  Google Scholar 

  30. Duddy C, Wong G. Explaining variations in test ordering in primary care: protocol for a realist review. BMJ Open. 2018;8(9):e023117. https://doi.org/10.1136/bmjopen-2018-023117.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Reeves S. The importance of realist synthesis for the interprofessional field. J Interprof Care. 2015;29(1):1–2. https://doi.org/10.3109/13561820.2015.985883.

    Article  PubMed  Google Scholar 

  32. Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med. 2018;16(1):95. https://doi.org/10.1186/s12916-018-1089-4.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Saul JE, Willis CD, Bitz J, Best A. A time-responsive tool for informing policy making: rapid realist review. Implement Sci. 2013;8(1):103. https://doi.org/10.1186/1748-5908-8-103.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Goodridge D, Westhorp G, Rotter T, Dobson R, Bath B. Lean and leadership practices: development of an initial realist program theory. BMC Health Serv Res. 2015;15(1):362. https://doi.org/10.1186/s12913-015-1030-x.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Jagosh J, Macaulay AC, Pluye P, Salsberg JO, Bush PL, Henderson JI, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q. 2012;90(2):311–46. https://doi.org/10.1111/j.1468-0009.2012.00665.x.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Jagosh J, Pluye P, Wong G, Cargo M, Salsberg J, Bush PL, et al. Critical reflections on realist review: insights from customizing the methodology to the needs of participatory research assessment. Res Synth Methods. 2014;5(2):131–41. https://doi.org/10.1002/jrsm.1099.

    Article  PubMed  Google Scholar 

  37. Waldron T, Carr T, McMullen L, Westhorp G, Duncan V, Neufeld SM, et al. Development of a program theory for shared decision-making: a realist synthesis. BMC Health Serv Res. 2020;20(1):59. https://doi.org/10.1186/s12913-019-4649-1.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Wong G, Greenhalgh T, Westhorp G, Buckingham J, Pawson R. RAMESES publication standards: realist syntheses. BMC Med 2013;11(1):1–4.

  39. Boreham N. A theory of collective competence: challenging the neo-liberal individualisation of performance at work. Br J Educ Stud. 2004;52(1):5–17. https://doi.org/10.1111/j.1467-8527.2004.00251.x.

    Article  Google Scholar 

  40. Boreham N. Collective competence and work process knowledge. Crete: European Conference on Educational Research; 2004.

    Google Scholar 

  41. Boreham N. Competence as collective process. In: Catts R, Falk I, Wallace R, editors. Vocational learning. Springer: Dordrecht; 2011. p. 77–91. https://doi.org/10.1007/978-94-007-1539-4_5.

    Chapter  Google Scholar 

  42. Lingard L. Paradoxical truths and persistent myths: reframing the team competence conversation. J Contin Educ Health Prof. 2016;36(1):S19–21. https://doi.org/10.1097/CEH.0000000000000078.

    Article  PubMed  Google Scholar 

  43. Groot G, Waldron T, Carr T, McMullen L, Bandura LA, Neufeld SM, et al. Development of a program theory for shared decision-making: a realist review protocol. Syst Rev. 2017;6(1):114. https://doi.org/10.1186/s13643-017-0508-5.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Pearson M, Brand SL, Quinn C, Shaw J, Maguire M, Michie S, et al. Using realist review to inform intervention development: methodological illustration and conceptual platform for collaborative care in offender mental health. Implement Sci. 2015;10(1):134. https://doi.org/10.1186/s13012-015-0321-2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Carr T, Quinlan E, Robertson S, Gerrard A. Adapting realist synthesis methodology: the case of workplace harassment interventions. Res Synth Methods. 2017;8(4):496–505. https://doi.org/10.1002/jrsm.1261.

    Article  PubMed  Google Scholar 

  46. Absolom K, Holch P, Woroncow B, Wright EP, Velikov G. Beyond lip service and box ticking: how effective patient engagement is integral to the development and delivery of patient-reported outcomes. Qual Life Res. 2015;24(5):1077–85. https://doi.org/10.1007/s11136-014-0909-z.

    Article  CAS  PubMed  Google Scholar 

  47. Bacsu J, Abonyi S, Viger M, Morgan D, Johnson S, Jeffery B. Examining rural older adults' perceptions of cognitive health. Can J Aging. 2017;36(3):318–27. https://doi.org/10.1017/S0714980817000150.

    Article  PubMed  Google Scholar 

  48. Bacsu J, McIntosh T, Viger M, Johnson S, Jeffery B, Novik N. Supporting older adults' engagement in health-care programs and policies: findings from a rural cognitive health study. Home Health Care Serv Q. 2019;38(3):209–23. https://doi.org/10.1080/01621424.2019.1614505.

    Article  PubMed  Google Scholar 

  49. Boote J, Telford R, Cooper C. Consumer involvement in health research: a review and research agenda. Health Policy. 2002;61(2):213–36. https://doi.org/10.1016/S0168-8510(01)00214-7.

    Article  PubMed  Google Scholar 

  50. Boote J, Julious S, Horspool M, Elphick H, Smithson WH, Norman P. PPI in the PLEASANT trial: involving children with asthma and their parents in designing an intervention for a randomised controlled trial based within primary care. Prim Health Care Res Dev. 2016;17(6):536–48. https://doi.org/10.1017/S1463423616000025.

    Article  PubMed  Google Scholar 

  51. Breault LJ, Rittenbach K, Hartle K, Babins-Wagner R, de Beaudrap C, Jasaui Y, et al. The top research questions asked by people with lived depression experience in Alberta: a survey. CMAJ Open. 2018;6(3):E398–405. Published 2018 Sep 28. https://doi.org/10.9778/cmajo.20180034.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Caress AL, Duxbury P, Woodcock A, Luker KA, Ward D, Campbell M, et al. Exploring the needs, concerns and behaviours of people with existing respiratory conditions in relation to the H1N1 'swine influenza' pandemic: a multicentre survey and qualitative study. Health Technol Assess. 2010;14(34):1–108. https://doi.org/10.3310/hta14340-01.

    Article  PubMed  Google Scholar 

  53. Cashman SB, Adeky S, Allen AJ III, Corburn J, Israel BA, Montaño J, et al. Building public health infastructure and assessing capacity in a tribal community (case study). The power and the promise: working with communities to analyze data, interpret findings, and get to outcomes. Am J Public Health. 2008;98(8):1407–17. https://doi.org/10.2105/AJPH.2007.113571.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Chino M, Debruyn L. Building true capacity: indigenous models for indigenous communities. Am J Public Health. 2006;96(4):596–9. https://doi.org/10.2105/AJPH.2004.053801.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Cashman SB, Adeky S, Allen AJ III, Corburn J, Israel BA, Montaño J, et al. Developing the Easr Side Village worker partnership (case study). The power and the promise: working with communities to analyze data, interpret findings, and get to outcomes. Am J Public Health. 2008;98(8):1407–17. https://doi.org/10.2105/AJPH.2007.113571.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Parker EA, Schulz AJ, Israel BA, Hollis R. Detroit's east Side Village health worker partnership: community-based lay health advisor intervention in an urban area. Health Educ Behav. 1998;25(1):24–45. https://doi.org/10.1177/109019819802500104.

    Article  CAS  PubMed  Google Scholar 

  57. Cashman SB, Adeky S, Allen AJ III, Corburn J, Israel BA, Montaño J, et al. Improving Latino Men’s health (case study). The power and the promise: working with communities to analyze data, interpret findings, and get to outcomes. Am J Public Health. 2008;98(8):1407–17. https://doi.org/10.2105/AJPH.2007.113571.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Cashman SB, Adeky S, Allen AJ III, Corburn J, Israel BA, Montaño J, et al. Tackling environmental health issues in an Urban Community (case study). The power and the promise: working with communities to analyze data, interpret findings, and get to outcomes. Am J Public Health. 2008;98(8):1407–17. https://doi.org/10.2105/AJPH.2007.113571.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Cawston PG, Mercer SW, Barbour RS. Involving deprived communities in improving the quality of primary care services: does participatory action research work? BMC Health Serv Res. 2007;7(1):88. https://doi.org/10.1186/1472-6963-7-88.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Clemens KK, Getchell L, Robinson T, Ryan BL, O'Donnell J, Reichert SM. Clinical care gaps and solutions in diabetes and advanced chronic kidney disease: a patient-oriented qualitative research study. CMAJ Open. 2019;7(2):E258–63. https://doi.org/10.9778/cmajo.20180177.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Cook T, Atkin H, Carter L, Mitchell P, Moore P, Bell E, et al. Towards inclusive living: A case study of the impact of inclusive practice in neuro-rehabilitation/neuro-psychiatry service. Newcastle Upon Tyne: Northumbria University; 2013. Department of Health Policy Research Programme LTNC, 291 p.: Reference Number 530010

    Google Scholar 

  62. Corner J, Wright D, Hopkinson J, Gunaratnam Y, McDonald JW, Foster C. The research priorities of patients attending UK cancer treatment centres: findings from a modified nominal group study. Br J Cancer. 2007;96(6):875–81. https://doi.org/10.1038/sj.bjc.6603662.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  63. Wright D, Corner J, Hopkinson J, Foster C. Listening to the views of people affected by cancer about cancer research: an example of participatory research in setting the cancer research agenda. Health Expect. 2006;9(1):3–12. https://doi.org/10.1111/j.1369-7625.2006.00353.x.

    Article  PubMed  PubMed Central  Google Scholar 

  64. Cunningham S, Rodriguez A, Boyd KA, McIntosh E, Lewis SC, BIDS Collaborators Group. Bronchiolitis of Infancy Discharge Study (BIDS): a multicentre, parallel-group, double-blind, randomised controlled, equivalence trial with economic evaluation. Health Technol Assess. 2015;19(71):i–172. https://doi.org/10.3310/hta19710.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Davidson J, Wiens S, Anderson K. Creating a provincial family council to engage youth and families in child & youth mental health systems. J Can Acad Child Adolesc Psychiatry. 2010;19(3):169–75.

    Article  Google Scholar 

  66. de Wit MP, Kvien TK, Gossec L. Patient participation as an integral part of patient-reported outcomes development ensures the representation of the patient voice: a case study from the field of rheumatology. RMD Open. 2015;1(1):e000129. https://doi.org/10.1136/rmdopen-2015-000129.

    Article  PubMed  PubMed Central  Google Scholar 

  67. DeCamp LR, Polk S, Chrismer MC, Giusti F, Thompson DA, Sibinga E. Health care engagement of limited English proficient Latino families: lessons learned from advisory board development. Prog Community Health Partnersh. 2015;9(4):521–30. https://doi.org/10.1353/cpr.2015.0068.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Durham J, Fa’avale N, Fa’avale A, Zeisman C, Malama E, Tafa S, et al. The impact and importance of place on health for young people of Pasifika descent in Queensland, Australia: a qualitative study towards developing meaningful health equity indicators. Int J Equity Health. 2019;18(81):1–16.

  69. Edgren KK, Parker EA, Israel BA, Lewis TC, Salinas MA, Robins TG, et al. Community involvement in the conduct of a health education intervention and research project: community action against asthma. Health Promot Pract. 2005;6(3):263–9. https://doi.org/10.1177/1524839903260696.

    Article  PubMed  Google Scholar 

  70. Edwards V, Wyatt K, Logan S, Britten N. Consulting parents about the design of a randomized controlled trial of osteopathy for children with cerebral palsy. Health Expect. 2011;14(4):429–38. https://doi.org/10.1111/j.1369-7625.2010.00652.x.

    Article  PubMed  PubMed Central  Google Scholar 

  71. Wyatt K, Edwards V, Franck L, Britten N, Creanor S, Maddick A, et al. Cranial osteopathy for children with cerebral palsy: a randomised controlled trial. Arch Dis Child. 2011;96(6):505–12. https://doi.org/10.1136/adc.2010.199877.

    Article  PubMed  Google Scholar 

  72. Eisinger A, Senturia K. Doing community-driven research: a description of Seattle Partners for Healthy Communities. J Urban Health. 2001;78(3):519–34. https://doi.org/10.1093/jurban/78.3.519.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  73. Flicker S. Who benefits from community-based participatory research? A case study of the positive youth project. Health Educ Behav. 2008;35(1):70–86. https://doi.org/10.1177/1090198105285927.

    Article  PubMed  Google Scholar 

  74. Flores E, Espinoza P, Jacobellis J, Bakemeier R, Press N. The greater Denver Latino Cancer prevention/control network. Prevention and research through a community-based approach. Cancer. 2006;107(8 Suppl):2034–42. https://doi.org/10.1002/cncr.22146.

    Article  PubMed  Google Scholar 

  75. Gill M, Bagshaw SM, McKenzie E, Oxland P, Oswell D, Boulton D, et al. Patient and family member-led research in the intensive care unit: a novel approach to patient-centered research. PLoS One. 2016;11(8):e0160947. https://doi.org/10.1371/journal.pone.0160947.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  76. Gillard S, Borschmann R, Turner K, Goodrich-Purnell N, Lovell K, Chambers M. 'What difference does it make?' finding evidence of the impact of mental health service user researchers on research into the experiences of detained psychiatric patients. Health Expect. 2010;13(2):185–94. https://doi.org/10.1111/j.1369-7625.2010.00596.x.

    Article  PubMed  PubMed Central  Google Scholar 

  77. Greenwood DA, Litchman ML, Ng AH, Gee PM, Young HM, Ferrer M, et al. Development of the intercultural diabetes online community research council: Codesign and social media processes. J Diabetes Sci Technol. 2019;13(2):176–86. https://doi.org/10.1177/1932296818818455.

    Article  PubMed  PubMed Central  Google Scholar 

  78. Hanes JE, Hlyva O, Rosenbaum P, Freeman M, Nguyen T, Palisano RJ, et al. Beyond stereotypes of cerebral palsy: exploring the lived experiences of young Canadians. Child Care Health Dev. 2019;45(5):613–22. https://doi.org/10.1111/cch.12705.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Jinks C, Ong BN, O'Neill TJ. The Keele community knee pain forum: action research to engage with stakeholders about the prevention of knee pain and disability. BMC Musculoskelet Disord. 2009;10(85):1–11.

  80. Kearns Á, Kelly H, Pitt I. Rating experience of ICT-delivered aphasia rehabilitation: co-design of a feedback questionnaire. Aphasiology. 2020;34(3):319–42. https://doi.org/10.1080/02687038.2019.1649913.

    Article  Google Scholar 

  81. Kelley ML, Prince H, Nadin S, Brazil K, Crow M, Hanson G, et al. Developing palliative care programs in indigenous communities using participatory action research: a Canadian application of the public health approach to palliative care. Ann Palliat Med. 2018;7(Suppl 2):S52–72. https://doi.org/10.21037/apm.2018.03.06.

    Article  PubMed  Google Scholar 

  82. Khan A, Coffey M, Litterer KP, Baird JD, Furtak SL, Garcia BM, et al. Families as partners in hospital error and adverse event surveillance. JAMA Pediatr. 2017;171(4):372–81. https://doi.org/10.1001/jamapediatrics.2016.4812.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Khan A, Spector ND, Baird JD, Ashland M, Starmer AJ, Rosenbluth G, et al. Patient safety after implementation of a coproduced family centered communication programme: multicenter before and after intervention study. BMJ. 2018;363:k4764. https://doi.org/10.1136/bmj.k4764.

    Article  PubMed  PubMed Central  Google Scholar 

  84. Kleinman LC, Lutz D, Plumb EJ, Barkley P, Nazario HR, Ramos MA, et al. A partnered approach for structured observation to assess the environment of a neighborhood with high diabetes rates. Prog Community Health Partnersh. 2011;5(3):249–59. https://doi.org/10.1353/cpr.2011.0036.

    Article  PubMed  PubMed Central  Google Scholar 

  85. Krewulak KD, Sept BG, Stelfox HT, Ely EW, Davidson JE, Ismail Z, et al. Feasibility and acceptability of family administration of delirium detection tools in the intensive care unit: a patient-oriented pilot study. CMAJ Open. 2019;7(2):E294–9. https://doi.org/10.9778/cmajo.20180123.

    Article  PubMed  PubMed Central  Google Scholar 

  86. Lechelt LA, Rieger JM, Cowan K, Debenham BJ, Krewski B, Nayar S, et al. Top 10 research priorities in head and neck cancer: results of an Alberta priority setting partnership of patients, caregivers, family members, and clinicians. Head Neck. 2018;40(3):544–54. https://doi.org/10.1002/hed.24998.

    Article  PubMed  Google Scholar 

  87. Lewis D, Yerby L, Tucker M, Foster PP, Hamilton KC, Fifolt MM, et al. Bringing community and academic scholars together to facilitate and conduct authentic community Based participatory research: project UNITED. Int J Environ Res Public Health. 2015;13(1):ijerph13010035.

    Article  Google Scholar 

  88. McCormick N, Hamilton CB, Koehn CL, English K, Stordy A, Li LC. Canadians' views on the use of routinely collected data in health research: a patient-oriented cross-sectional survey. CMAJ Open. 2019;7(2):E203–9. https://doi.org/10.9778/cmajo.20180105.

    Article  PubMed  PubMed Central  Google Scholar 

  89. Mendel P, Ngo VK, Dixon E, Stockdale S, Jones F, Chung B, et al. Partnered evaluation of a community engagement intervention: use of a kickoff conference in a randomized trial for depression care improvement in underserved communities. Ethn Dis. 2011;21(3 Suppl 1):S1–88.

    PubMed  Google Scholar 

  90. Middleton H, Shaw R, Collier R, Purser A, Ferguson B. The dodo bird verdict and the elephant in the room: a service user-led investigation of crisis resolution and home treatment. Health Sociol Rev. 2011;20(2):147–56. https://doi.org/10.5172/hesr.2011.20.2.147.

    Article  Google Scholar 

  91. Mishra MK, Saunders CH, Rodriguez HP, Shortell S, Fisher E, Elwyn G. How do healthcare professionals working in accountable care organisations understand patient activation and engagement? Qualitative interviews across two time points. BMJ Open. 2018;8(10):e023068. https://doi.org/10.1136/bmjopen-2018-023068.

    Article  PubMed  PubMed Central  Google Scholar 

  92. Munoz S-A. Co-producing care services in rural areas. J Integr Care. 2013;21(5):276–87. https://doi.org/10.1108/JICA-05-2013-0014.

    Article  Google Scholar 

  93. Nelson RG, Pankratz VS, Ghahate DM, Bobelu J, Faber T, Shah VO. Home-based kidney care, patient activation, and risk factors for CKD progression in Zuni Indians: a randomized, controlled clinical trial. Clin J Am Soc Nephrol. 2018;13(12):1801–9. https://doi.org/10.2215/CJN.06910618.

    Article  PubMed  PubMed Central  Google Scholar 

  94. Oliver S, Milne R, Bradburn J, Buchanan P, Kerridge L, Walley T, et al. Investigating consumer perspectives on evaluating health technologies. Evaluation. 2001;7(4):468–86. https://doi.org/10.1177/13563890122209847.

    Article  Google Scholar 

  95. Patel DI, Winkler P, Botello J, Villarreal J, Puga F. The citizen scientist: community-academic partnerships through translational advisory boards. Patient Educ Couns. 2016;99(12):2087–90. https://doi.org/10.1016/j.pec.2016.07.013.

    Article  PubMed  Google Scholar 

  96. Peacock N, Issel LM, Townsell SJ, Chapple-McGruder T, Handler A. An innovative method to involve community health workers as partners in evaluation research. Am J Public Health. 2011;101(12):2275–80. https://doi.org/10.2105/AJPH.2011.300263.

    Article  PubMed  PubMed Central  Google Scholar 

  97. Pelletier JF, Lesage A, Boisvert C, Denis F, Bonin JP, Kisely S. Feasibility and acceptability of patient partnership to improve access to primary care for the physical health of patients with severe mental illnesses: an interactive guide. Int J Equity Health. 2015;14(1):78. https://doi.org/10.1186/s12939-015-0200-0.

    Article  PubMed  PubMed Central  Google Scholar 

  98. Potestio ML, Boyd JM, Bagshaw SM, Heyland D, Oxland P, Doig CJ, et al. Engaging the public to identify opportunities to improve critical care: a qualitative analysis of an open community forum. PLoS One. 2015;10(11):e0143088. https://doi.org/10.1371/journal.pone.0143088.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  99. Rai SK, Howren A, Wilcox ES, Townsend A, Marra CA, Aviña-Zubieta A, et al. Exploring strategies to support medication adherence in patients with inflammatory arthritis: a patient-oriented qualitative study using an interactive focus group activity. Patient Prefer Adherence. 2018;12:2015–25. https://doi.org/10.2147/PPA.S174672.

    Article  PubMed  PubMed Central  Google Scholar 

  100. Ritte R, Panozzo S, Johnston L, Agerholm J, Kvernmo SE, Rowley K, et al. An Australian model of the First 1000 Days: an Indigenous-led process to turn an international initiative into an early-life strategy benefiting indigenous families. Glob Health Epidemiol Genom. 2016;1:e11.

    Article  CAS  Google Scholar 

  101. Saunders C, Girgis A, Butow P, Crossing S, Penman A. Beyond scientific rigour: funding cancer research of public value. Health Policy. 2007;84(2–3):234–42. https://doi.org/10.1016/j.healthpol.2007.05.002.

    Article  PubMed  Google Scholar 

  102. Smith SL, Blake K, Olson CR, Tessaro I. Community entry in conducting rural focus groups: process, legitimacy, and tt1 lessons learned. J Rural Health. 2002;18(1):118–24. https://doi.org/10.1111/j.1748-0361.2002.tb00883.x.

    Article  PubMed  Google Scholar 

  103. Staniszewska S, Brett J, Redshaw M, Hamilton K, Newburn M, Jones N, et al. The POPPY study: developing a model of family-centred care for neonatal units. Worldviews Evid-Based Nurs. 2012;9(4):243–55. https://doi.org/10.1111/j.1741-6787.2012.00253.x.

    Article  PubMed  Google Scholar 

  104. Brett J, Staniszewska S, Newburn M, Jones N, Taylor L. A systematic mapping review of effective interventions for communicating with, supporting and providing information to parents of preterm infants. BMJ Open. 2011;1(1):e000023. https://doi.org/10.1136/bmjopen-2010-000023.

    Article  PubMed  PubMed Central  Google Scholar 

  105. Stirman SW, Goldstein LA, Wrenn G, Barrett M, Connolly Gibbons MB, Casiano D, et al. Developing research and recruitment while fostering stakeholder engagement in a National Institutes of mental health-funded interventions and practice research infrastructure programs grant for depression. Prog Community Health Partnersh. 2010;4(4):299–303. https://doi.org/10.1353/cpr.2010.0020.

    Article  PubMed  PubMed Central  Google Scholar 

  106. Suarez-Balcazar Y, Hellwig M, Kouba J, Redmond L, Martinez L, Block D, et al. The making of an interdisciplinary partnership: the case of the Chicago food system collaborative. Am J Community Psychol. 2006;38(1–2):113–23. https://doi.org/10.1007/s10464-006-9067-y.

    Article  PubMed  Google Scholar 

  107. Sweeney G, O’Hagan B, Squire S, Powell C. The patients accelerating change project: does it make any difference? Clin Gov: Int J. 2005;10(1):72–83. https://doi.org/10.1108/14777270510579323.

    Article  Google Scholar 

  108. Tapp H, Derkowski D, Calvert M, Welch M, Spencer S. Patient perspectives on engagement in shared decision-making for asthma care. Fam Pract. 2017;34(3):353–7. https://doi.org/10.1093/fampra/cmw122.

    Article  PubMed  Google Scholar 

  109. Tapp H, Shade L, Mahabaleshwarkar R, Taylor YJ, Ludden T, Dulin MF. Results from a pragmatic prospective cohort study: shared decision making improves outcomes for children with asthma. J Asthma. 2017;54(4):392–402. https://doi.org/10.1080/02770903.2016.1227333.

    Article  PubMed  Google Scholar 

  110. Thompson JL. Building collective communication competence in interdisciplinary research teams. J Appl Commun Res. 2009;37(3):278–97. https://doi.org/10.1080/00909880903025911.

    Article  Google Scholar 

  111. Thompson J, Bissell P, Cooper CL, Armitage CJ, Barber R. Exploring the impact of patient and public involvement in a cancer research setting. Qual Health Res. 2014;24(1):46–54. https://doi.org/10.1177/1049732313514482.

    Article  PubMed  PubMed Central  Google Scholar 

  112. Wahbe TR, Jovel EM, García DRS, Pilco Llagcha VE, Rose PN. Building international indigenous People’s partnerships for community-driven health initiatives. EcoHealth. 2007;4(4):472–88. https://doi.org/10.1007/s10393-007-0137-x.

    Article  Google Scholar 

  113. Wells KB, Jones L, Chung B, Dixon EL, Tang L, Gilmore J, et al. Community-partnered cluster-randomized comparative effectiveness trial of community engagement and planning or resources for services to address depression disparities [published correction appears in J Gen Intern Med, 2013; 28(11):1534]. J Gen Intern Med. 2013;28(10):1268–78. https://doi.org/10.1007/s11606-013-2484-3.

    Article  PubMed  PubMed Central  Google Scholar 

  114. Woolf SH, Zimmerman E, Haley A, Krist AH. Authentic engagement of patients and communities can transform research, practice, and policy. Health Aff (Millwood). 2016;35(4):590–4. https://doi.org/10.1377/hlthaff.2015.1512.

    Article  Google Scholar 

  115. Wyatt K, Carter M, Mahtani V, Barnard A, Hawton A, Britten N. The impact of consumer involvement in research: an evaluation of consumer involvement in the London primary care studies Programme. Fam Pract. 2008;25(3):154–61. https://doi.org/10.1093/fampra/cmn019.

    Article  PubMed  Google Scholar 

  116. Ashcroft J, Wykes T, Taylor J, Crowther A, Szmukler G. Impact on the individual: what do patients and carers gain, lose and expect from being involved in research? J Ment Health. 2016 Jan 2;25(1):28–35. https://doi.org/10.3109/09638237.2015.1101424.

    Article  PubMed  PubMed Central  Google Scholar 

  117. Hemphill R, Forsythe LP, Heckert AL, Amolegbe A, Maurer M, Carman KL, et al. What motivates patients and caregivers to engage in health research and how engagement affects their lives: qualitative survey findings. Health Expect. 2020 Apr;23(2):328–36. https://doi.org/10.1111/hex.12979.

    Article  PubMed  Google Scholar 

  118. McCarron TL, Noseworthy T, Moffat K, Wilkinson G, Zelinsky S, White D, et al. Understanding the motivations of patients: a co-designed project to understand the factors behind patient engagement. Health Expect. 2019;22(4):709–20. https://doi.org/10.1111/hex.12942.

    Article  PubMed  PubMed Central  Google Scholar 

  119. Hanley B, Truesdale A, King A, Elbourne D, Chalmers I. Involving consumers in designing, conducting, and interpreting randomised controlled trials: questionnaire survey. BMJ. 2001 Mar 3;322(7285):519–23. https://doi.org/10.1136/bmj.322.7285.519.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  120. SCPOR Patient-oriented research level of engagement tool [PORLET]. 2019. Available from https://www.scpor.ca/porlet. Accessed April 01 2021.

    Google Scholar 

Download references

Acknowledgments

This rapid realist review was supported with in-kind funds from the Saskatchewan Centre for Patient-Oriented Research (SCPOR) and the College of Medicine at the University of Saskatchewan. The authors would like to acknowledge Tamara Waldron, Maniza Abedin Choudry, Gideon Asamoah, Anum Ali, Holly Ellinor and Maryam Yasinian for their support of this study.

Funding

This rapid realist review is supported with in-kind funds from the Saskatchewan Centre for Patient-Oriented Research and the College of Medicine at the University of Saskatchewan.

Author information

Authors and Affiliations

  1. Department of Community Health and Epidemiology, University of Saskatchewan, 107 Wiggins Road, Saskatoon, SK, S7N 5E5, Canada

    Elaine Zibrowski, Tracey Carr & Gary Groot

  2. Patient partner, Saskatoon, Saskatchewan, Canada

    Shelagh McDonald & Heather Thiessen

  3. Patient partner, Regina, Saskatchewan, Canada

    Ray van Dusen

  4. Saskatchewan Centre for Patient-Oriented Research, Health Sciences Building, 107 Wiggins Road, Saskatoon, SK, S7N 5E5, Canada

    Charlene Haver & Christine Stobart

  5. University of Saskatchewan, College of Medicine, 107 Wiggins Road, Saskatoon, SK, S7N 5E5, Canada

    Donna Goodridge & Darcy Marciniuk

  6. Saskatchewan Health Quality Council, Atrium Building, Innovation Place, 241 – 111 Research Drive, Saskatoon, SK, S7N 3R2, Canada

    Tanya Verrall

Authors
  1. Elaine Zibrowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tracey Carr
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shelagh McDonald
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Heather Thiessen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ray van Dusen
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Donna Goodridge
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Charlene Haver
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Darcy Marciniuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Christine Stobart
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Tanya Verrall
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Gary Groot
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

EZ contributed to conceptualization, funding acquisition, methodology, project administration, writing the original draft and reviewing and editing the final version. TC contributed to conceptualization, methodology, project administration, supervision, writing-review and editing the final version. SM, HT and RVD contributed to conceptualization and writing-review of the final version. DG and TV contributed to conceptualization, methodology and writing-review of the final version. CH and DM contributed to conceptualization and writing-review of the final version. CS contributed to conceptualization, funding acquisition, project administration and writing-review of the final version. GG contributed to conceptualization, funding acquisition, methodology, project administration, supervision and writing-review of the final version. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Gary Groot.

Ethics declarations

Completing interests

The authors declare that they have no competing interests.

Ethics approval and consent to participate

Our research involved a secondary review of previously disseminated information. We were granted a formal exemption from institutional review by the Behavioral Research Ethics Board at the University of Saskatchewan.

Consent for publication

Not applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Appendices A-G.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Zibrowski, E., Carr, T., McDonald, S. et al. A rapid realist review of patient engagement in patient-oriented research and health care system impacts: part one. Res Involv Engagem 7, 72 (2021). https://doi.org/10.1186/s40900-021-00299-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40900-021-00299-6

Research Involvement and Engagement

ISSN: 2056-7529

Contact us