Skip to main content
Download PDF
Download ePub
  • Research article
  • Open access
  • Published:

Development and formative evaluation of patient research partner involvement in a multi-disciplinary European translational research project

Research Involvement and Engagement volume 6, Article number: 6 (2020) Cite this article

Plain English summary

Patient and public involvement (PPI) improves the quality of health research and ensures that research is relevant to patients’ needs. Though PPI is increasingly evident in clinical and health services research, there are few examples in the research literature of effective PPI in translational and laboratory-based research. In this paper, we describe the development and evaluation of PPI in a multi-centre European project (EuroTEAM – Towards Early biomarkers in Arthritis Management) that included both translational and laboratory-based and psychosocial research. We found that although most PPI in EuroTEAM was centred around the psychosocial research, there were examples of PPI in the laboratory studies. As the project evolved, researchers became better at accommodating PPI and identifying PPI opportunities. It was generally agreed that PPI had a positive impact on the project overall, particularly on public engagement with the research. We concluded that the inclusion of both psychosocial and laboratory-based research in the same project facilitated PPI across all aspects of the research. In future projects, we would try to specify individual PPI activities in more detail at the project-planning stage, and better accommodate patient partners who are not native speakers of English.

Abstract

Background

Patient and public involvement (PPI) enhances research quality and relevance and is central to contemporary health policy. The value of PPI has been recognised in rheumatology research, though there are limited examples of PPI in basic and translational science. The EU FP7 funded ‘EuroTEAM’ (Towards Early biomarkers in Arthritis Management) project was established to develop biomarker-based approaches to predict the future development of rheumatoid arthritis and incorporated psychosocial research to investigate the perceptions of ‘at risk’ individuals about predictive testing, and to develop informational resources about rheumatoid arthritis (RA) risk. Patient involvement was central to EuroTEAM from the inception of the project. The objective of this paper is to describe the development of PPI in EuroTEAM, formatively assess the impact of PPI from the perspectives of researchers and patient research partners (PRPs), reflect on successes and lessons learned, and formulate recommendations to guide future projects.

Methods

Two mixed-methods surveys (for PRPs and researchers) and a teleconference were undertaken to assess the impact of PPI on individual work packages and on EuroTEAM overall.

Results

There was consensus about the positive impact of PPI on the research and on the experiences of those involved. In particular, the positive impact of PPI on the personal development of researchers, and on effective public engagement with EuroTEAM research were highlighted. Researchers described adapting their practice in future projects to facilitate PPI. Spin-off projects and ongoing collaborations between PRPs and researchers reflected the value of PPI to participants. PPI was more frequently integrated in psychosocial research, though examples of PPI in laboratory/translational science were also described. PRPs asked for more opportunities to contribute meaningfully to basic scientific research and for more extensive feedback on their contributions.

Conclusions

The findings were used to formulate recommendations to guide effective involvement of patients in future similar projects, including identifying specific training requirements for PRPs and researchers, the identification of PRP focused tasks/deliverables at the project planning stage, and supporting access to involvement for all PRPs. Importantly, the distinctive multidisciplinary approach of EuroTEAM, incorporating both basic science and psychosocial research, facilitated patient involvement in the project overall.

Peer Review reports

Background

Patient-centred approaches are integral to contemporary health policy. Consequently, patient and public involvement (PPI) have become increasingly important in health research and service evaluation [1]. PPI has been defined as research being carried out “‘with’ or ‘by’ members of the public rather than ‘to’, ‘about’ or ‘for’ them” [2]. It is a central theme of the National Institute for Health Research (NIHR) in the United Kingdom, and evidence of active engagement with PPI is now a requirement for many funding bodies, including the European Union’s Horizon 2020 (H2020) funding stream. H2020 guidelines state that “Patients and citizens must be involved in the entire process, from the design of research programmes to the dissemination and implementation of results relating to wellbeing, health, social care, public health, and society” [3].

The involvement of patients in decisions that ultimately affect them has been accepted as beneficial to health research in a number of ways [4]. PPI enhances research quality, efficiency, and transparency, and helps ensure that public benefit is the key focus of the work undertaken. Consultation with those affected by research outcomes has augmented research relevance and validity, and facilitated wider dissemination and engagement with research from patients / members of the public. Patients have become involved with delivering research goals in several ways, at all stages of the research process. For example, they have contributed to priority setting, supported grant applications, advised on clinical trial design, provided feedback on patient facing documents, prepared lay summaries and supported other forms of research dissemination. Patients’ experience of living with a disease has brought additional and unique perspectives [5].

There has been a growing appreciation of the benefits of PPI within rheumatology research [6, 7]. For example, patients have contributed to: the development of questionnaires to assess help-seeking behaviours in patients with new onset rheumatoid arthritis (RA) [8] and hypothetical reactions to the symptoms of RA amongst members of the public [9]; the development of interview schedules [10,11,12]; systematic reviews [13,14,15]; generating research ideas [16]; rheumatology conferences [17] and the development of international research recommendations [18,19,20].

Effective PPI has fostered the development of ongoing, mutually advantageous relationships between researchers and patient research partners (PRPs) [21, 22]. However, maximising achievement of PPI goals has considerable resource implications. Funding may be required to compensate patients for their time and expenses, provide experienced staff to coordinate PPI and deliver appropriate training for researchers and PRPs. Researchers need to invest time into the development of resources to support meaningful patient involvement, such as lay summaries, glossaries and background information on key project elements [23]. Without resource allocation to support PPI, patient involvement risks becoming tokenistic [24, 25].

Whilst PPI has become increasingly commonplace in clinical and health services research, it has been less frequently integrated with early phase translational and laboratory based research [26, 27]. Although patients and researchers agree on the benefits of PPI in pre-clinical translational research in the context of rheumatology, associated challenges include communication between researchers and patients about scientific concepts and terminology and limited access to and awareness of PPI opportunities [28,29,30].

A further challenge associated with PPI is the difficulty in evaluating its impact [23]. Whilst there have been calls for more robust quantitative assessment of the impact of PPI on research quality, it has been argued that it is also important to capture the experiential, contextual impact of PPI on both researchers and patient research partners [31].

This paper describes the development and formative evaluation of the impact of PPI in a European Union FP7 funded translational research project, EuroTEAM - Towards Early biomarkers in Arthritis Management, which ran from 2012 to 2016. The aim of this multidisciplinary project was to develop new biomarker-based approaches to predict the development of RA in people who do not yet have the disease. RA is a chronic inflammatory disease affecting the joints and internal organs, and is associated with a reduced life expectancy of around 10 years. Early treatment of RA is associated with better clinical outcomes. If uncontrolled, this painful condition can lead to irreversible joint erosion and disability [32]. Improved prediction of RA development would facilitate early treatment and the development of preventive interventions.

An innovative aspect of the EuroTEAM project was that it encompassed both laboratory based science that addressed the identification of predictive biomarkers [33,34,35,36,37,38,–39] and psychosocial research, that explored the perspectives of potential end-users of predictive tests for RA, and how disease related risk information could be communicated effectively to those at risk of developing RA in the future [40,41,42,43,–44]. In order to ensure the quality and relevance of the research and to facilitate effective translation and dissemination of the research findings, PPI was considered an essential part of EuroTEAM from its inception. PPI was specifically funded and supported by the management team.

The objective of this paper is to describe the development of PPI in the EuroTEAM project, and the results of two mixed-methods surveys, undertaken towards the end of the project to capture the perspectives of both researchers and patients on the impact of PPI on this research. Our secondary objective is to reflect on the findings of this evaluation to identify good practice and areas for improvement to inform effective PPI in future projects of this kind.

Methods

Patient research partner involvement and EuroTEAM

The EuroTEAM project was a multidisciplinary collaboration between 16 partners across Europe [Table 1a]. The consortium comprised of 13 universities and 3 small/medium enterprises (SMEs) led by the University of Birmingham. EuroTEAM contained 5 work packages (WPs): genetic biomarkers (WP1), blood biomarkers (WP2), tissue biomarkers (WP3), dissemination and user integration (WP4), and project management (WP5). WPs 1–3 comprised of laboratory-based studies to identify biomarkers predictive of future RA development. The focus of WP4 was psychosocial research to elucidate the perspectives of individuals with an elevated risk of developing RA in the future (first degree relatives of existing RA patients and individuals with clinically suspect joint symptoms) [45]. The aim was to capture this group’s thoughts about being ‘at risk’, their acceptance of predictive testing and preferences for risk communication. A further objective of WP4 was the development and evaluation of informational material for individuals at risk of developing RA.

Table 1 Geographical distribution of EuroTEAM a) consortium partners and b) patient research partners (PRPs)
Full size table

During the early planning stages of EuroTEAM, several national RA organisations and patient groups in a range of European countries [Table 2] were approached in order to seek endorsement of the project, provide advice and support for the funding application, and to identify potential PRPs. Additional PRPs were recruited via clinician researchers and PRPs’ own networks, resulting in a panel of 9 PRPs; 8 patients with a diagnosis of RA and 1 person whose first-degree relative had RA [Table 1b]. PRP activity was co-ordinated by a research group manager and PRPs were compensated for travel/subsistence expenses incurred.

Table 2 European patient organisations approached to identify potential patient research partners
Full size table

PRPs contributed to a number of research activities over the 4 year project, with participation being voluntary at all times. Research activities with active patient partner involvement included:

  • Attending and contributing to annual scientific meetings and regular teleconferences

  • Development of a glossary resource (WP1–4)

  • Contributing to a meta-synthesis of qualitative literature on public perceptions of predictive testing [13, 14] (WP4)

  • Contributing to the development of interview schedules (including question setting) and the interpretation of qualitative data [12, 46] (WP4)

  • Contributing to the development of informational resources for those at risk (WP4)

  • Evaluating a web-based platform for the communication of risk information (WP4)

  • Developing a questionnaire for patients undergoing a lymph node biopsy procedure (WP3)

  • Developing informational resources for patients about RA such as the ‘Metaphor Project’ (a collaboration between Eva C Johansson (PRP) and Dr. Heidi Wähämaa from the Karolinska Institutet) exploring the communication of scientific concepts via the use of metaphors and visual representations

  • Contributing to the project website (e.g. providing news items and reports, creating subtitles for videos) (WP4)

  • Developing lay summaries of EuroTEAM methods and findings (e.g. lay summary of metabolomics in EuroTEAM) (WP2)

  • Developing posters for dissemination at the European League Against Rheumatism (EULAR) Congress (WP1–4)

Training for PRPs was provided on an ad-hoc basis for specific research activities (e.g. analysis and interpretation of qualitative data) [14]. Annual project meetings included a day focused specifically on PRPs, where presentations were delivered by the researchers in lay language. No formal training for researchers was provided, however EULAR patient involvement reference cards were utilised by some consortium members [47]. Many researchers adapted to accommodate PRP needs as the project evolved, due to increased mutual understanding. For example, lay summaries were incorporated into research presentations, and frequent short breaks were introduced at annual meetings to avoid PRPs sitting for long periods. Reporting of patient involvement is summarized in Additional file 3.

Evaluation of PPI in EuroTEAM

Towards the end of the EuroTEAM project, two surveys (one for PRPs and another for researchers; Additional files 1 and 2, respectively) were developed to evaluate the impact of PPI in EuroTEAM. The surveys included Likert-type response scales and free text responses and asked respondents to evaluate the impact of PPI in WPs1–3 and WP4 separately, as well as the impact of PPI on the project as a whole. The design and content of the surveys themselves were developed in collaboration with PRPs to ensure they were understandable and comprehensive. The surveys were distributed in April 2016 via email to all 9 PRPs and 51 researchers [Table 3]. Email reminders were sent out to non-responders after 2 weeks. Responses were collated and summarised descriptively. The frequency with which each response category was chosen was summed for Likert-type scales, and descriptive thematic analysis of free text responses was undertaken by RB and MF. A teleconference was held with PRPs and researchers to review and interpret the survey findings and their implications for future projects. Two PRPs also contributed to the preparation of this manuscript.

Table 3 Survey recipients
Full size table

Results

Respondents

Sixty-six per cent (6 out of 9) of PRPs and 29% (15 out of 51) of researchers completed the surveys. All the PRPs who responded were female. Two were aged between 30 and 39 years, two aged 50–59 years and two were aged between 60 and 69 years.

Eleven of the 15 researchers were female. Four were aged between 30 and 39 years, eight were aged 40–49 years, two were 50–59 years and one was aged between 60 and 69 years). Fourteen were from academic institutions, one was from an SME. Six were clinical researchers, nine were non-clinical researchers.

Survey for patient research partners

The quantitative results of the survey for PRPs are summarized in Table 4. All of the PRP respondents reported that their involvement had a positive overall impact on the EuroTEAM project. This was mainly described in terms of the effect of their involvement on researchers’ perspectives and ability to communicate with members of the public:

“A present, physical reminder of the lay aspects of communication and the patient perspective.”

Respondents stated they had made a large or moderate positive contribution to WP4, and described being involved in specific research activities:

“Contribution at coding and summarizing activity, study protocol, leaflet/brochures for patients, dissemination (in the future), feedback questionnaires, video transcript, writing an article in PARE [People with Arthritis/Rheumatism in Europe)] e-Breakthrough, EuroTEAM website”

The majority of the PRPs thought they had made a minor or moderate positive contribution to WPs 1–3, with one PRP reporting a larger contribution

“I think we made a large contribution to the lymph node biopsy questionnaire for WP3, but for WP1 and WP2 maybe not so much, apart from the overall impact.”

Most of the PRPs found they had a moderate understanding of EuroTEAM from the outset. Half of the PRPs said there were about the right number of assignments for them, whereas half stated that there were too few assignments. All agreed that the assignments were of an appropriate level of difficulty and that they received suitable levels of information about them, however some respondents mentioned that more contextual information or specific training and feedback would have been useful. Half of the respondents stated that they had received too little feedback on the outcome of their contributions to this project:

“When introducing a completely new skill – e.g. coding – perhaps more training, and feedback, would be helpful”

All respondents agreed that the glossary resource was either very useful or extremely useful, and that PRP involvement in EuroTEAM was well co-ordinated. PRP contributions were reported to have been welcomed by researchers and fairly acknowledged:

“We were welcomed and included in the team. We were listened to with respect. We were included in setting recommendations for future work.”

Most PRPs mentioned that their contribution to meetings was very or extremely well supported, although one reported that there had been a moderate amount of support. Some described how this support evolved over the project:

“By the end of the project, with PRPs in the room, the researchers automatically featured some lay language in their presentations, avoiding the need for separate briefing: by this stage the PRPs themselves were also more familiar with the scientific concepts and language of the project. So we all learnt together.”

For many respondents, building relationships with researchers was one of the most valuable aspects of participating in EuroTEAM:

“Enjoyed opportunity to talk to researchers and especially encouraging young researchers to interact with patients.”

In particular, PRPs valued being treated as respected equal partners in the research process …

“Never felt patronised but always valued.”

… and found that their involvement with EuroTEAM had had a positive impact on them personally:

“A definite positive impact. Very informative and challenging in a good way. I’ve definitely grown as a person through the work and meeting all the people in the consortium”.

Such interactions between researchers and PRPs also led to the development of innovative spin-off collaborations:

“The Metaphor project showed pure imagination.”

All respondents to the survey for PRPs were either very interested or extremely interested in contributing to future projects as a PRP. When asked how PRP involvement could have been improved in EuroTEAM, some described accessibility issues relating to accommodation provided at annual project meetings, and several made suggestions to support communication between researchers and PRPs, such as: the need for short breaks during meetings; more materials in lay language; more feedback on project progress and the outcome of PRPs contributions; lay summaries and printouts of slides used in presentations; consideration of non-native English speakers’ needs during teleconferences and face to face meetings.

Table 4 Quantitative results of the survey for patient research partners (PRPs; N = 6)
Full size table

Some also identified missed opportunities for dissemination:

“I think the PRPs themselves could have written (or should write) an abstract about their experiences and submit it for the PARE sessions at the EULAR congress.”

Survey for researchers

The quantitative results of the survey for researchers are summarised in Table 5. Respondents had varying levels of previous experience of working with PRPs, ranging from none to extensive experience, however the majority of researchers reported no prior experience. All respondents were in agreement that PRP involvement had a positive impact on EuroTEAM:

“The patient research partners have not only given an insight into what it actually entails to have RA and which aspects they feel we need to address in our research, they have contributed enormously to the project, both intellectually and practically. It has made the project’s outcomes more valuable to the RA community, relatives and friends as well as the research community.” (non-clinical researcher, academic institution)

“The respect which was shown for PRPs (for example, mini pauses) created an overall kind and positive atmosphere. PRP presence reminds us why we do research. For non-clinical scientists it is really important to meet patients – for some scientists EuroTEAM might have been the first time?” (non-clinical researcher, academic institution)

Several researchers recounted that they had learnt a great deal from their involvement with PRPs, particularly in relation to their ability to engage with the public about their research:

“I personally learned a lot about how to translate scientific terminology into understandable language to meet the demands of a lay audience. It was advantageous for the project that the patient focus sometimes differed from the scientific/medical focus.” (communications manager, SME)

Of the five respondents who were most involved in WP2, one mentioned that PRPs had not been able to contribute positively to this work package:

“The PRPs were very interested in our research, but did not/could not contribute to the research questions, methods or interpretation of the results.” (clinical researcher, academic institution)

Another said that PRPs had been able to make a minor contribution, whereas another stated that PRPs had contributed moderately and two found that PRPs had been able to make a large contribution to this work package.

Table 5 Quantitative results of the survey for researchers (N = 15)
Full size table

Of the four respondents who were most involved in WP3, one found that the PRPs had not been able to contribute positively, others stated that PRPs had made a minor (N = 1) or large (N = 2) contribution to this work package.

Amongst the six respondents who were most involved in WP4, there was agreement that PRPs had been able to make a large (N = 3) or extremely large (N = 3) contribution:

“Their contribution has been very substantial … They have been involved with the coding and analysis of interviews. They have been an integral part of the development of the resources for people at risk of RA. PRPs have been instrumental in the development of the information resources we developed for people at risk of RA.” (non-clinical researcher, academic institution)

Five of the 15 researchers had been involved in more than one work package. Two of these had additionally been involved in WP1, and reported that PRPs had not been able to make a positive contribution at all, two had also been involved in WP3 and reported that PRPs had made a minor or moderate contribution. One researcher had additional involvement in WP4 and reported that PRPs had made an extremely large contribution to that work package.

The majority of PRP involvement was perceived to be focused around the psychosocial research carried out in WP4 and researchers sometimes found it difficult to identify meaningful ways to involve patients in other work packages:

“All work packages and research projects should have had input from PRPs and perhaps this should have been implemented earlier on. It should be an integral part of all the research carried out from the very beginning. In some of the more basic research this might be difficult on a practical level, but lay summaries of the findings at various stages are a minimum.” (non-clinical researcher, academic institution)

Those who actively involved PRPs found it very rewarding. For example:

“I had direct talks with patients followed by email correspondence in developing lay summaries of technologies. These were overwhelmingly positive, with positive involvement of the patients and a good and worthwhile contribution to the refinement of informational sources.” (non-clinical researcher, academic institution)

“Close involvement with the partners with producing lay summary of metabolomics technologies to augment a broader understanding.” (non-clinical researcher, academic institution)

When asked how PRP involvement in EuroTEAM had affected how they would involve PRPs in future projects, several researchers indicated that their perception of PPI had evolved throughout the project:

“Before working on EuroTEAM I was always somewhat wary of the idea of working with patients on research – I worried that they wouldn’t understand our work and that their direction would move research away from basic science to outcomes that aren’t the sort of thing I can do. However, I was mistaken. They are brilliant, enthusiastic and very supportive!” (non-clinical researcher, academic institution)

In addition, it was mentioned that PRPs could have a greater role in setting the research agenda:

“It would have been interesting to hear what individual PRPs think about the ongoing research and get their input on which kind of research they think we should prioritise and focus on. This would increase our insights (especially non-clinical researchers) what RA patients experience as a big health issues affecting their daily life.” (non-clinical researcher, academic institution)

Others described gaining insight that would change their approach in future projects, and highlighted that they would endeavour to find more meaningful ways for PRPs to be involved in basic scientific research:

“I would be more proactive in identifying tasks for PRPs to get involved with in the context of biological research studies to allow for their better integration into these projects.” (clinical researcher, academic institution)

“Try to find ways of asking for very specific, as well as general feedback on research.” (non-clinical researcher, academic institution)

It was also suggested that facilitating small-scale meetings alongside annual project meetings might facilitate communication between researchers and PRPs:

“Discussions on a personal level with PRPs present at the annual meeting happened during coffee/lunch breaks or dinner. Sometimes it was a bit hard to start a conversation and for the junior researchers it might not always have been clear, who the PRPs were and what they could talk about. Maybe this could be more guided somehow. Maybe by introducing a kind of speed date session for researchers and PRPs at the start of the project? Guided by the EULAR reference cards?” (non-clinical researcher, academic institution)

Some researchers believed that PPI should be incorporated into basic training for all researchers:

“I think that PRPs could (should?) be included as part of the PhD education:

  • To practice how to communicate with lay people

  • To meet a “real patient”, not only working with patient samples”

(non-clinical researcher, academic institution)

Some researchers mentioned that as a direct result of their positive experiences of working with PRPs in EuroTEAM, they had gone on to include PRPs in other projects:

“From EuroTEAM we recruited our “own” PRP to our research group … Overall, she has been a very important link between our rheumatologists and non-clinical PhD students and post-docs... Our group meetings are not only about cells and molecules anymore, we have also patient-orientated discussions with our rheumatologists.” (non-clinical researcher, academic institution)

“The involvement of PRPs was very important for my personal development. In the past I had no idea on how to contact them (as a non-clinical researcher) and how we could together bring research to a higher level. For me a new door has opened, and currently I am in contact with PRPs to discuss my future research proposal.” (non-clinical researcher, academic institution)

Discussion

These findings demonstrate the positive impact of PPI on a multi-centre, multidisciplinary European translational research project that incorporated both laboratory/translational science and psychosocial research. PRPs and researchers who completed the surveys reported that the involvement of PRPs in the project enhanced the research and their own experience of participating in this project. Both groups described the value of building ongoing relationships between patients and researchers and interactively developing their own knowledge and communication skills in ways that were not only personally rewarding but also facilitated effective public engagement and dissemination of the research findings. The development of innovative spin-off projects and ongoing future collaborations between PRPs and researchers reflected the value of PPI to those involved.

There was agreement between all respondents that the PRPs were able to make significant positive contributions to the psychosocial research and dissemination activities associated with WP4, but several reported that PRPs were less able to make a meaningful contribution to the laboratory-based research undertaken in WPs1–3. However, there were examples of effective patient contributions to these work packages that were valued by researchers and PRPs, such as the development of a questionnaire for patients undergoing a lymph node biopsy procedure, lay summaries of metabolomics studies, and lay posters of EuroTEAM findings, which were presented at the European League against Rheumatism (EULAR) Annual Meeting 2016. Several researchers mentioned that in future, they would actively try to identify specific (rather than general) ways in which patients could contribute to laboratory-based projects and dissemination of project results. It is possible that laboratory-based researchers’ awareness of PPI and confidence to implement it in their own research increased in response to proximity with the PPI activity that developed in WP4. In this respect, the distinctive multidisciplinary structure of EuroTEAM facilitated the evolution of PPI in this project. Moving towards more integrative, interdisciplinary models may further enhance PPI by developing common ground that is conducive to collaboration between patients and researchers.

The challenges associated with the involvement of patients in early stage translational science could be at least partly be addressed by appropriate training for researchers about the benefits of PPI and how to identify opportunities and overcome barriers to useful PRP involvement. This could be further supported at the project planning stage by incorporation of deliverables and/or milestones that specifically relate to activities involving PRPs, such as the development of lay progress reports. However, it may be difficult to specify in advance the extent to which patients are able or willing to be involved. It is important to avoid imposing heavy workloads or tight deadlines on patients who may have limited availability and are continuously managing the impact of a chronic condition on their lives, which may also be busy with work, family or other commitments. It is important that patients do not feel pressurised to contribute to research activities unwillingly in order to satisfy research objectives or funders’ requirements.

A further issue raised was that PRPs thought that they would have benefitted from more direct feedback on the outcome or impact of their contributions to research activities, and ongoing progress of research studies within the project. Researchers may not always have been aware of the extent to which feedback could be provided to PRPs, or have had the time needed to provide such feedback. These findings align with recent work to clarify the kinds of feedback needed by public contributors to research [48]. These issues could also be addressed, in collaboration with PRPs, at the project planning stage. Training may be required (for both researchers and PRPs) and resources allocated to support the development of effective PPI, especially where local or institutional infrastructure or funding to support such activities is insufficient or absent. It was suggested in the current evaluation and elsewhere [28] that PPI related training could be integrated into basic training for research students. It is not difficult to imagine that funding bodies will increasingly expect institutional infrastructure, as well as project-specific capacity to support such PPI facilitators to be demonstrated, to ensure research relevance and impact.

Strengths and limitations

A strength of the surveys described here was the use of both quantitative and qualitative methods, which facilitated formative empirical assessment of the impact of PPI on the EuroTEAM project, and captured the experiential and contextual impact from the perspectives of the researchers and PRPs involved. The impact of PPI can be framed in terms of impact on the research itself or impact on the stakeholders involved [31, 49]. For example, some of the researchers in the present survey described how they had gained knowledge about RA from the patients’ expertise, and how they would alter their practice to facilitate PPI and dissemination in future projects as a direct result of their participation in EuroTEAM.

A second strength of the surveys was that they were developed in collaboration with PRPs, to ensure that the questions included were comprehensive from their perspective. PRPs also contributed to the interpretation of the survey results and the preparation of this manuscript, ensuring that their viewpoints were fully and fairly represented. A further strength was the pan-European nature of both PRPs and researchers.

A limitation of the surveys was that the respondents are unlikely to be representative. PRPs were mostly active members of patient organisations and therefore fully engaged with the promotion of patient representation and involvement. However, this can be said of most patients who are actively involved in research and is not specific to this study. Not all PRPs/researchers responded to the survey, and the response rate was particularly low amongst researchers, despite email reminders. With low participant numbers, the utility of the quantitative approach beyond formative evaluation was limited. Furthermore, as surveys were returned via email, respondents were identifiable. It is therefore possible that the results were susceptible to social desirability bias, or that those who responded were more likely to be proactively engaged with PPI and favourable towards the involvement of PRPs in a project of this kind.

The notion of representativeness of PRPs is a matter of ongoing debate [50]. Self-selected patient representatives often develop considerable research expertise in their own right, and this empowers them to contribute meaningfully to the research process. However, this could also be considered to detract from their position as representatives of the experience of lay people [28]. Ensuring that patients from all social groups have equal access to PPI is challenging, and the ability of patients at different stages of a disease to participate is likely to be variable, though they may have very different perspectives on research priorities.

We conducted this formative evaluation of PPI towards the end of the project, but note that PPI practice adapted throughout in response to PRPs needs and feedback on specific elements, such as annual scientific meetings. More formal, iterative assessment of PRP satisfaction throughout the project lifecycle could have supported this adaptive process [28].

Conclusions and recommendations

There was consensus among PRPs and researchers about the positive impact of PPI on EuroTEAM. These findings suggest that PPI can be usefully incorporated in future projects of this kind, and that barriers and facilitators to the implementation of effective PPI in this context should be identified and addressed. On the basis of these findings, it is possible to make the following recommendations, which we hope will guide future projects:

  • Initiatives to support communication between researchers and patients, such as glossaries and advance lay summaries of research presentations were highly valued and could usefully be incorporated and further developed in future projects.

  • The unusual multidisciplinary structure of EuroTEAM facilitated patient involvement in the project overall. Further research is needed to define the ways in which multi- and interdisciplinary research can enhance PPI.

  • Additional training would have been useful for both researchers and PRPs to support effective PPI and the development of mutually advantageous relationships. For example, identification of opportunities for meaningful PPI, awareness of PRP needs, providing feedback and developing communication skills.

  • It would have been useful to identify specific tasks/areas for development with PRPs at the project planning stage and to consider including such activities as deliverables/milestones where feasible.

  • Regular opportunities for feedback on the impact of PRPs contribution to specific research activities, and on the progress of the project overall, was highly valued, and could also have been specified at the project planning stage.

  • Equality of access to patient representation could have been addressed more effectively, both when planning PRP recruitment and throughout the project; for example by facilitating awareness and access to PPI to all patients, not just those who are active members of patient organisations; providing translation services and support for non-native speakers; and supporting research involvement for individuals with particular literacy or mobility/access needs.

Availability of data and materials

The data collected during the evaluation exercise described in this paper are available from the corresponding author on reasonable request.

Abbreviations

EULAR:

European League Against Rheumatism

EuroTEAM:

EU FP7 funded collaborative project – Towards Early biomarkers in Early Arthritis

H2020:

Horizon 2020 (EU funding stream)

NIHR:

National Institute for Health Research

PARE:

People with Arthritis / Rheumatism in Europe

PPI:

Patient and public involvement

PRP:

Patient research partner

RA:

Rheumatoid arthritis

SMEs:

Small / medium enterprises

WP:

Work package

References

  1. Mockford C, Staniszewska S, Griffiths F, Marx SH. The impact of patient and public involvement on UK NHS health care: a systematic review. Int J Qual Health Care. 2012;24(1):28–38. https://doi.org/10.1093/intqhc/mzr066.

    Article  PubMed  Google Scholar 

  2. INVOLVE website – what is public involvement in research? http://www.invo.org.uk/posttypefaq/what-is-public-involvement-in-research

  3. EU Horizon 2020 Advice for 2018–2020 of the Horizon 2020 Advisory Group for Societal Challenge 1, "Health, Demographic Change and Well-being", https://ec.europa.eu/research/health/pdf/ag_advice_report_2018-2020.pdf (see page 9).

  4. de Wit M, Kirwan JR, Tugwell P, Beaton D, Boers M, PBrooks SC, Conaghan PG, D’Agostino MA, Hofstetter C, Hughes R, Leonge A, Lyddiatt A, March L, May J, Montie P, Richards P, Simon LS, Singh JA, Strand V, Voshaar M, Bingham CO III, Gossec L. Successful Stepwise Development of Patient Research Partnership: 14 Years’ Experience of Actions and Consequences in Outcome Measures in Rheumatology (OMERACT). The Patient – Patient Centered Outcomes Research; 2016), online first. https://doi.org/10.1007/s40271-016-0198-4.

    Book  Google Scholar 

  5. Stewart R, Liabo K. Involvement in research without compromising research quality. J Health Serv Res Policy. 2012;17(4):248–51. https://doi.org/10.1258/jhsrp.2012.011086.

    Article  PubMed  Google Scholar 

  6. Hewlett S, de Wit M, Richards P, Quest E, Hughes R, Heiberg T, Kirwan J. Patients and professionals as research partners: Challenges, practicalities and benefits. Arthritis Care Res. 2006;55(4):676–80. https://doi.org/10.1002/art.22091.

    Article  Google Scholar 

  7. JR Kirwan, MPT de Wit, CO Bingham III, A Leong, P Richards, P Tugwell, M Voshaar, L Gossec, the outcome measures in rheumatology executive committee. Patients as partners: building on the experience of outcome measures in rheumatology. Arthritis Rheum (2016), vol. 68, 6, 1334–1336, doi: https://doi.org/10.1002/art.39678.

    Article  Google Scholar 

  8. Stack RJ, Mallen CD, Deighton C, Kiely P, Shaw KL, Booth A, Kumar K, Thomas S, Rowan I, Horne R, Nightingale P, Herron-Marx S, Jinks C. DELAY Study Syndicate, K Raza. The development and initial validation of a questionnaire to measure help-seeking behaviour in patients with new onset rheumatoid arthritis. Health Expect. 2015;18(6):2340–55. https://doi.org/10.1111/hex.12203.

    Article  PubMed  Google Scholar 

  9. Simons G, Belcher J, Morton C, Kumar K, Falahee M, Mallen CD, Stack RJ, Raza K. Symptom recognition and perceived urgency of help-seeking for rheumatoid arthritis and other diseases in the general public: a mixed method approach. Arthritis Care Res. 2017;69(5):633–41epub ahead of print. https://doi.org/10.1002/acr.22979.

    Article  Google Scholar 

  10. Simons G, Mason A, Falahee M, Kumar K, Mallen CD, Raza K, Stack RJ. Qualitative Exploration of illness perceptions of rheumatoid arthritis in the general public. Musculoskelet Care. 2017;15(1):13–22. https://doi.org/10.1002/msc.1135.

    Article  Google Scholar 

  11. Simons G, Mallen CD, Kumar K, Stack RJ, Raza K. A qualitative investigation of the barriers to help-seeking among members of the public presented with symptoms of new-onset rheumatoid arthritis. J Rheumatol. 2015;42(4):585–92. https://doi.org/10.3899/jrheum.140913.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Stack RJ, Stoffer M, Englbrecht M, Mosor E, Falahee M, Simons G, Smolen J, Schett G, Buckley CD, Kumar K, Hansson M, Hueber A, Stamm T, Raza K. Perceptions of risk and predictive testing held by the first-degree relatives of patients with rheumatoid arthritis in England, Austria and Germany: a qualitative study. BMJ Open. 2016;6(6):e010555. https://doi.org/10.1136/bmjopen-2015-010555.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Bayliss K, Raza K, Simons G, Falahee M, Hansson M, Starling B, Stack R. Perceptions of predictive testing for those at risk of developing a chronic inflammatory disease: a meta-synthesis of qualitative studies. J Risk Res. 2016. https://doi.org/10.1080/13669877.2015.1119183.

    Article  Google Scholar 

  14. Bayliss K, Starling B, Raza K, Johansson EC, Zabalan C, Moore S, Skingle D, Jasinski T, Thomas S, Stack R. Patient involvement in a qualitative meta-synthesis: Lessons learnt. Res Involvement Engagement. 2016;2:18. https://doi.org/10.1186/s40900-016-0032-0.

    Article  Google Scholar 

  15. Shea B, Santesso N, Qualman A, Heiberg T, Leong A, Judd M, Robinson V, Well G, Tugwell P, the Cochrane Musculoskeletal Consumer Group. Consumer-driven health care: building partnerships in research. Health Expecations. 2005;8(4):352–9. https://doi.org/10.1111/j.1369-7625.2005.00347.x.

    Article  Google Scholar 

  16. Tiwana R, Rowland J, Fincher M, Raza K, Stack RJ. Social interaction at the onset of rheumatoid arthritis and their influence on help-seeking behaviour: A qualitative exploration. Health Psychol. 2015;20(3):648–61. https://doi.org/10.1111/bjhp.12134.

    Article  Google Scholar 

  17. de Wit MPT, Koelewijn-van Loon MS, Collins S, Abma TA, Kirwan J. “If I Wasn’t This Robust”: Patients’ expectations and experiences at the outcome measures in rheumatology conference 2010. The Patient. 2013;6(3):179–87. https://doi.org/10.1007/s40271-013-0017-0.

    Article  PubMed  Google Scholar 

  18. Gerlag D, Raza K, van Baarsen LGM, Brouwer E, Buckley CD, Burmester GR, Gabay C, Catrina AI, Cope AP, Cornelis F, Rantapää Dahlqvist S, Emery P, Eyre S, Finckh A, Gay S, Hazes JM, van der Helm-van Mil A, Huizinga TWJ, Klareskog L, Kvien TK, Lewis C, Machold KP, Rönnelid J, van Schaardenburg D, Schett G, Smolen JS, Thomas S, Worthington J, Tak PP. EULAR recommendations for terminology and research in individuals at risk of rheumatoid arthritis: report from the Study Group for Risk Factors for Rheumatoid Arthritis. Ann Rheum Dis. 2012;71(5):638–41. https://doi.org/10.1136/annrheumdis-2011-200990.

    Article  PubMed  Google Scholar 

  19. de Wit MPT, Berlo SE, Aanerud GJ, Aletaha D, Bijlsma JW, Croucher L, Da Silva JAP, Glüsing B, Hewlett S, Jongkees M, Magnusson D, Scholte-Voshaar M, Richards P, Ziegler C, Abma TA. European league against rheumatism recommendations for the inclusion of patient representatives in scientific projects. Ann Rheum Dis. 2011;70:722–6. https://doi.org/10.1136/ard.2010.135129.

    Article  PubMed  Google Scholar 

  20. Kirwan JR, Minnock P, Adebajo A, Bresnihan B, Choy E, de Wit M, Hazes M, Richards P, Saag K, Suarez-Almazor M, Wells G, Hewlett S. Patient perspective: fatigue as a recommended patient centered outcome measure in rheumatoid arthritis. J Rheumatol. 2007;34(5):1174–7.

    PubMed  Google Scholar 

  21. Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, Brito JP, Boehmer K, Hasan R, Firwana B, Erwin P, Eton D, Sloan J, Asi N, Dabrh AMA, Murad MH. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14:89. https://doi.org/10.1186/1472-6963-14-89.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Bagley HJ, Short H, Harman NL, Hickey HR, Gamble CL, Woolfall K, Young B, Williamson PR. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials – a work in progress. Res Involvement Engagement. 2016;2:15. https://doi.org/10.1186/s40900-016-0029-8.

    Article  Google Scholar 

  23. Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, Suleman R. A Systematic Review of the Impact of Patient and Public Involvement on Service Users, Researchers and Communities. Patient. 2014;7(4):387–95. https://doi.org/10.1007/s40271-014-0065-0.

    Article  PubMed  Google Scholar 

  24. Buck D, Gamble C, Dudley L, Preston J, Hanley B, Williamson PR, Young B. The EPIC Patient Advisory Group From plans to actions in patient and public involvement: qualitative study of documented plans and the accounts of researchers and patients sampled from a cohort of clinical trials. BMJ Open. 2014;4(12):e006400 epub ahead of print. https://doi.org/10.1136/bmjopen-2014-006400.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement a narrative review. BMJ Qual Saf. 2016;25(8):626–32. https://doi.org/10.1136/bmjqs-2015-004839.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Dobbs T, Whitaker I. Patient and public involvement in basic science research – are we doing enough? The BMJ opinion (blog), 11; 2016.

    Google Scholar 

  27. Callard F, Rose D, Wykes T. Close to the bench as well as the bedside: involving service users in all phases of translational research. Health Expect. 2012;15(4):389–400. https://doi.org/10.1111/j.1369-7625.2011.00681.x Epub 2011 May 25.

    Article  PubMed  Google Scholar 

  28. Pollock J, Raza K, Pratt AG, Hanson H, Siebert S, Filer A, Isaacs JD, Buckley CD, McInnes IB, Falahee M. Patient and researcher perspectives on facilitating patient and public involvement in rheumatology research. Musculoskelet Care. 2016), online first. https://doi.org/10.1002/msc.1171.

    Article  PubMed  PubMed Central  Google Scholar 

  29. McCarthy J, Guerin S, Wilson AG, Dorris E, Salsberg J. Facilitating public and patient involvement in basic and preclinical health research. PLoS One. 2019;14(5):e0216600. https://doi.org/10.1371/journal.pone.0216600.

    Article  CAS  Google Scholar 

  30. Baart I, Abma T. Patient participation in fundamental psychiatric genomics research: a Dutch case study. Health Expect. 2011;14(3):240–9. https://doi.org/10.1111/j.1369-7625.2010.00634.x.

    Article  PubMed  Google Scholar 

  31. Staley K. “Is it worth doing?” measuring the impact of patient and public involvement in research. Res Involvement & Engagement. 2015;1:6. https://doi.org/10.1186/s40900-015-0008-5.

    Article  Google Scholar 

  32. Smolen JS, Landewé R, Bijlsma J, Burmester G, Chatzidionysiou K, Dougados M, Nam J, Ramiro S, Voshaar M, van Vollenhoven R, Aletaha D, Aringer M, Boers M, Buckley CD, Buttgereit F, Bykerk V, Cardiel M, Combe B, Cutolo M, van Eijk-Hustings Y, Emery P, Al Finckh CG, Gomez-Reino J, Gossec L, Gottenberg JE, Hazes JMW, Huizinga T, Jani M, Karateev D, Kouloumas M, Kvien T, Li Z, Mariette X, McInnes I, Mysler E, Nash P, Pavelka K, Poór G, Richez C, van Riel P, Rubbert-Roth A, Saag K, Silva J, Stamm T, Takeuchi T, Westhovens R, de Wit M, van der Heijde D. EULAR recommendations for the management of rheumatoid arthritis: with synthetic and biological disease-modifying antirheumatic drugs: 2016 update Annals of the Rheumatic Diseases; 2017), online first. https://doi.org/10.1136/annrheumdis-2016-210715.

    Book  Google Scholar 

  33. Ytterberg AJ, Joshua V, Reynisdottir G, Tarasova NK, Rutishauser D, Ossipova E, Hensvold AH, Eklund A, Sköld CM, Grunewald J, Malmström V, Jakobsson PJ, Rönnelid J, Padyukov L, Zubarev RA, Klareskog L, Catrina AI. Shared immunological targets in the lungs and joints of patients with rheumatoid arthritis: identification and validation. Ann Rheum Dis. 2015;74:1772–7. https://doi.org/10.1136/annrheumdis-2013-204912.

    Article  CAS  PubMed  Google Scholar 

  34. Juarez M, Bang H, Hammar F, Reimer U, Dyke B, Sahbudin I, Buckley CD, Fisher B, Filer A, Raza K. Identification of novel anti-acetylated vimentin antibodies in patients with early inflammatory arthritis. Ann Rheum Dis. 2016 Jun;75(6):1099–107. https://doi.org/10.1136/annrheumdis-2014-206785.

    Article  CAS  PubMed  Google Scholar 

  35. Maijer KI, Ri Noort A, de Hair MJH, van der Leij C, van Zoest KPM, Choi IY, Gerlag DM, Maas M, Tak PP, Tas SW. Nuclear Factor-κB–inducing Kinase Is Expressed in Synovial Endothelial Cells in Patients with Early Arthritis and Correlates with Markers of Inflammation: A Prospective Cohort Study. J Rheumatol. 2015;42(9):1573–81. https://doi.org/10.3899/jrheum.150245.

    Article  CAS  PubMed  Google Scholar 

  36. Catrina AI, Svensson CI, Malmström V, Schett G, Klareskog L. Mechanisms leading from systemic autoimmunity to joint-specific disease in rheumatoid arthritis. Nat Rev Rheumatol. 2017;13:79–86. https://doi.org/10.1038/nrrheum.2016.200.

    Article  CAS  PubMed  Google Scholar 

  37. Ospelt C, Bang H, Feist E, Camici G, Keller S, Detert J, Kramer A, Gay S, Ghannam K, Burmester GR. Carbamylation of vimentin is inducible by smoking and represents an independent autoantigen in rheumatoid arthritis. Ann Rheum Dis. 2017;76:1176–83. https://doi.org/10.1136/annrheumdis-2016-210059.

    Article  CAS  PubMed  Google Scholar 

  38. Rech J, Hueber AJ, Finzel S, Englbrecht M, Haschka J, Manger B, Kleyer A, Reiser M, Cobra JF, Figueiredo C, Tony HP, Kleinert S, Wendler J, Schuch F, Ronneberger M, Feuchtenberger M, Fleck M, Manger K, Ochs W, Schmitt-Haendle M, Lorenz HM, Nuesslein H, Alten R, Henes J, Krueger K, Schett G. Prediction of disease relapses by multibiomarker disease activity and autoantibody status in patients with rheumatoid arthritis on tapering DMARD treatment. Ann Rheum Dis. 2016;75:1637–44. https://doi.org/10.1136/annrheumdis-2015-207900.

    Article  CAS  PubMed  Google Scholar 

  39. Krishnamurthy A, Joshua V, Haj Hensvold A, Jin T, Sun M, Vivar N, Ytterberg AJ, Engström M, Fernandes-Cerqueira C, Amara K, Magnusson M, Wigerblad G, Kato J, Jiménez-Andrade JM, Tyson K, Rapecki S, Lundberg K, Catrina SB, Jakobsson PJ, Svensson C, Malmström V, Klareskog L, Wähämaa H, Catrina AI. Identification of a novel chemokine-dependent molecular mechanism underlying rheumatoid arthritis-associated autoantibody-mediated bone loss. Ann Rheum Dis. 2016;75:721–9. https://doi.org/10.1136/annrheumdis-2015-208093.

    Article  CAS  PubMed  Google Scholar 

  40. Bayliss K, Raza K, Simons G, Falahee M, Hansson M, Starling B, Stack R. Perceptions of predictive testing for those at risk of developing a chronic inflammatory disease: a meta-synthesis of qualitative studies. J Risk Res. 2018;21(2):167–89. https://doi.org/10.1080/13669877.2015.1119183.

    Article  Google Scholar 

  41. Falahee M, Simons G, Raza K, Stack R. Healthcare professionals’ perceptions of risk in the context of genetic testing for the prediction of chronic disease: a qualitative meta-synthesis. J Risk Res. 2018;21(2):129–66. https://doi.org/10.1080/13669877.2016.1153503.

    Article  Google Scholar 

  42. Stack RJ, Stoffer M, Englbrecht M, Mosor E, Falahee M, Simons G, Smolen J, Schett G, Buckley CD, Kumar K, Hansson M, Hueber A, Stamm T, Raza K. Perceptions of risk and predictive testing held by the first-degree relatives of patients with rheumatoid arthritis in England. Austria and Germany: a qualitative study BMJ Open. 2016;6:e010555. https://doi.org/10.1136/bmjopen-2015-010555.

    Article  PubMed  Google Scholar 

  43. Falahee M, Simons G, Buckley CD, Hansson M, Stack RJ, Raza K. Patients’ perceptions of their relatives’ risk of developing rheumatoid arthritis and of the potential for risk communication, prediction and modulation. Arthritis Care Res. 2017;69(10):1558–65. https://doi.org/10.1002/acr.23179.

    Article  Google Scholar 

  44. Mosor E, Stoffer-Marx M, Steiner G, Raza K, Stack R, Simons G, Falahee M, Skingle D, Dobrin M, Schett G, Englbrecht M, Smolen J, Kjeken I, Hueber A, Stamm T. I would never take preventive medication! Perspectives and information needs of people who underwent predictive tests for rheumatoid arthritis. Arthritis Care Res. 2019, epub ahead of print 2 Feb 2019. https://doi.org/10.1002/acr.23841.

  45. van Steenburgen HW, Aletaha D, Beaart-van der Voorde LJJ, El B, Codreanu C, Combe B, Fonseca JE, Hetland ML, Humby F, Kvien TK, Niedermann K, Nuño L, Oliver S, Rantapää-Dahlqvist S, Raza K, van Schaardenburg D, Schett G, De Smet L, Szücs G, Vencovský J, Wiland P, de Wit M, Landewé RL, van der Helm-van Mil AHM. EULAR definition of arthralgia suspicious for progression to rheumatoid arthritis. Ann Rheum Dis. 2017;76(3):491–6. https://doi.org/10.1136/annrheumdis-2016-209846.

    Article  Google Scholar 

  46. Falahee M, Simons G, Buckley CD, Hansson M, Stack RJ. Patients’ perceptions of their relatives' risk of developing rheumatoid arthritis and of the potential for risk communication, prediction and modulation. Arthritis Care Res. 2016) online first. https://doi.org/10.1002/acr.23179.

    Article  Google Scholar 

  47. EULAR PARE (People with Arthritis / Rheumatism in Europe) booklet – Patient Involvement in Research: A way to success https://www.eular.org/myUploadData/files/Reference_cards_explained_Booklet_pages_23-08-13_1.pdf

  48. Mathie E, Wythe H, Munday D, Millac P, Rhodes G, Roberts N, Smeeton N, Poland F, Jones J. Reciprocal relationships and the importance of feedback in patient and public involvement: a mixed methods study. Health Expect. 2018;21:899–908. https://doi.org/10.1111/hex.12684.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Staley K. Changing what researchers 'think and do': Is this how involvement impacts on research? Res For All. 2017;1(1):158–67. https://doi.org/10.18546/RFA.01.1.13.

    Article  Google Scholar 

  50. Martin GP. ‘Ordinary people only’: knowledge, representativeness, and the publics of public participation in healthcare. Soc Health Illness. 2008;30:35–54. https://doi.org/10.1111/j.1467-9566.2007.01027.x.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all of the EuroTEAM patient research partners (Mircia Dobrin, Marie Fincher, Tiina Jasinski, Eva C. Johansson, Hayley Rose, Diana Skingle, Susan Thomas, Daniela Winkels, and Codruta Zabalan) and the University of Birmingham Rheumatology Research Patient Partnership: www.birmingham.ac.uk/r2p2

Funding

The research leading to these results was funded within the FP7 HEALTH programme under the grant agreement FP7-HEALTH-F2–2012-305549 (EuroTEAM).

CDB & KR receive support from the NIHR Birmingham Biomedical Research Centre and the Research into Inflammatory Arthritis Centre Versus Arthritis: grant number 20298.

CM was an NIHR funded academic clinical lecturer.

This paper presents independent research supported by the NIHR Birmingham Biomedical Research Centre based at the University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health.

Author information

Authors and Affiliations

  1. Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, B15 2TT, UK

    Rebecca Birch, Gwenda Simons, Catherine M. McGrath, Christopher D. Buckley, Karim Raza & Marie Falahee

  2. Rheumatology Unit, Department of Medicine, Karolinska University Hospital and Karolinska Institutet, SE-171 76, Stockholm, Sweden

    Heidi Wähämaa

  3. Department of Rheumatology, Sandwell and West Birmingham Hospitals NHS Trust, B18 7QH, Birmingham, UK

    Catherine M. McGrath, Christopher D. Buckley & Karim Raza

  4. EuroTEAM Patient Research Partners, Stockholm, Sweden

    Eva C. Johansson & Diana Skingle

  5. EuroTEAM Patient Research Partners, London, UK

    Eva C. Johansson & Diana Skingle

  6. Public Programmes Team, Central Manchester University Hospitals NHS Foundation Trust, University of Manchester, Manchester Academic Health Science Centre, Manchester, UK

    Kerin Bayliss & Bella Starling

  7. Department of Clinical Immunology and Rheumatology, Amsterdam Rheumatology and Immunology Centre, Academic Medical Centre/University of Amsterdam, Amsterdam, Netherlands

    Danielle M. Gerlag

  8. RxCelerate Ltd, Babraham Research Campus, Cambridge, CB22 3AT, UK

    Danielle M. Gerlag

  9. Kennedy Institute of Rheumatology, University of Oxford, Headington, Oxford, OX3 7FY, UK

    Christopher D. Buckley

  10. National Institute for Health Research (NIHR) Birmingham Biomedical Research Centre, Birmingham, UK

    Christopher D. Buckley & Karim Raza

  11. Division of Psychology, School of Social Sciences, Nottingham Trent University, Nottingham, NG1 4BU, UK

    Rebecca J. Stack

Authors
  1. Rebecca Birch
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Gwenda Simons
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heidi Wähämaa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Catherine M. McGrath
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Eva C. Johansson
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Diana Skingle
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kerin Bayliss
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Bella Starling
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Danielle M. Gerlag
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Christopher D. Buckley
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Rebecca J. Stack
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Karim Raza
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Marie Falahee
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CB and KR were Principal Investigators for EuroTEAM, incorporating patient and public involvement (PPI) from the outset. RS, BS and KB supported the development of PPI in EuroTEAM and RB was project manager and PPI coordinator. MF, GS, KR, DS and EJ developed the evaluation exercise. All authors contributed to the interpretation of the findings of the evaluation and to the writing of this manuscript, which was led by RB and MF. All authors approved the final version of this manuscript.

Corresponding author

Correspondence to Marie Falahee.

Ethics declarations

Ethics approval and consent to participate

This paper reports the development and evaluation of a patient advisory group. Patient research partners acted as specialist advisors, and were involved in the planning and conduct of this research and in the development of this manuscript as authors. All participants in the EuroTEAM project were provided with information about the purpose of this evaluation exercise, and both patient partners and researchers contributed to the development of the survey reported here. Completion and return of the survey was voluntary for both EuroTEAM researchers and patient research partners. Formal ethical approval is therefore not needed for research of this kind, in line with National Institute for Health Research (NIHR) INVOLVE policy.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Survey for patient research partners (PRPs).

Additional file 2.

Survey for researchers.

Additional file 3.

GRIPP 2.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Birch, R., Simons, G., Wähämaa, H. et al. Development and formative evaluation of patient research partner involvement in a multi-disciplinary European translational research project. Res Involv Engagem 6, 6 (2020). https://doi.org/10.1186/s40900-020-0178-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40900-020-0178-7

Keywords

Research Involvement and Engagement

ISSN: 2056-7529

Contact us