Keeping it credible in cohort multiple Randomised Controlled Trials: the Community Ageing Research 75+ (CARE 75+) study model of patient and public involvement and engagement
© The Author(s). 2016
Received: 5 December 2015
Accepted: 23 August 2016
Published: 30 August 2016
Plain English summary
There are well documented benefits to involving patients and the public in research. However, there is little research published about their involvement in large complex studies such as cohort multiple Randomised Controlled Trials (cmRCTs). The cmRCT method establishes a group of participants, with a common characteristic (e.g. older people) who will be followed over a number of years. Other (sub) studies can also recruit from this pool of people. This method offers researchers many advantages, including being able to recruit from more hard to reach groups. However, cmRCTs also have features which can make it more complicated to involve patients and the public. For example more than one study may take place at the same time; studies may be spread out over a large geographical area and they may include a wide range of topics. In spite of these difficulties we have developed a way of working with patients, the public and researchers that provides stability over time but allows flexibility along the way. Our model of working has saved us time and money; helped us to recruit more widely, and enabled us to focus our research in areas that are important to older people with frailty.
There is increasing guidance on how to make the most of the rich seam of data provided by large cohort studies, and growing recognition of the benefits of cohort multiple Randomised Controlled Trials (cmRCT) in health research. In contrast, there is a lack of discussion about patient and public involvement and engagement (PPIE) in these large and complex research infrastructures. Our aim was to create a structure to enable meaningful, sustainable public involvement within the cmRCT framework. We have established a core reference group of four key individuals with extensive links to other relevant local community structures and individuals.
Using the CARE 75+ model we have engaged with a wide variety of patients and the public in a relatively short space of time. Activities have included scrutiny of protocols and assessment tools, and process evaluations; resulting in system efficiencies, increased recruitment and a more focused research agenda.
There is a need for strong public oversight and flexible models of PPIE in cmRCTs. The model of PPIE developed in the Community Ageing Research 75+ study presents one potential way to foster expertise and enable diversity.
KeywordscmRCT Public Involvement Engagement Participation
This paper is based on the experience of running the Community Ageing Research 75+ (CARE 75+) study (ISRCTN16588124). This study is part of a programme of studies investigating the Primary Care Based Management of Frailty in Older People as part of the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care (NIHR CLAHRC) in Yorkshire and the Humber .
the CLAHRC Frailty theme
development of the cmRCT methodology, and
the unique proposition that cmRCTs present for public engagement.
Frailty is a condition characterised by loss of biological reserve and vulnerability to adverse outcomes . The current health and social care response to frailty is largely reactive to acute crises and is predominantly located in secondary care. We have established the Primary care-based management of frailty theme as part of the NIHR CLAHRC programme . The aim of this work is to enable a new approach to frailty that is proactive and preventative, predominantly located in primary and community care.
A key component of our NIHR CLAHRC programme of work has been the Community Ageing Research CARE 75+ study. We have recruited a cohort of older people across the frailty spectrum to investigate frailty transitions and evaluate frailty interventions using a novel cmRCT design . Following recruitment and baseline assessment, participants are followed up at 6, 12, 24 and 48 months. A range of health, social and economic data is collected along with demographic information, and information about social networks. In addition, blood samples are collected for storage in a bio-bank for use in future studies.
Alongside the observational study, the cohort is being used as a recruitment platform for qualitative and quantitative studies. It is intended that once numbers increase in the cohort, it will provide a platform for definitive randomised controlled trials. Initially, intervention studies will be restricted to feasibility testing and pilot randomised controlled trials. A range of possible interventions exist – to date there has been interest from researchers working in the areas of dermatology, diet and nutrition, community infection, social networks and pain.
Cohort multiple Randomised Control Trials (cmRCT)
The cmRCT method is based on establishing a longitudinal observational cohort from which other (sub) studies can recruit. The original cohort is used as a ‘patient identification site’ (PIC). CmRCTs are best suited to acute clinical conditions and chronic conditions - for which many different types of interventions may be trialled concurrently. They are also beneficial for conditions for which previous trials have struggled with recruitment .
Two key features of the cmRCT are ‘active recruitment’ and ‘embedded controls’. Using a model of ‘real world’ or ‘patient centred’ information’ – only those actively participating in a sub-study receive patient information. Cohort participants who are not recruited to the intervention arm of a sub-study will have their background observational data used for control purposes (consent for this is sought at the time of original recruitment to the cohort) . In this way, cmRCTs facilitate the inclusion of cognitively impaired participants, and other hard to reach groups, who, as controls, are not required to review new study information.
Although, the inclusion of those with cognitive impairment at the outset is still prescribed by the study design i.e. dependent on the advice of a consultee and not by an adapted trial design, the potential for an individual to be included if they develop cognitive impairment during the lifetime of the study is greater as they will have had an opportunity to make the decision in advance.
In addition, multiple interventions can be trialled concurrently in one cohort. CmRCTs can facilitate meta-analysis using standardised outcome measures across studies - assuming there is an agreed minimum dataset; maximising resources and minimising participant burden.
Historically, clinical trials of interventions for older people are characterised by low recruitment rates for a number of reasons, such as exclusion criteria – in particular cognitive impairment , patient preferences, and ethical dilemmas . This has resulted in a limited evidence base for treatments and services for older people. It is therefore expected that using a cmRCT method will improve research in populations of older people and the evidence based outcomes.
Despite the potential of this increasingly popular methodology there is an absence of guidance about how PPIE activity fits with this study design. The Medical Research Council (MRC) guidelines on maximising the value of large cohorts notes ‘stakeholder’ engagement but does not discuss the potential role of the public especially with regard to increasing retention and recruitment .. Furthermore, a review of birth cohorts suggest that public engagement (PE) should be ‘strengthened’ , but offers little indication of how this could be practicably achieved.
The need for engagement
The arguments for public involvement in cohort studies are the same as those given for involvement in any health service research. There are moral, political, economic and pragmatic reasons for involving the public and patients in all aspects of research from design to dissemination [7, 8].
The national and international importance of involving ‘consumers’ in service design and research has long been recognised . Organisations such as INVOLVE testify to the government’s commitment to public and service user engagement in the research process in the UK . Moreover, most major UK health research funders such as NIHR and MRC advocate public involvement in research or expect valid reasons as to why it has not been included in applications [11, 12].
Most systematic reviews of PPIE conclude that attempts to conceptualise, evaluate and report outcomes are still in their infancy [11, 13]. Nevertheless, there are already many descriptive reports of the benefit of PPIE from individual studies [12, 14, 15].
Additional considerations for cmRCTs
Over the past 10 years there has been a development of strong values and principles which should underpin PPIE work [16, 17] alongside toolkits which support the practical application of these [18, 19]. Alongside these there is agreement that PPIE cannot be prescriptive and flexibility is needed to ensure the activity is meaningful, appropriate and impactful within any given context. There are numerous examples of good practice from individual studies. However, there is little in the way of guidance about which paradigms might best support specific study types [6, 20]. Whilst briefing notes for researchers present potential benefits and challenges to PPIE in different clinical trial scenarios they do not suggest any specific mechanisms which would work best in these scenarios .
We believe there are additional considerations which should influence the structure of PPIE in cohorts used as a platform for multiple studies.
Firstly, it is imperative that there is monitoring and scrutiny of the original aims and objectives of the observational study for which the cohort was developed. For example, when new studies wish to utilise the cohort they may require additional outcome measures or propose duplicating/modifying some existing measures. All changes need to be reviewed carefully and objectively to avoid any unnecessary additional burden on the participants.
Secondly, the recruitment and retention of lay representatives needs to be considered. In longitudinal observational cohort studies, perhaps more than in shorter studies, public representation may be better served by community organisations than by individuals.
Thirdly, as with all cohort populations, older people with frailty are not a homogenous group – there is huge diversity both within and across geographic regions. What is relevant to an older person in Bradford may have little relevance to an older person in Bath. This becomes increasingly important in multi-site studies where recruitment and retention rates can vary enormously  and be adversely affected by local context [23, 24] But, whilst there is an acknowledgement that international trials need to consider local context this is normally viewed through the lens of research staff and not patients or the wider public . In addition, reported reasons for differential recruitment across sites include external publicity and conflict with other trials , both of which are pertinent in cmRCTs.
Finally, the potential range of topics for sub-studies is vast. Therefore, it is unreasonable to expect the original lay representatives to have either the time or breadth of interest to be involved in the detail of all studies. Sub-studies require their own engagement structures to focus on specific topics, but these need to be linked and co-ordinated in order to reduce duplication and/or contradiction.
The CARE 75+ cohort involvement model
Within the CLAHRC frailty theme, we were challenged to create a structure to enable meaningful, public involvement within the cmRCT framework. We needed a structure that had the potential to connect us to the whole spectrum of older people with frailty across a range of cohort sub-studies in the future. What we have established is a core reference group of four key individuals with extensive links to other relevant local community structures. Within the Frailty Oversight Group (FOG) we have lay representation from the Bradford Older People’s Partnership , the Bradford Self-Care and Prevention Forum and a general practice Patient Participation Group along with a BME advocate from the local authority . This core group undertakes a monitoring and scrutiny role for the original observational study alongside providing oversight for the wider programme of work utilising the cohort within the frailty theme. And, provide signposting to researchers and advocacy for participants.
Core organisational members provide stability over time which means the structure is not reliant on individuals. At a secondary level core group members will have links to specialist condition/disease groups provides patient expertise and experience. Finally, at the widest community level, local ad hoc groups and individuals, engaged via the networks provided by the core group members, maintain diversity and can be engaged for one-off consultation activity. However, the various levels are not hierarchical and any of them can be used for consultation, collaboration or co-production interchangeably, as appropriate.
It is important that flexibility is retained and any members of the core group who are interested in sub-studies can be more or less involved as they wish. In encouraging sub-studies to regularly report back to the core group, those members can consider how sub-study decisions might impact the wider programme of work, for example in the methods and timing of recruitment. Sub-study groups may also provide a natural recruitment resource for the core group in future, and those leaving the core group can remain within the structure at a more informal level i.e. level 3 as and when they are interested and able.
Whilst it is important that sub-studies undertake their own, bespoke, PPIE activity, clear branding of the sub-studies will maintain an association with the original cohort. This will improve external publicity – benefiting from PPIE work that has already taken place, and reduce conflict with other trials by fostering a culture of collective responsibility across the studies. In maintaining the brand all PPIE activity will have reach beyond its original aim.
The model we have adopted embodies the values and principles of good PPIE in the following ways: The core FOG members meet independent of the Frailty Theme Operational Board. This is to ensure that the focus of the meetings remains with the lay members. The project manager chairs the meetings. This role has been offered to members who so far have declined, but the intention is to offer the role in the future. The PI for the CARE75+ study is always required to attend and all other researchers attend as and when necessary. Researchers advocating all new proposals for use of the cohort are required to attend. Outcomes from the FOG are fed into other arenas such as the overall Frailty Theme Operational Group and study co-ordination meetings.
The core FOG members meet quarterly, although PPIE activity also takes place in the interim, and all discussions are fully documented for reference. Any issues impacting beyond the scope of the group are forwarded to the relevant organisations or groups such as the Integrated Care Board. All actions taken as a result of the FOG are documented in the meeting minutes and followed up. Reasons for in-action are noted. The FOG members have clear terms of reference for the scope of their work. They are also linked to complimentary structures such as the AHSN, Improvement Academy.
Core members are financially reimbursed at a rate of £10 per hour for any time spent engaged in project work e.g. meetings, training, observations and background reading. This is in addition to out of pocket expenses to pay for parking or transport. Lay members have received training in observational methods and briefings in event facilitation and presentations before carrying out the tasks. One of the first requests from lay members was a research language ‘jargon buster’.
Researchers from all sub-studies are required to regularly update the core members of the FOG and make representations if necessary. The fluidity of the FOG model is such that it can accommodate the views of individuals or groups allowing for more diverse representation in the main cohort study and sub-studies.
Work undertaken by the Frailty Oversight Group
We have been developing the FOG model for the past 18 months and already there are a number of significant outcomes which evidence the added value of this approach across the whole of the research cycle. In total, over 100 individuals have helped to shape our work.
Identifying and prioritising areas of research
During the first study wide ‘Celebration Event’ of the CARE75+ study, 70 participants were asked to prioritise a number of areas of interest to researchers including; pain, loneliness, infection and skin health. The core FOG members were briefed to facilitate this exercise and helped to identify loneliness and pain as important topics to take forward within the cohort. In the following months two grant applications were developed and submitted on those topics.
The FOG had quite an impact on my thinking – particularly their obvious lack of enthusiasm for my work (in the nicest possible way). It’s made me think even more about how I can convince funders that this work is worthwhile – and the need for it to have tangible impact/patient benefit. It’s obvious really – but very powerful when it comes directly from ‘real’ people (Researcher).
“I kept talking I did elaborate. I think they’re going to meet this anyway. A lot of people need to talk. They were very good. They had very good listening skills. Offered to stop to have a cup of tea” (test participant 1).
“It was very clear. They were extremely polite. They were concerned about my welfare and that everything was alright with me. The opportunity to come back is a good option.” (test participant 2).
Core members also sourced other individuals with experience of chronic pain to test the proposed data collection tool for the pain study. This was a well-established tool which has been used for a pan-European study of pain. However, within our test-bed of frail older people we found that some of the pain descriptors were not well understood and needed adjustment.
One of the sub-studies used the core members to signpost researchers to groups primarily concerned with supporting older people in the community e.g. British Legion. In this way they were able to develop their own specialist engagement group for the shorter duration of the sub-study.
Development of grant proposals
Because of the close links the FOG has with related areas of work within the research unit, one member was seconded to be a co-applicant on a Health Technology Assessment bid addressing extended rehabilitation. As exercise and mobility was one of the top three priorities identified at the Celebration Event this as considered an important programme with which to link.
Very early on the lay members identified that researchers should be mindful of not increasing social isolation when withdrawing from assessments. Because of their extensive local networks they were able to suggest organisations that would ensure continuity for the participants and give them an opportunity to start building networks if they wished. These were then added to the existing signposting resource that is made available to the participants.
One of the on-going agenda items for the FOG is how to keep in touch with participants between assessments, which are at 6 and then 12 month intervals. The importance of this contact was highlighted during the observations. To date the group have held one ‘Celebration Event’ and are in the process of planning a second. They have also reviewed and contributed quarterly newsletters.
Another area of interest which the FOG would like to be considered is the issue of ‘drop out’. Core members feel it is important to understand why participants would not wish to continue in the study in order to improve retention rates. This is an area for consideration in the future. However, our data suggests that the study has experienced relatively low attrition rates (6.84 %) compared to community based trials including older people .
Local networks and other district wide work with older people enabled FOG members to signpost the research team to a research active GP which resulted in increased Black, Minority Ethnic (BME) participation to 14 %, in line with the local population.
In assuring good governance of the study the FOG members also raised the question of how much support the researchers need/receive when they are faced with participants who may have mental health problems such as depression or dementia or seemingly be very frail and vulnerable. This made the research team consider if the support structures in place for staff were adequate.
Core FOG members have been instrumental in the on-going process evaluation through structured observations of the consent and assessment process. These observations have ensured that the participants’ best interests remain paramount but have also highlighted considerations for the analysis and interpretation of data. For example, the self-report of smoking habits in one case were at odds with the lay members’ observation of the environment. Other points to consider going forward included keeping in touch between assessments, the brief time participants spend reading postal information and appreciating the level of participant nerves at the first encounter.
Analysis and interpretation
There have been many discussions about the interpretation of language and concepts at the FOG quarterly meetings. For example, it was noted that the word ‘chronological’ was probably not widely understood and this was removed from a lay summary. In addition, the phrase ‘off legs’ to describe reduced mobility was also not well understood by lay members and was abandoned. However, whilst these individual discussions are useful the real value of the FOG structure lies in sharing them across all of the sub- studies.
Having a multi-layered approach to PPIE has meant that all of the sub- studies have benefitted from shared insight at an early stage. For example, it quickly became apparent from one sub-study that it was not appropriate or meaningful to use the term ‘carer’ for those people providing informal support in the community. This was taken on board by a subsequent study which identified those who provided support as ‘friends, family or neighbours’.
Where issues have been raised in sub-studies researchers have reported these to the core FOG members and they in turn have been able to add another perspective or ratify the original discussion. For example, core members agreed with the sub-study assertion that religious groups should be considered important community support groups. But, the core group did not agree that the sub-study looking at resourcefulness in older people should only focus on non-home owners as a lower income group as there were expenses that could be incurred as a home owner that would put older individuals in a similar financial position to those on low incomes.
In addition to their contribution to routine dissemination activities such as the quarterly newsletters and review of the CLAHRC website, FOG members have also co-presented a workshop at one national conference.
However, one of their central roles is in raising awareness of the CARE75+ within the local area through their personal networks. Following an introduction to the Bradford Older People’s forum, researchers from the CARE75+ were able to address a wider audience and elicit views on the shape and scope of the research. This discussion highlighted a potential area of diversity which had been overlooked i.e. inclusion of the long-established Ukranian community in Bradford. In addition, researchers have been invited to present the research at the Bradford Self-Care and Prevention Programme.
Building a model of involvement across time, geographical space and communities of interest has a number of challenges, not least the human resource required to set-up and co-ordinate effective networks at each site. This challenge is not unique to cmRCTs but to any complex studies or large programmes of multi-layered research such as those funded by the CLAHRC or in international trials.
Whilst involvement may have found a place on the agenda in theory, there is still evidence to suggest that researchers will take the path of least resistance and fail to engage patients and the public in a meaningful way, preferring to use what is already in existence in a tokenistic manner [7, 13, 20, 30] rather than build something bespoke. And, although there has been an increase in the amount of resources available to guide researchers in terms of toolkits, values and principles some still struggle to effectively utilise these due to lack of time, resource or confidence in their approach.
We have not found any reference to PPIE models for specific study designs but believe that in the case of cmRCTs and other complex designs a general paradigm is useful in meeting the longitudinal objectives and making the best use of time and resources.
At a time when there is call for the impact of PPIE to be contextualised to provide a more strategic approach , practices are not well described in the context of cohort studies. The most extensive review of engagement in cohort studies, which included only birth cohorts describes most engagement activity at the level of information dissemination . Other cohorts offering a facility for ‘trials within cohorts’, such as the South Yorkshire Health Study have only the briefest reference to public engagement on their website  and it was confirmed by personal correspondence that this is not an area currently being developed. Other well established ageing cohorts also have no obvious reference to public involvement in their publications or on their websites [33, 34].
Using the FOG model we have been able to involve a significant number of individuals from our target population, i.e. older people aged over 75, across a large spectrum of research activity, in a relatively short space of time. We have both enabled diversity through reaching out via networks into ‘research naive’ communities and encouraged lasting expertise, by skilling up a small core group of collaborators. Because of the inter-connected structure of the FOG, we have been able to strengthen PPIE activity by cross-referencing ideas between the core group, sub-groups and individuals. We have also been able to effectively share the outcomes amongst all researchers working within the Frailty Theme.
Future challenges for the CARE 75+ study oversight are: to establish a network in each of the study sites; to encourage researchers to go beyond the core oversight group, to explore more diverse engagement opportunities and to co-ordinate the work of the local networks to share learning effectively.
Recommendations for PPIE in CmRCTs
Choose core group members from established voluntary and community groups which can provide continuity over time
Ensure all sub-studies protocols are presented to the core group in the initial stages
Brand sub-studies to ensure they are identified as originating from the cohort
Use the core group to signpost sub-studies to further engagement opportunities with groups and individuals
Ensure sub-studies to feedback and share learning quickly
Establish links with other sites with similar remits
Academic Health Science Network
Black Minority Ethnic
Collaboration for Leadership in Applied Health Research and Care
Cohort multiple Randomised Controlled Trial
Frailty Oversight Group
Medical Research Council
Patient Identification Site
Patient and public involvement and engagement
The authors would like to thank all those who have been involved in the wider FOG over the past 18 months. Their willingness to share their experience and time with us has been invaluable. We would also like to thank the researchers from the sub-studies who have done their very best to contribute to this work in progress.
This work is funded by the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care Yorkshire and Humber (NIHR CLAHRC YH).
Availability of data and materials
Records of FOG meetings and data generated by the FOG members can be requested from the CARE75+ project manager Anne Heaven and will be made available in line with appropriate information governance processes and data sharing agreements.
AC is the Principal Investigator for the CARE75+ study; AH is the Research Project Manager for the CARE75+ study; MF is a lay representative on the Frailty Oversight Group and LB is the Theme Manager for the Primary Care Based Management of Frail Older People, NIHR CLAHRC YH. All named authors’ are members of the Frailty Oversight Group have been involved in drafting the manuscript and given final approval. AH, LB and MF co-produced and presented a Health Service Research Network workshop on which the paper is based.
The authors declare that they have no competing interests.
Consent for publication
Not applicable. This paper does not report on study participants.
Ethics approval and consent to participate
Not applicable. This paper does not report on study participants.
This article presents independent research by the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care Yorkshire and Humber (NIHR CLAHRC YH); www.clahrc-yh.nihr.ac.uk. The views and opinions expressed are those of the authors, and not necessarily those of the NHS, the NIHR or the Department of Health.’
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- NIHR CLAHRC Yorkshire and Humber. https://sites.google.com/a/nihr.ac.uk/clahrcyh/.
- Clegg A, et al. Frailty in elderly people. Lancet. 2013;381(9868):752–62.View ArticlePubMedGoogle Scholar
- Clegg A, et al. Improving recruitment of older people to clinical trials: use of the cohort multiple randomised controlled trial design. Age and Ageing. 2015:0:1-4.
- Relton C, et al. Rethinking pragmatic randomised controlled trials: introducing the “cohort multiple randomised controlled trial” design. BMJ. 2010;340:c1066.View ArticlePubMedGoogle Scholar
- Council, MR. Maximising the value of UK population cohorts MRC Strategic Review of the Largest UK Population Cohort Studies. 2014; London.
- Lucas PJ, Allnock D, Jessiman T. How are European birth-cohort studies engaging and consulting with young cohort members? BMC Med Res Methodol. 2013;13:56.
- Thompson J, et al. Health researchers’ attitudes towards public involvement in health research. Health Expect. 2009;12(2):209–20.PubMedGoogle Scholar
- Ardron D, Kendall M. Patient and public involvement in health research: what is it, and why is it so important? Int J Palliat Nurs. 2010;16(4):160–2.View ArticlePubMedGoogle Scholar
- Boote J, Telford R, Cooper C. Consumer involvement in health research: a review and research agenda. Health Policy. 2002;61(2):213–36.View ArticlePubMedGoogle Scholar
- Shippee. Patient and service user engagement in health research: a systematic review and synthesised framework. Health Expectations; 2013 p. 1369–7625.
- NIHR. In: NIHR, editor. Going the extra mile: improving the nation’s health and wellbeing through public involvement in research. London: Department of Health; 2015.Google Scholar
- Oliver S, Armes DG, Gyte G. Public involvement in setting a national research agenda. The Patient: Patient-Centered Outcomes Research. 2009;2(3):179–90.View ArticleGoogle Scholar
- Brett J, et al. A systematic review of the conceptualisation, measurement, impact and outcomes of patients and public involvement in health and social care research. Warwick: University of Warwick; 2010.Google Scholar
- INVOLVE. Exploring the impact of public involvement on the quality of research: examples. 2013, NIHR.
- Staley K. A series of case studies illustrating the impact of service user and carer involvement on research 2013, NIHR.
- Popay J, Collins M, w.t.P.S. Group. The public involvement impact assessment framework guidance. Universities of Lancaster, Liverpool and Exeter.
- INVOLVE. Public invovlement in research: values and principles framework. 2015.Google Scholar
- Bagley HJ, et al. A patient and public involvement (PPI) toolkit for meaningful and flexible involvement in clinical trials “a work in progress. Research Involvement and Engagement. 2016;2:15.
- RDS, N. Patient and public involvement in health and social care research: a handbook for researchers.
- Buck D, et al. From plans to actions in patient and public involvement: qualitative study of documented plans and the accounts of researchers and patients sampled from a cohort of clinical trials. BMJ Open. 2014;4(12).
- INVOLVE. Public involvement in clinical trials: Supplement to the briefing notes for researchers. 2012, NIHR.
- Johnson R, Kuczawski M, Mason S. Why is it so difficult to recruit patients to research in emergency care? Lessons from the AHEAD study. Emergency Medicine Journal. 2015; 0:1-5.
- Bonnefoy X, et al. A pan-European housing and health survey: description and evaluation of methods and approaches. Int J Environ Pollut. 2007;30(3–4):363–83.View ArticleGoogle Scholar
- Bosch X, Titus SL. Cultural challenges and international research integrity. Lancet. 2009;373(9664):610–2.View ArticlePubMedGoogle Scholar
- Nuttall J, et al. Building an international network for a primary care research program: reflections on challenges and solutions in the set-up and delivery of a prospective observational study of acute cough in 13 European countries. BMC Fam Pract. 2011;12:78.
- McDonald AM, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7(1):9.View ArticlePubMedPubMed CentralGoogle Scholar
- Bradford Older People’s Partnership. Available from: https://bdp.bradford.gov.uk/about-us/partnership-whos-who/.
- Meri Yaadain. Available from: http://www.meriyaadain.co.uk/.
- Nyman SR, Victor CR. Older people’s participation in and engagement with falls prevention interventions in community settings: an augment to the Cochrane systematic review. Age and Ageing. 2012;41(1):16–23.
- Gamble C, et al. Patient and public involvement in the early stages of clinical trial development: a systematic cohort investigation. BMJ Open. 2014;4(7):e005234.View ArticlePubMedPubMed CentralGoogle Scholar
- Staley K, et al. ‘The missing links’: understanding how context and mechanism influence the impact of public involvement in research. Health Expect. 2012;17(6):755–64.View ArticlePubMedGoogle Scholar
- Yorkshire Health Study. Available from: http://www.yorkshirehealthstudy.org/#!south-yorkshire/c7ca.
- English Longitudinal Study of Ageing. Available from: http://www.elsa-project.ac.uk/search?search%5Bcategory%5D=&search%5Bkeywords%5D=public+involvement&search%5Bauthor%5D=&search%5Bsearch%5D=.
- Canadian Study of Health and Ageing. Available from: http://csha.ca/r_publication_list.asp?action=search&submitted=yes.