Skip to main content
Download PDF
Download ePub

Recruitment of caregivers into health services research: lessons from a user-centred design study

Research Involvement and Engagement volume 5, Article number: 17 (2019) Cite this article

Abstract

Background

With patient and public engagement in many aspects of the healthcare system becoming an imperative, the recruitment of patients and members of the public into service and research roles has emerged as a challenge. The existing literature carries few reports of the methods – successful and unsuccessful – that researchers engaged in user-centred design (UCD) projects are using to recruit participants as equal partners in co-design research. This paper uses the recruitment experiences of a specific UCD project to provide a road map for other investigators, and to make general recommendations for funding agencies interested in supporting co-design research.

Methods

We used a case study methodology and employed Nominal Group Technique (NGT) and Focus Group discussions to collect data. We recruited 25 family caregivers.

Results

Employing various strategies to recruit unpaid family caregivers in a UCD project aimed at co-designing an assistive technology for family caregivers, we found that recruitment through caregiver agencies is the most efficient (least costly) and effective mechanism. The nature of this recruitment work – the time and compromises it requires – has, we believe, implications for funding agencies who need to understand that working with caregivers agencies, requires a considerable amount of time for building relationships, aligning values, and establishing trust.

Conclusions

In addition to providing adaptable strategies, the paper contributes to discussions surrounding how projects seeking effective, meaningful, and ethical patient and public engagement are planned and funded. We call for more evidence to explore effective mechanisms to recruit family caregivers into qualitative research. We also call for reports of successful strategies that other researchers have employed to recruit and retain family caregivers in their research.

Peer Review reports

Plain English summary

With increasing attention to patient and public engagement in many aspects of the healthcare system, the recruitment of patients and members of the public into service and research roles has emerged as a challenge. Using the experiences of a research project that sought to engage family caregivers in the co-design of technology to better support their work, this paper describes the specific recruiting strategies we used, and identifies general challenges we faced. We describe the successes and drawbacks of various recruitment strategies. We found that recruitment through community-based caregiver organizations is the most effective and least costly mechanism. However, this recruitment work requires a considerable amount of time for building relationships, aligning values, and establishing trust. We identify how existing research funding models may not allow for the relationship building that is central to engaging members of the public in research. These funding models can also force researchers into solving problems they think exist, rather than allowing them to collectively define problems and co-design solutions in partnership with members of the public.

Background

Family caregiversFootnote 1 are a heterogeneous population [1] who make up a significant unpaid labour force that provides the vast majority of care to elders and others with chronic health conditions and/or physical and mental disabilities [2]. Family care work, driven by demographic and economic change, is on the rise [3] and research into the conditions of, and supports for, this unpaid work is increasing exponentially. Along with attention to policy initiatives addressing labour laws and providing other statutory accommodations for caregivers [4,5,6] a major focus of both scholars and private industry has been on developing technologies [7] to make caregiving sustainable for family caregivers [8,9,10] by reducing their burden [11,12,13]. User Centered Design (UCD) approaches to engaging family caregivers as end users of these technologies are central to this field of research and the agencies that support it such as AGE-WELL NCE in Canada. UCD is a ‘co-design’ or ‘participatory design’ [14,15,16,17,18,19] process that focuses on partnering with end-users and designing with family caregivers not for them [20, 21]. Co-design, a mainstream term in health services research, refers to shared leadership and partnership between designers and end-users [22]. Co-design participants are assumed to hold different values, perspectives, and interests with final products emerging from shared visions, co-learning, and mutual understanding [23]. As such, UCD reflects a significant shift in the traditional designer-client relationship as it seeks to engage end users as equal partners with designers in the definition and resolution of particular challenges [24,25,26,27].

Although UCD co-design is considered a promising practice, the ethics and practicalities of integrating family caregivers into technology research remain fraught. Although family caregivers may be highly motivated to participate in research, access to these individuals by researchers, especially junior researchers with limited resources, is a known challenge [28, 29]. These family caregivers are generally time-poor [28, 30], with many of them juggling work, family, and caregiving responsibilities [31,32,33]. Recruiting those who care for persons with Alzheimer’s Disease and dementia can be even more challenging as they are often: socially isolated by their caregiving role and thus difficult to contact; unable to find someone to look after their frail care recipient; and lack access to transportation [31, 34]. Family caregivers’ mistrust of the scientific community and institutions is also reported as a significant barrier to successful recruitment into research [35]. The literature suggests that recruiting these unpaid private citizens into research aimed at improving their lives is difficult indeed [36,37,38,39,40].

Previous research examining the recruitment of caregivers in health services research [36, 41, 42], has tended to focus on minority research participants in the clinical trial setting [36, 43] rather than UCD projects. As the time and work required to identify, recruit and retain these clinical trial participants has increased, the field has turned to professional recruitment coordinators both to liberate lead investigators’ time, and to counter potential participants’ hesitance [44]. Other more recent efforts at professionalization in community and patient engagement for research have focused on creating in-house teams to identify community stakeholders, prepare researchers, and facilitate interactions between researchers and the community [40, 43, 45,46,47,48]. Despite these efforts, challenges in recruitment and retention persist [35, 40, 46, 47]. Where advice for UCD researchers has been published, it is highly contextual [40, 48,49,50,51,52,53,54] suggesting there are no universal fixes for a universal challenge. There is limited research on the challenges of recruiting caregivers outside the clinical trial environment, leaving those interested in patient engagement and participation in qualitative research with few options.

Similarly, the literature presenting best practices and strategies for successfully recruiting caregivers in UCD co-design research is scant [55]. This is despite the strong emphasis on ‘democratization of research’, and empowerment of patients and members of the public/community as research partners [56]. While this deficit is particularly acute for graduate students with limited resources as well as researchers without grants or university support [57], even early career, or well-established researchers with funding can find recruiting for UCD within the confines of grant development and execution cycles challenging. This paper draws on a specific case study of a particular co-design research project, identifying a number of challenges and counter strategies that we deployed in the course of that project to recruit family caregivers. As a resource for other researchers, we offer an account of the recruiting techniques we deployed, highlighting the time commitment and trust building issues embedded in them. We show how to develop the relationships that are a necessary part of creating the conditions that enable true co-design (i.e. partnering with end-users). We also make recommendations targeting funding agencies interested in the specifics of recruiting for co-design research.

Methods

The case study at the centre of this paper is a project funded by AGE-WELL Network of Centres of Excellence (NCE). AGE-WELL is a Canadian, federally funded collaborative entity supporting research at the intersection of technology and aging. Our specific UCD project aimed to co-design a smartphone-based application to assist family caregivers providing care for elders. We engaged family caregivers in two in-person Focus Group (FG) meetings, each lasting for two hours, with a gap of at least one week between the first and the second FG. Over the course of the two FGs, family caregivers were invited first to share and discuss their goals and aspirations, and then to imagine feasible technology-enabled supports or paths towards achieving them. As part of our training and mentorship program and to ensure a shared understanding of the research project and to develop trust and relationships, we engaged with family caregivers expressing an interest in our research, through a number of email exchanges prior to convening the FGs. In those emails, family caregivers were given information about the research, their potential role in it, and our expectations. They were also encouraged to ask any questions. At the start of each FG, the lead researcher shared the same information with family caregivers while elaborating on the components of the consent form in detail. We conducted FGs until a total of 25 family caregivers were recruited. Our main recruitment criteria were: 1) being below the age of 65 (with the assumption this population group are more likely to adopt new technology), 2) being a caregiver to a senior citizen over the age of 65 (caregiving for the adults was the focus of the project), 3) living preferably in the Calgary or Edmonton area (driven by the time and costs associated with traveling across the province or country), 4) preferably working, either part-time or full-time (again, assuming this group is more likely to adopt new technology).

In our application to AGE-WELL, we initially proposed to employ a three-step UCD process that included: 1) Citizen panels [35, 46] to discuss and identify caregivers’ needs; 2) Delphi method [5, 31, 58,59,60] to prioritize identified needs; and 3) Design Thinking method [46] to co-create a basic mock-up of a software solution to the prioritized needs. Both the citizen panel and the design thinking session were to have occurred at a hotel with 25 family caregivers spending a night and day together to define their needs (step one) and co-create a software solution (step three). Unfortunately, it proved impossible to recruit caregivers for this three-step process. While large-group residential sessions have been successful for improving quality in acute care we learned from consulting with our recruitment partners that these arrangements were impractical for family caregivers, many of whom were uninterested or unable to spend such long periods of time away from their care recipient and in the company of strangers. In partnership with Caregivers Alberta (http://www.caregiversalberta.ca/), we altered our methods. This is to say, as part of a co-design process with our community partner, we made changes to accommodate limited schedules and family caregiver preferences for interaction with social acquaintances in smaller groups. Specifically, we abandoned the large group, overnight residential sessions and instead pivoted to meeting caregivers in small groups at places they found more convenient. Methodologically, we set aside Citizen Panels, Delphi, and Design Thinking, replacing them with Nominal Group Technique [61, 62] and Focus Group (FG) discussions [63, 64]. We employed NGT in the first FG to prioritise family caregivers’ goals and used open group discussions in the second FG to explore technology-enabled solutions to those prioritised goals. NGT is particularly well adapted because of its specific focus on empowering all members [65, 66]. It is a stepwise consensus-building democratic process that results in a list of collective priorities [67]. NGT’s facilitated discussions and voting allowed varied family caregivers to contribute equally to group discussions [68].

We engaged a lay representative, who is a family caregiver, as a research partner from the time of grant writing to publication of research findings. In fact, this lay representative is one of co-authors (GM). GM is affiliated by personal and professional experience with family caregiving and the formal healthcare system, and has advised on the content and direction of the research we present in the paper since its inception. GM is involved in an Alberta based citizen-led organization, IMAGINE Citizens Collaborating for Health, who wrote a letter in support of our original grant application to AGE-WELL.

Results

When we started the project, as with many junior researchers, our knowledge of recruitment strategies was limited [69]. In the grant writing stage we had not adequately anticipated the time, human resources, and costs associated with recruitment efforts [70, 71]. Over the course of our research, from May 2017 through to August 2018, we deployed a number of techniques that we are sharing in this paper with the hope of helping other researchers. Those techniques, employed for recruiting family caregivers who provide care to older adults (see Table 1), included: partnering with intermediary caregiver organizations, using social and print media advertisement, distributing study flyers in geriatric clinics, and employing snowball sampling. We also employed two recruitment support techniques to encourage more participation including remuneration and flexible scheduling.

Table 1 Number of family caregivers recruited through different recruitment strategies
Full size table

Recruitment techniques

Recruiting through caregiver organizations

Our recruitment efforts began with approaches to community-based caregiver organizations- who have the outreach to, and are trusted by, family caregivers- such as Caregivers Alberta, the Alzheimer Society, and other local non-profit support agencies with a focus on older adults. Our central aim in approaching these organizations was to connect and form partnerships with those who had access to the vast and heterogeneous population of family caregivers [71] we sought for our study. In this sense we were engaging the organizations as co-researchers, [72] partnering with them to determine and design how to engage caregivers in the research. As noted above, our partnership with one of these organizations extended to a (co)re-design of the methods originally described in our grant application. To their great credit, grant officers, administrators, and leadership at our funding agency were amenable to, and supportive of these adaptations reflecting the input and priorities of our partner organizations. Initially, we found engaging these organizations for recruitment slow and lengthy. We believe this was due to a combination of missing resources, mutual mis-understanding, and absent trust. We elaborate on this below.

The mandate of these organizations is to support family caregivers. As such, asking them to devote limited resources to rewriting methods, making calls, or sending recruitment emails on behalf of an outside research project was, at an important level, a resourcing issue. Our budget did not include extra resources for these organizations, and as such, we were unable to assist them. Not only were we asking for time and effort on our project’s behalf, we were asking them to ‘sell’ it to family caregivers. This meant organization staff needed not just to understand our project, but to see it as aligned with their own mission. As reported elsewhere, then, we were working to overcome known barriers to recruiting through intermediary organizations which included competing demands on their time, a lack of compensation for their study-related time and effort, and having little vested interest in the study [35]. Trust that our motivations and the potential outcomes of the research were aligned with their own goals needed to be built, particularly as many staff at the organizations saw their first priority as protecting family caregivers by controlling access to them [54, 73]. Once a sense of alignment and trust had been established, and we had maintained a collaborative relationship with these organizations over time [7], our recruitment proceeded successfully. Recruiting through these organizations netted us the majority of participants in our study, 13 of 25, and was the least financially costly [74, 75]. However, the time required to overcome mutual misunderstandings, align goals, and establish trust was significant.

Other challenges associated with this recruitment technique included: a dependence on these organizations for access to potential participants; and an inability to communicate directly with caregivers [42, 76, 77]. While direct communications would have been preferable, the massive heterogeneity and anonymity of the caregiving population made these reasonable compromises in our recruitment process. Similarly, there were compromises inherent in our dependence on caregiver organizations not just for communications, but access at all. As the caregiver population is so heterogeneous, and many of those who provide unpaid care do not, despite meeting formal criteria, see themselves as “caregivers” [35, 46], caregiver partnering organizations are only able to provide access to a limited subset of a much larger population. This is to say, only those who have self-identified as caregivers will ever seek out and become affiliated with a caregiver organization.

Recruiting through social and print media

We also extensively exploited social media to recruit caregivers into the study. We designed a Facebook page and posted an ad and targeted several Facebook pages related to caregivers and seniors. We also posted regular notices using Twitter. We used print media too, for instance, our study information appeared on the first page of Dementia Connections magazine. These strategies were the most costly recruitment strategies and were not very effective compared to working with caregiver agencies, as these yielded only nine out of 25 caregivers. Other researchers have reported poor recruitment through these strategies [42], and indeed, few researchers found these means effective [54]. A shortfall of these strategies was receiving many email inquiries from individuals who did not meet study inclusion criteria, a problem experienced by other researchers too [46].

Recruiting through geriatric clinics

Our study flyers were also distributed across two geriatric clinics affiliated with the University of Calgary. The flyer included a very brief introduction to the project (in lay language), recruitment criteria, and contact information of the research coordinator. Although the flyer was designed professionally with precise and concise messages, this strategy was not effective as it yielded only two research participants. Our efforts to collaborate with these clinics were not successful which could be due to staff time constraints, bureaucratic rules and procedures, and potential of perceived competing interests as reported elsewhere [78].

Recruiting through snowball sampling

We also recruited one caregiver through snowball sampling. This technique has been reported as useful for recruiting research participants who share similar characteristics, and for locating caregivers and elders who may not have access to social services [40, 73, 79]. We used a traditional snowball sampling method by asking successfully recruited caregivers if they know of others who might be interested in participating in our study. We did not take advantage of updated snowball sampling techniques that rely on social media (e.g. retweets, or shared links of study material) rather than word-of-mouth referrals [36, 48].

Recruitment support techniques

We employed two recruitment support techniques aimed at making participation in the study more attractive to unpaid caregivers with minimal free time. Both support techniques were supplements to our caregiver organization, social and print media, geriatric clinic, and snowball recruitment efforts.

Recruitment support through remuneration

We offered two gift cards with the total value of $50 to each caregiver as a token of appreciation for their participation in our study (one card valued at $25 for each focus group meeting). While the ethical case for remunerating patient-participants is clear [36], and other researchers have reported remuneration (e.g. financial incentives/reimbursement, acknowledgment and recognition) to be effective in recruitment efforts [36], it was not obvious that many of our participants were swayed by, or even aware that, a gift card would be provided. Despite inclusion in all of our communications material, a number of participants expressed surprise when the cards were distributed. This diffidence may have reflected an understanding of our study as an extension of their otherwise unpaid caregiving work, or a desire to avoid seeming preoccupied with money, but in any case the gift cards did not appear to have been major factors in our recruitment success. We were unable to measure their value in building the project’s reputation as ethically sound and genuinely valuing caregivers’ experience and perspectives. Beyond our own research, our assumption is that providing gift cards may contribute to participants developing a positive view of research, making them more likely to get involved in the future, and to speak positively about their experience with others [80]. We argue these longer term ‘legitimacy’ benefits should join ethical arguments in favour of research budget being devoted to providing remuneration for participants’ time.

Recruitment support through flexible scheduling and meeting location

To facilitate caregivers’ attendance, especially working caregivers, we held focus group meetings outside normal business hours and in locations suited to most of them [81]. We traveled to Cochrane (a town located 18 km west of the Calgary city) for two focus groups, held another set of two focus groups in Edmonton, with the balance were held at the School of Public Policy, located in downtown Calgary, a location easily accessible by various form of public and private transportation.

Discussion

Having described our experiences and efforts at recruitment, and recruitment support, in a UCD co-design project targeting improvements in the lives of family caregivers, we move to more general observations and recommendations in this section. There are still many obstacles in the recruitment of family caregivers, patients, and members of the public in research that prevent their meaningful engagement (for a summary of these challenges see Table 2). Our findings suggest that a true co-design - where research participants are seen as equal research partners and the authority to define and act on problems is shared with them – requires structural changes. True co-design requires meaningful engagement with both family caregivers, patients, or citizens, and the organizations that may assist with their recruitment at the moment research is first contemplated. Carman et al. [82, 83] have characterized this engagement as operating across a spectrum of volume that is reminiscent of Arnstein’s [49, 84, 85] earlier view of citizen participation. Their volume continuum ranges from low level consultation, through mid-level involvement, and up to high level partnership, with patients afforded increasing presence and authority at each level. Without a shared sense that the research is a high priority for all stakeholders (family caregivers, trusted organizations, and researchers), participation will only really occur at the levels of consultation or involvement. This is to say, it will not be true co-design, which we understand requires engagement at a partnership level.

Table 2 Summary of challenges associated with recruitment in co-design research
Full size table

A number of research funding agencies across the world including CIHR in Canada, and Patient–Centered Outcome Institute (PCORI) and Quality Enhancement Research Initiative (QUERI), both in the United States, and INVOLVE (a project established by the British National Institute of Health Research to increase public engagement in research) in the United Kingdom are now encouraging co-design research through partnership between researchers and other stakeholders including members of the public. The CIHR Strategy for Patient-Oriented Research (SPOR) is another funding partnership that CIHR formed to make co-design patient-oriented research a reality in Canada. In Alberta, the home jurisdiction for the case study at the center of this paper, Alberta Innovates - a provincial research funding agency - has introduced Partnership for Research and Health Innovation in the Health System and the Collaborative Research and Innovation Opportunities program to encourage partnership between researchers and community members. Despite these efforts, we argue that some existing funding models and grant processes tend to force researchers into solving a problem that they think exists, rather than allowing them to co-define problems and co-design solutions alongside participants. This is due, in part, to the emphasis on ‘problem solving’ rather than ‘problem definition’ or ‘problem structuring’ [86, 87] which is one of the key reasons for policy failure [40, 88]. To overcome this, we argue that granting organizations should consider seed, or incubation grants that facilitate not the presentation of pre-made research questions to nominally engaged patients, but rather the trust building and value aligning that are necessary for co-design. An example of such funding initiative is the Coalitions Linking Action and Science for Prevention (CLASP) led by the Canadian Partnership Against Cancer that offer allowances to researchers to build relationships and coalition and partner with stakeholders as a granting prerequisite. Clearly there is space, and funding, for traditional research models as well, but structural supports – in the form of time and money – for the participatory action model we are advocating here are long overdue. If we are to take engagement, at the point where it distributes the most power to patients, caregivers, or citizens seriously, reforms to granting cycles and content ought to be considered carefully by research funding agencies.

If we are to avoid the marginalization of co-design in health services research, and reap the benefits of partnership-level engagement, we suggest the following participant, and organization level changes in the funding structures: 1) At the participant level, provide seed grants for working on research proposals with patient/caregiver partners, and factor in relationship-building periods at the start of grants, 2) At the organizational level, include opportunities to build in funding to support the often small non-profit patient/caregiver organizations that researchers want to engage in their co-design/co-research processes.

Conclusions

Despite being best practice and an ethical imperative, patient and public engagement in health services research generally, and the recruitment of participants for UCD co-design research remains a persistent challenge. Through employing various strategies to recruit unpaid family caregivers in a UCD project aimed at co-designing an assistive technology for family caregivers, we found that recruitment through trusted caregiver agencies is the most efficient (least costly) and effective mechanism. The nature of this recruitment work – the time and compromises it requires – has, we believe, implications for funding agencies; they need to understand that working with caregivers agencies, requires a considerable amount of time for building relationships, aligning values, and establishing trust. In addition to being time and relationship intensive, the compromises inherent in working with caregiver organizations mean that access to the full family caregiver population, and so a ‘representative’ sample, is not a realistic expectation for funding agencies. These factors are not readily known by young researchers in the grant writing stage, which lead the research project to extend beyond the funding timeline. Moreover, effective engagement of patients/caregivers and their partnering organizations requires political support for the genuine devolution of power and decision making to patient/caregiver organizations and to the citizens and caregivers with whom they engage. Some of what we learned about engaging family caregivers and caregiver partnering organizations in research might be transferable to engaging other groups as well. We call for more evidence to explore effective mechanisms to recruit family caregivers into qualitative research. We also call for documentation and reporting of the successful techniques that other researchers are employing to recruit and retain family caregivers in their co-design, partnership-level research.

Notes

  1. Family caregiver is defined by Family Caregiver Alliance as “any relative, partner, friend or neighbour who has a significant personal relationship with, and provides a broad range of assistance for an older person or an adult with a chronic or disabling condition.”

Abbreviations

FG:

Focus Group

NGT:

Nominal Group Technique

UCD:

User-centred Design

References

  1. Bua A, Escobar O. Participatory-deliberative processes and public policy agendas: lessons for policy and practice. Policy Design and Practice. 2018;1(2):126–40.

  2. Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, Sweeney J. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff. 2013;32(2):223–31.

    Article  Google Scholar 

  3. Arnstein SR. A ladder of citizen participation. J Am Inst Plann. 1969;35(4):216–24.

    Article  Google Scholar 

  4. Brett J, Staniszewska S, Mockford C, Seers K, Herron-Marx S, Bayliss H. The PIRICOM study: a systematic review of the conceptualisation, measurement, impact and outcomes of patients and public involvement in health and social care research; 2010.

    Google Scholar 

  5. Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, Brito JP, Boehmer K, Hasan R, Firwana B. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14(1):89.

    Article  Google Scholar 

  6. Staniszewska S, Brett J, Mockford C, Barber R. The GRIPP checklist: strengthening the quality of patient and public involvement reporting in research. Int J Technol Assess Health Care. 2011;27(4):391–9.

    Article  Google Scholar 

  7. Eales J, Keating N, Donalds S, Fast J. Assessing the needs of employed caregivers and employers. Edmonton: University of Alberta, research on aging, policies and Practice; 2015.

    Google Scholar 

  8. Abdelmoneium AO, Alharahsheh ST. Family home caregivers for old persons in the Arab region: perceived challenges and policy implications. Open J Soc Sci. 2016;4(01):151.

    Google Scholar 

  9. Stacey AF, Gill TK, Price K, Warmington R, Taylor AW. Unpaid informal caregivers in South Australia: population characteristics, prevalence and age-period-cohort effects 1994–2014. PLoS One. 2016;11(9):e0161994.

    Article  Google Scholar 

  10. Williams A, Sethi B, Duggleby W, Ploeg J, Markle-Reid M, Peacock S, Ghosh S. A Canadian qualitative study exploring the diversity of the experience of family caregivers of older adults with multiple chronic conditions using a social location perspective. Int J Equity Health. 2016;15(1):40.

    Article  Google Scholar 

  11. van Groenou MIB, De Boer A. Providing informal care in a changing society. Eur J Ageing. 2016;13(3):271–9.

    Article  Google Scholar 

  12. Sigurdardottir SH, Kåreholt I. Informal and formal care of older people in Iceland. Scand J Caring Sci. 2014;28(4):802–11.

    Article  Google Scholar 

  13. Bremer P, Cabrera E, Leino-Kilpi H, Lethin C, Saks K, Sutcliffe C, Soto M, Zwakhalen SM, Wübker A, Consortium R. Informal dementia care: consequences for caregivers’ health and health care use in 8 European countries. Health Policy. 2015;119(11):1459–71.

    Article  Google Scholar 

  14. Schneider U, Sundström G, Johannson L, Tortosa MA. Policies to support informal care. Long-term care reforms in OECD countries; 2015. p. 219–46.

    Google Scholar 

  15. DeMello S, Furseth PI. Innovation and culture in public services: the case of independent living. United Kingdom of Great Britain and Northern Ireland: Edward Elgar Publishing; 2016.

  16. Osborne K, Margo N, Margo O. Compassionate care benefit: health Council of Canada; 2005.

    Google Scholar 

  17. O'Hara M. Analyzing provincial supports for family/friend caregivers: a comparison of the Manitoba primary caregiver tax credit and the Nova Scotia caregiver benefit. Nova Scotia: Mount Saint Vincent University; 2014.

  18. Yeandle S. From provider to enabler of care? Reconfiguring local authority support for older people and carers in Leeds, 2008 to 2013. J Soc Serv Res. 2016;42(2):218–32.

    Article  Google Scholar 

  19. Yeandle S. Caring for our carers: an international perspective on policy developments in the UK. Juncture. 2016;23(1):57–62.

    Article  Google Scholar 

  20. Pedrozo Campos Antunes T, Souza Bulle de Oliveira A, Hudec R, Brusque Crocetta T, Ferreira de Lima Antão JY, de Almeida Barbosa RT, Guarnieri R, Massetti T, Garner DM, de Abreu LC. Assistive technology for communication of older adults: a systematic review. Aging Ment Health. 2018;23(4):417-27.

  21. Mortenson WB, Demers L, Fuhrer MJ, Jutai JW, Lenker J, DeRuyter F. Development and preliminary evaluation of the caregiver assistive technology outcome measure. J Rehabil Med. 2015;47(5):412–8.

    Article  Google Scholar 

  22. Kohler G, Sampalli T, Ryer A, Porter J, Wood L, Bedford L, Higgins-Bowser I, Edwards L, Christian E, Dunn S. Bringing value-based perspectives to care: including patient and family members in decision-making processes. Int J Health Policy Manag. 2017;6(11):661.

    Article  Google Scholar 

  23. Camarinha-Matos LM, Afsarmanesh H, Ferrada F, Oliveira AI, Rosas J. A comprehensive research roadmap for ICT and ageing. Studies in Informatics and Control. 2013;22(3):233–54.

    Article  Google Scholar 

  24. Hoenig H, Taylor DH Jr, Sloan FA. Does assistive technology substitute for personal assistance among the disabled elderly? Am J Public Health. 2003;93(2):330–7.

    Article  Google Scholar 

  25. Yusif S, Soar J, Hafeez-Baig A. Older people, assistive technologies, and the barriers to adoption: a systematic review. Int J Med Inform. 2016;94:112–6.

    Article  Google Scholar 

  26. Mortenson WB, Demers L, Fuhrer MJ, Jutai JW, Bilkey J, Plante M, DeRuyter F. Effects of a caregiver-inclusive assistive technology intervention: a randomized controlled trial. BMC Geriatr. 2018;18(1):97.

    Article  Google Scholar 

  27. Mao HF, Chang LH, Yao G, Chen WY, Huang WNW. Indicators of perceived useful dementia care assistive technology: caregivers' perspectives. Geriatr Gerontol Int. 2015;15(8):1049–57.

    Article  Google Scholar 

  28. Sanders EB-N, Stappers PJ. Co-creation and the new landscapes of design. Co-design. 2008;4(1):5–18.

    Google Scholar 

  29. Robert G. Participatory action research: using experience-based co-design to improve the quality of healthcare services. Understanding and Using Health Experiences–improving patient care; 2013.

    Google Scholar 

  30. Huldtgren A, Detweiler C, Alers H, Fitrianie S, Guldemond NA. Towards community-based co-creation. In: Human Factors in Computing and Informatics edn. Berlin, Heidelberg: Springer; 2013. p. 585–92.

  31. Oliver K, Kothari A, Mays N. The dark side of coproduction: do the costs outweigh the benefits for health research? Health Res Policy Syst. 2019;17(1):33.

    Article  Google Scholar 

  32. Donetto S, Pierri P, Tsianakas V, Robert G. Experience-based co-design and healthcare improvement: realizing participatory design in the public sector. Des J. 2015;18(2):227–48.

    Google Scholar 

  33. Iedema R, Merrick E, Piper D, Britton K, Gray J, Verma R, Manning N. Codesigning as a discursive practice in emergency health services: the architecture of deliberation. J Appl Behav Sci. 2010;46(1):73–91.

    Article  Google Scholar 

  34. What is co-design? Design for Europe. http://designforeurope.eu/what-co-design.

  35. Buckwalter KC. Recruitment of older adults: an ongoing challenge. Res Gerontol Nurs. 2009;2(4):265–6.

    Article  Google Scholar 

  36. Etkin CD, Farran CJ, Barnes LL, Shah RC. Recruitment and enrollment of caregivers for a lifestyle physical activity clinical trial. Res Nurs Health. 2012;35(1):70–81.

    Article  Google Scholar 

  37. Gelman CR. Learning from recruitment challenges: barriers to diagnosis, treatment, and research participation for Latinos with symptoms of Alzheimer's disease. J Gerontol Soc Work. 2010;53(1):94–113.

    Article  Google Scholar 

  38. Grill JD, Karlawish J. Addressing the challenges to successful recruitment and retention in Alzheimer's disease clinical trials. Alzheimers Res Ther. 2010;2(6):34.

    Article  CAS  Google Scholar 

  39. Murphy MR, Escamilla MI, Blackwell PH, Lucke KT, Miner-Williams D, Shaw V, Lewis SL. Assessment of caregivers' willingness to participate in an intervention research study. Res Nurs Health. 2007;30(3):347–55.

    Article  Google Scholar 

  40. Leach MJ, Ziaian T, Francis A, Agnew T. Recruiting dementia caregivers into clinical trials. Alzheimer Dis Assoc Disord. 2016;30(4):338–44.

    Article  Google Scholar 

  41. DePasquale N, Mogle J, Zarit SH, Okechukwu C, Kossek EE, Almeida DM. The family time squeeze: perceived family time adequacy buffers work strain in certified nursing assistants with multiple caregiving roles. The Gerontologist. 2017:gnw191.

  42. McSweeney JC, Pettey CM, Fischer EP, Spellman A. Going the distance: overcoming challenges in recruitment and retention of black and white women in multisite, longitudinal study of predictors of coronary heart disease. Res Gerontol Nurs. 2009;2(4):256–64.

    Article  Google Scholar 

  43. Dilworth-Anderson P, Williams SW. Recruitment and retention strategies for longitudinal African American caregiving research. J Aging Health. 2004;16(5_suppl):137S–56S.

    Article  Google Scholar 

  44. Moreno-John G, Gachie A, Fleming CM, Napoles-Springer A, Mutran E, Manson SM, Pérez-Stable EJ. Ethnic minority older adults participating in clinical research. J Aging Health. 2004;16(5_suppl):93S–123S.

    Article  Google Scholar 

  45. Aaron CS. Recruitment of African Americans with type 2 diabetes who care for persons with dementia: lessons learned. Los Angeles: SAGE Publications Sage CA; 2016.

    Book  Google Scholar 

  46. Pote S. May I recruit through your agency? Considerations for researchers of spousal caregivers. Educ Gerontol. 2016;42(10):729–38.

    Article  Google Scholar 

  47. Buss MK, DuBenske LL, Dinauer S, Gustafson DH, McTavish F, Cleary JF. Patient/caregiver influences for declining participation in supportive oncology trials. J Support Oncol. 2008;6(4):168–74.

    PubMed  Google Scholar 

  48. Gallagher-Thompson D, Solano N, Coon D, Arean P. Recruitment and retention of Latino dementia family caregivers in intervention research: issues to face, lessons to learn. The Gerontologist. 2003;43(1):45–51.

    Article  Google Scholar 

  49. Yancey AK, Ortega AN, Kumanyika SK. Effective recruitment and retention of minority research participants. Annu Rev Public Health. 2006;27:1–28.

    Article  Google Scholar 

  50. Rodríguez MD, Rodriguez J, Davis M. Recruitment of first-generation Latinos in a rural community: the essential nature of personal contact. Fam Process. 2006;45(1):87–100.

    Article  Google Scholar 

  51. Han H-R, Kang J, Kim KB, Ryu JP, Kim MT. Barriers to and strategies for recruiting Korean Americans for community-partnered health promotion research. J Immigr Minor Health. 2007;9(2):137–46.

    Article  Google Scholar 

  52. Silvestre AJ, Hylton JB, Johnson LM, Houston C, Witt M, Jacobson L, Ostrow D. Recruiting minority men who have sex with men for HIV research: results from a 4-city campaign. Am J Public Health. 2006;96(6):1020–7.

    Article  Google Scholar 

  53. Nicholson LM, Schwirian PM, Groner JA. Recruitment and retention strategies in clinical studies with low-income and minority populations: progress from 2004–2014. Contemp Clin Trials. 2015;45:34–40.

    Article  Google Scholar 

  54. Morrison K, Winter L, Gitlin LN. Recruiting community-based dementia patients and caregivers in a nonpharmacologic randomized trial: what works and how much does it cost? J Appl Gerontol. 2016;35(7):788–800.

    Article  Google Scholar 

  55. McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7(1):9.

    Article  Google Scholar 

  56. Joosten YA, Israel TL, Williams NA, Boone LR, Schlundt DG, Mouton CP, Dittus RS, Bernard GR, Wilkins CH. Community engagement studios: a structured approach to obtaining meaningful input from stakeholders to inform research. Acad Med. 2015;90(12):1646–50.

  57. Kadam RA, Borde SU, Madas SA, Salvi SS, Limaye SS. Challenges in recruitment and retention of clinical trial subjects. Perspect Clin Res. 2016;7(3):137–43.

    Article  Google Scholar 

  58. Esmail L, Moore E, Rein A. Evaluating patient and stakeholder engagement in research: moving from theory to practice. J Comp Eff Res. 2015;4(2):133–45.

    Article  Google Scholar 

  59. Hanson F, Hanson R. Reflections from a patient and Carer on involvement in research and integrating Care in the Health System. Int J Integr Care. 2017;17(2).

  60. Sorrentino M, Badr NG, De Marco M. Healthcare and the co-creation of value: qualifying the service roles of informal caregivers. In: International conference on exploring services science, vol. 2017. Rome: Springer; 2017. p. 76–86.

  61. Forum MH. Overview of the McMaster Health Forum’s Approach to Convening Citizen Panels. Hamilton: McMaster University; 2016.

    Google Scholar 

  62. Citizen Briefs & Panels. https://www.mcmasterhealthforum.org/citizens/citizen-briefs-and-panels.

  63. Adler M, Ziglio E. Gazing into the oracle: the Delphi method and its application to social policy and public health. London: Jessica Kingsley Publishers; 1996.

  64. Kennedy HP. Enhancing Delphi research: methods and results. J Adv Nurs. 2004;45(5):504–11.

    Article  Google Scholar 

  65. Lugmayr A, Stockleben B, Zou Y, Anzenhofer S, Jalonen M. Applying “design thinking” in the context of media management education. Multimed Tools Appl. 2014;71(1):119–57.

    Article  Google Scholar 

  66. Brown T. Design thinking. Harv Bus Rev. 2008:85–92.

  67. Maxey-Jones C, Bittner E. An intervention to decrease catheter-related bloodstream infections in the ICU. Studies Every Intensivist Should Know. 2018;50:287.

  68. Van de Ven AH, Delbecq AL. The nominal group as a research instrument for exploratory health studies. Am J Public Health. 1972;62(3):337–42.

    Article  Google Scholar 

  69. Kitzinger J. Qualitative research: introducing focus groups. Bmj. 1995;311(7000):299–302.

    Article  CAS  Google Scholar 

  70. McMillan SS, Kelly F, Sav A, Kendall E, King MA, Whitty JA, Wheeler AJ. Using the nominal group technique: how to analyse across multiple groups. Health Serv Outcome Res Methodol. 2014;14(3):92–108.

    Article  Google Scholar 

  71. Spencer DM. Facilitating public participation in tourism planning on American Indian reservations: a case study involving the nominal group technique. Tour Manag. 2010;31(5):684–90.

    Article  Google Scholar 

  72. Harvey N, Holmes CA. Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Pract. 2012;18(2):188–94.

    Article  Google Scholar 

  73. Tarlow BA, Mahoney DF. The cost of recruiting Alzheimer’s disease caregivers for research. J Aging Health. 2000;12(4):490–510.

    Article  CAS  Google Scholar 

  74. Mann J, Hung L. Co-research with people living with dementia for change. Action Res. 2018:1476750318787005. https://journals.sagepub.com/doi/10.1177/1476750318787005#articleCitationDownloadContainer.

  75. Littlechild R, Tanner D, Hall K. Co-research with older people: perspectives on impact. Qual Soc Work. 2015;14(1):18–35.

    Article  Google Scholar 

  76. Russell KM, Maraj MS, Wilson LR, Shedd-Steele R, Champion VL. Barriers to recruiting urban African American women into research studies in community settings. Appl Nurs Res. 2008;21(2):90–7.

    Article  Google Scholar 

  77. Mott DA, Chater R. Collaborations to facilitate success of community pharmacy practice-based research networks. J Am Pharm Assoc. 2008;48(2):153–62.

    Article  Google Scholar 

  78. Keating, Eales J, Funk L, Fast J, Min J. Lifecourse trajectories of family care: implications for well-being. In: British society on gerontology annual conference as part of the symposium sustainable care. Mancheter: British Society on Gerontology; 2018.

  79. O'Dwyer ST, Moyle W. Using G oogle a dwords to recruit family carers of people with dementia. Australas J Ageing. 2014;33(2):128–31.

    Article  Google Scholar 

  80. Mendez-Luck CA, Trejo L, Miranda J, Jimenez E, Quiter ES, Mangione CM. Recruitment strategies and costs associated with community-based research in a Mexican-origin population. The Gerontologist. 2011;51(suppl_1):S94–S105.

    Article  Google Scholar 

  81. Lammert C, Comerford M, Love J, Bailey JR. Investigation gone viral: application of the social mediasphere in research. Gastroenterology. 2015;149(4):839–43.

    Article  Google Scholar 

  82. Gelinas L, Largent EA, Cohen IG, Kornetsky S, Bierer BE, Fernandez Lynch H. A framework for ethical payment to research participants. In: Mass Medical Soc; 2018.

    Book  Google Scholar 

  83. Largent EA, Lynch HF. Paying research participants: regulatory uncertainty, conceptual confusion, and a path forward. Yale J Health Policy Law Ethics. 2017;17(1):61.

    PubMed  PubMed Central  Google Scholar 

  84. Leonard A, Hutchesson M, Patterson A, Chalmers K, Collins C. Recruitment and retention of young women into nutrition research studies: practical considerations. Trials. 2014;15(1):23.

    Article  Google Scholar 

  85. Huang L, Lü J, Chen N, Liu Y. Recruitment of older adults into randomized controlled trials: issues and lessons learned from two community-based exercise interventions in Shanghai. J Sport Health Sci. 2016;5(3):308–14.

    Article  Google Scholar 

  86. Polacsek M, Boardman G, McCann TV. Paying patient and caregiver research participants: putting theory into practice. J Adv Nurs. 2017;73(4):847–56.

    Article  Google Scholar 

  87. Roche E, King R, Mohan HM, Gavin B, McNicholas F. Payment of research participants: current practice and policies of Irish research ethics committees. J Med Ethics. 2013;39(9):591–3.

    Article  Google Scholar 

  88. Lawrence V, Pickett J, Ballard C, Murray J. Patient and carer views on participating in clinical trials for prodromal Alzheimer's disease and mild cognitive impairment. Int J Geriatr Psychiatry. 2014;29(1):22–31.

    Article  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge the contributions of all family caregivers and community-based caregiver organizations, who willingly partnered with our research project.

Funding

This work was supported by the AGE-WELL Network of Centres of Excellence (NCE).

Availability of data and materials

The data are available from the principal investigator by reasonable request.

Author information

Authors and Affiliations

  1. Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, Alberta, Canada

    Myles Leslie & Gail MacKean

  2. School of Public Policy, University of Calgary, Downtown Campus, 906 8th Avenue S.W., 5th Floor, Calgary, Alberta, T2P 1H9, Canada

    Myles Leslie & Akram Khayatzadeh-Mahani

  3. Health Services Management Research Center, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran

    Akram Khayatzadeh-Mahani

  4. IMAGINE Citizens Collaborating for Health, Calgary, Alberta, Canada

    Gail MacKean

Authors
  1. Myles Leslie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Akram Khayatzadeh-Mahani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gail MacKean
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ML and AKM wrote the first draft of this manuscript. GM critically reviewed and revised the manuscript. All authors read and approved the final version of the manuscript.

Corresponding author

Correspondence to Akram Khayatzadeh-Mahani.

Ethics declarations

Ethics approval and consent to participate

This study has received ethics approval from the Conjoint Faculties Research Ethics Board at the University of Calgary (reference number REB17–0977).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Leslie, M., Khayatzadeh-Mahani, A. & MacKean, G. Recruitment of caregivers into health services research: lessons from a user-centred design study. Res Involv Engagem 5, 17 (2019). https://doi.org/10.1186/s40900-019-0150-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40900-019-0150-6

Keywords

Research Involvement and Engagement

ISSN: 2056-7529

Contact us