- Review article
- Open Access
- Open Peer Review
Patient and public involvement in health literacy interventions: a mapping review
Research Involvement and Engagementvolume 3, Article number: 31 (2017)
Plain English summary
If people can read, understand and act on health information to better their health and reduce illness, they are thought to have “adequate” health literacy. Poor health literacy can mean people are less able to access health care and manage their health. Health literacy tends to worsen as adults get older, and is especially poor in adults age 65 and over. Ideally, health literacy interventions target people before age 65, to establish good skills and habits before people have many health problems associated with ageing. It is also good if researchers consult ordinary people, including patients and the public (PPI) when planning a programme to try to improve health literacy. This may help ensure individual needs are catered for.
We therefore looked for studies that described any role of patient or public representatives in the research planning stages. We explored how the representatives contributed to each project. We found only 20 studies that included people other than the research team. Lack of reporting and consultation with patient and public representatives may contribute to less success when public health programmes are undertaken.
Health literacy is the ability to understand, access and use health care and is a critical mediating factor that affects the health of older adults. Patient and public involvement in health and social care research, policy and design of care delivery is one mechanism that can promote production of better health literacy. This mapping review looks for and describes practices, concepts and methods that have been reported involving patients and public in the development and design of health literacy interventions for older people.
Studies for the present review were selected from an inventory of health behaviour studies published between 2003 and 2013. The inventory was created by systematic searches on bibliographic databases (Medline, CINAHL, Scopus, Google) for health literacy interventions involving older people (50+ years) and resulted in screening of 5561 articles, of which 1097 met study inclusion criteria. For the research described in this article 96 of the 1097 studies specifically focused on health literacy and were independently screened by two reviewers to assess involvement of stakeholders other than investigators and participants.
Twenty studies included patient and/or public involvement in at least one research domain: design, management or evaluation. Involvement included volunteers, older people, patients, and/or community representatives.
Patient and public involvement were rarely reported in studies on health literacy interventions for older people. Future intervention development needs high quality PPI, which is well reported to develop the evidence base and inform practice.
Health literacy, the ability to read, understand and act on health information, is a key determinant for improving world health [1, 2]. At its simplest, health literacy may mean the ability to take medications correctly or perform basic self-care after injury or during mild illness; more advanced health literacy is required for effectively managing a chronic condition like diabetes or rheumatoid arthritis. Therefore, health literacy is a critical mediating factor that affects patients’ ability to take part in their healthcare . Health literacy is low for between 40 and 50% of the population in developed nations [4,5,6]. This has undesirable effects on a wide-range of health indicators and outcomes, and may impose additional costs of 3–5% onto total national health care budgets . Efforts to increase health literacy in patients have been endorsed by governments [8,9,10] and professional associations [11,12,13]. The undesirable consequences of low health literacy are internationally recognised, leading to the creation of many national commissions and comprehensive reviews in the hunt for effective intervention strategies to improve health literacy [14,15,16].
Adults age 65+ are an especially vulnerable group, with regard to poor health literacy, for many (sometimes complex) reasons . Cognitive decline, less educational attainment, and many years since acquisition and use of numeracy and literacy skills, co-occurring at a time of life when health problems may sharply increase and become more complex, are all possible factors in accelerating health literacy decline among older adults. There is increasing awareness in Europe that more should be done to ensure effectiveness of interventions to improve health literacy and thus health in older adults .
Broadly speaking, patient and public involvement (PPI) in health and social care research aims to encourage co-production of health care by giving non-investigators a voice in aspects of research design. Patient and public involvement refers to active partnership between patients and/or members of the public and researchers  to prioritise, design, manage, undertake and disseminate research. It is distinct from acting as a participant or a co-investigator in the research. Originating in the 1950s, PPI evolved as a challenge to ‘the unquestioned authority of medicine from health service users’ [4, 20]. Following accumulation of evidence regarding the worth of PPI , it has been implemented in Europe, the United States, Canada, and Australia. Support for PPI in the USA is led by Patient-Centred Outcomes Research Institute (PCORI) where patients can review and prioritise research projects . Since 2013, NHS commissioners in the UK have a statutory duty to promote PPI in all aspects of research.
PPI in research can identify relevant questions to ask and outcomes to assess that are important to them and address their needs in a suitable fashion. For example, patients might not understand the health information they are given, especially if not culturally specific, or they may wish to know how best to live with a chronic condition rather than what is the “best” treatment. In so doing, it should be possible to move away from health and social care research that is done to people to that being done with people . However, as yet, few clinical trials include patient-reported outcomes . Health literacy broadly covers knowledge, behaviour and health outcomes that differ at the individual or group level. Using PPI in health literacy interventions should, therefore, be key to improving health outcomes.
This mapping review attempts to find and describe PPI in a sample of health literacy interventions. The purpose of a mapping review is to categorise studies and types of investigation and explore linked concepts used in a body of related research . First, we implemented a customised search strategy to try to find reports on health literacy interventions that might include PPI. Then we read articles carefully, selecting for further descriptive analysis, articles that reported PPI activity. We describe PPI features that were found in the eligible articles. The results are described qualitatively but we do not treat these observations as definitive.
Data sources and selection criteria
Previous work by the authors  created an inventory of health behaviour studies published in 2003–2013, with the aim of developing policy and practical guidelines for health literacy promotion in Europe. The inventory was originally created by searching bibliographic and grey literature databases and sources (Medline, CINAHL, Scopus, Google) using a broad range of search terms related to health literacy and self-efficacy skills, for all interventions which included any older adults (although explicit targeting of this age group was not essential; “older adult” = age 50+). Age 50 has been suggested as a reasonable threshold for European public health research on older adults . To create the inventory, 5561 articles were screened independently by two researchers; inclusion was confirmed by a senior academic with experience in health literacy research. 1097 articles were included in the inventory from the initial eligibility criteria, which were the inclusion of older adults in health literacy or compatible interventions . For the research described in this article, we screened the title and abstract of these 1097 articles contain the exact phrase “health literacy” (n = 96). The abstracts of these 96 studies were duplicate screened for descriptions of studies that seemed to possibly describe involvement of stakeholders other than patients and investigators. The full texts of any abstracts that could not be excluded were read to search for the involvement of non-investigator patients, carers, community or charitable bodies in any aspects of research design including design of delivery, monitoring of evaluation (NIHR, 2014). Studies were excluded if it was not possible to discern that any of these groups were involved in any aspect of the research process. Among the remaining studies that described PPI involvement, we next posed two questions:
Who is involved in the research?
When and how are they involved?
We categorised patient and public involvement (PPI) within each study. Data were extracted for the number of people involved in each stage of the research process, who was involved and how were they involved. Following published guidance on possible PPI roles , we devised a taxonomy for PPI opportunities to input to the research process, designating the contribution domains (see Table 3) as follows: Identification and prioritisation of research objectives; (other aspects of) Design; Grant development; Project management or undertaking; Analysis and interpretation; Dissemination; Monitoring or evaluation. Two experienced qualitative researchers (SHW & CS) independently extracted data with differences resolved by a balanced discussion. There was an option to refer to a third investigator for very difficult decisions.
The study selection process is shown in Fig. 1. Of the 96 studies that mentioned health literacy, 43 were removed due to no suggestion of PPI in the title or abstract. Fifty-three studies were read in full and 20 studies fulfilled the inclusion criteria (evidence of PPI reported). Details of studies are shown in Table 1, with description of PPI.
Thirteen studies were conducted in the USA [29,30,31,32,33,34,35,36,37,38,39,40,41] and one in Canada . Three studies were conducted in Europe [43,44,45], two in the UK [46, 47] and one in Australia . Most studies (n = 12) focused on patients with a range of chronic conditions and four on ethnic groups who had immigrated to America [35, 40,41,42]. Three studies also included demographic variables about low income or low socio-economic status [32, 37, 47]. All the studies included older people, however, six studies were aimed specifically at people over 50 years of age [29, 30, 33, 41, 46, 48].
Patient and public involvement
The number of PPI representatives in the 20 studies (Table 2) ranged from 3  to over 5000 . Eight studies variously included PPI participants at different stages of research [35, 37, 38, 40,41,42, 45, 46]. Two studies did not report the number of PPI representatives [32, 33].
Much of patient and public involvement in the 20 studies on health literacy was concentrated into two main domains, design and/or evaluation of the research (Table 3). None of the studies involved patients or the public to identify or prioritise areas or concerns for research, although Aspinall et al.  conducted a needs assessment to identify topics for workshops to improve the health literacy of older people. In design, some studies used PPI to develop educational material in various forms and for different uses [29, 31, 33, 37, 43]. Three studies used PPI to inform development of websites [30, 39, 45] and another to educate marginalised groups on the use of health websites . PPI was used to address the unmet health education needs of ethnic minorities [35, 40,41,42], by enlisting the help of community groups to design interventions that addressed cultural and language barriers. One study enlisted PPI in recruitment  and one developed a questionnaire to assess unmet needs of patients .
In the undertaking and/or management of research, PPI was active in assisting with educational classes [37, 46], counselling , sharing experiences of illness , improving cancer screening  and disseminating information into communities . Other studies found that information learned through community events was also disseminated to other community and family members [35, 41].
A European study included PPI for management only . PPI was used only for evaluation for four studies in the USA [30, 32, 34, 36], one in Europe  and one in the UK  . Two American studies [39, 41] and one Canadian study  used PPI for design and evaluation purposes. Three studies, one in USA , one in Europe  and on in UK  used PPI in all three areas (Table 4).
All studies included research participants aged over 50 years, but only six studies explicitly targeted older people [29, 30, 33, 41, 46, 48]. Advisory and community groups were involved in six studies [35, 38, 40,41,42, 46]. Minority groups were involved in five studies [35, 38, 40,41,42], all of which were conducted in USA (Table 5).
Patients with relevant chronic health conditions were common representatives in research that included PPI. Most studies were conducted in the USA, where patients were involved with design [31, 37] or evaluation of intervention tools [32, 34, 36]. In Europe patients evaluated self-care cards , assisted in research management by sharing their experiences in health education programmes  and were involved in design, management and evaluation of a website for self-help chronic lower back pain . Patients, along with all the other groups assisted with design and evaluation of self-help educational material for Punjabi and Chinese asthma sufferers living in Canada . American older people contributed to design [29, 33] and evaluation  of interventions. Another study included older people and Alzheimer’s Association members in design and evaluation of an educational tool about dementia for Spanish-speaking older Latinos . Older people in Australia assisted with design of a tool to assess concern about asthma . In the UK, older people, together with participants from most other groups (community/volunteers/family) contributed to design, management and evaluation of a fitness intervention to improve health behaviour . Three more American studies included minority (ethnic and lower socioeconomic) group members, two in design of cancer interventions [35, 40], and one for design, management and evaluation of health promotion that also included an advisory group . In one European study peers spoke of experiences of their health conditions to people with similar conditions . One study engaged family members in the development of ethnically and culturally suited educational material for asthma self-management . However, family members were cited by older people as important sources of support for lifestyle changes  and for understanding medical information . Interestingly it was not until the evaluation stage that one study found out how important families had been in helping patients use websites to improve health literacy  (Table 5).
The aim of this mapping review was to consider when and how PPI activity has been reported in the research process within health literacy studies. A mapping review is an appropriate method where evidence is known to be difficult to find and describe, also when the conceptual definitions and boundaries are relatively new or unclear [25, 49]. A mapping review enabled us to consider some emerging evidence in the nascent and wide ranging field of health literacy intervention research.
Twenty diverse studies were found that reported PPI in the research process. Most studies were conducted in the USA where many addressed health literacy of minority groups. There appears to be a large gap in knowledge about health literacy for minority groups in Europe and other developed countries. PPI was used minimally in most studies. Interventions in Europe (including UK) were more likely to use PPI more comprehensively than those in the USA. Most of the studies in the USA involved PPI at only one stage of research, usually design or evaluation. For example, Aspinall conducted focus groups to identify needs assessment to build an educational program to improve health literacy  and in another study patients were recruited to evaluate a website designed to help with diabetes care . Mayberry’s intervention did little for health literacy and the researchers realised the importance of support given by family members only on evaluation. This example highlights the need for PPI to be inclusive of stakeholders that are involved early in the research process. In contrast, Schulz included patients in design, management and evaluation of a website offering self-help to those with chronic back pain . Interestingly, Long only involved patients with diabetes for evaluation of the intervention. However, the intervention was successful in improving knowledge, behavioural and health outcomes, because telecare call handlers provided time and space for patients to develop rapport and ask questions about their condition and related subjects . Patients found it more helpful hearing about living with a chronic condition than about the diagnosis from peers  demonstrating the importance of understanding what people want and need to know.
Interpersonal relationships and communication issues throughout the health system are important factors to enable patients to understand their health conditions . Many patients are confused by the language used in medicine and further hindered by ill-health that drains them of energy, although others may become experts on their condition over time . Health literacy affects patients’ and carers’ ability to actively take part in their healthcare . However, few people have any concept of health literacy and for many the term reflects academic language acquired in higher education . Understanding the needs of people to improve their health should drive health literacy interventions. Reflections reported in some of the studies showed that interventions addressed unmet needs [47, 48], improved patients’ self-confidence and ability to communicate with medical professionals , and that understanding cultural values had educated a community about dementia . These examples show the wide-ranging nature of the concept of health literacy and suggest that high quality PPI is required to understand and address people’s needs, which in turn, could play an important role in improving health literacy and other interventions [17, 24, 50].
The studies included in our review showed no evidence of PPI living up to the ‘gold standard’ (e.g., GRIPP2) covering the core six principles proposed by Wilson et al.  and Staniszewksa et al. . For example, no study reported formally on having independent patient or public members to sit alongside the researchers and feed into the research process. Most studies that included PPI did so at design stage, but none of the studies apparently elicited input at the inception of the research idea. A key finding was that overall PPI was often poorly reported, which aligns with results found by others . Transparency is a much needed requirement and recommended as a national standard for PPI . Lack of transparency and poor reporting reduces propensity to replicate the research, evaluate the actual usefulness of PPI and to explain the factors influencing the outcomes. In some studies patient representation was weak as it was only used for evaluation . Practical problems linked to PPI input to research development were sometimes discussed. For instance Coughlan et al.  used members of the Pharmaceutical Care Research Group (University of Cork) to develop self-care cards. These were found on evaluation to be written at a literacy level that was too high for patients to understand . In a UK lifestyle change programme , volunteers were comprehensively involved in various aspects of the intervention including delivery, and gained confidence and skills. However, practical issues arose affecting the fidelity of the intervention including misaligned priorities between stakeholders. Similarly, one report described that too much information, often confusing, was put on a website developed with existing patients . These practical issues highlight the need for PPI at the earliest level of research planning, which should be carefully monitored throughout, to ensure that PPI continues to be effective. These gaps and weaknesses should be remediated in future by the GRIPP2 guideline for development of tools to improve reporting of PPI, to understand the context, process, and impact of PPI for better conceptualization or theorization .
Strengths and limitations
This review represents a small subsample of a larger systematic survey of studies on health literacy interventions for older people. Potentially, using an existing inventory could result in studies being missed due to the inclusion criteria of that study not fully reflecting the purpose of the present review. For example, studies for the large inventory used for this review had to report outcomes, thus studies that may identify associations or other important issues around PPI were rejected . Nevertheless, the studies were widely sourced and representative of the existing health literature for older people and the research raised concerns that could be addressed in a dedicated review on health literacy. We relied on screening abstracts at some stages which may have limited our samples; we do not pretend to have undertaken a thorough assessment exercise. We did not assess the intrinsic methodological quality of the studies included in the mapping exercise, neither were we able to compare studies reporting PPI with those that did not.
We note that sometimes PPI representatives seemed to have blurred roles, such as also acting as research subjects [32, 39], or co-investigators . Blurring or dual roles is undesirable because it creates conflicts of interest; the PPI representatives may have cause and opportunity to bias outcomes. A more rigorous review than ours might exclude reports where roles appear to have been blurred.
Our choice of defining older adults as people aged 50+ is inevitably somewhat arbitrary. There is no universally agreed threshold for identifying relatively older adults. Age 50+ does reliably denote older adults as it is more than half of the average lifespan. For public health interventions, an “older adult” threshold at about 50 years may be desirable because this is a potential key window of opportunity to promote health literacy skills that might persist into retirement age, just before health literacy most declines and health care needs are likely to increase.
Production of this article itself did not directly involve patients or public representatives – although consultations with such groups did inform the wider project that led to the creation of the larger inventory that was the starting point for our mapping review [18, 26] . Within our selected studies, PPI was poorly reported. We checked for but failed to find PPI in earlier published developmental work, although we did not contact authors for more information. Many of the studies discussed here pre-date increasingly widespread obligations from funding bodies to orientate research design using PPI. Thus, this mapping review may be considered prescient or premature. Nevertheless, it is illuminating to map the gaps and deficiencies in existing research designs so that appropriate steps can be taken in future research and policy decisions.
Better reporting is required if the full potential value – and practical issues – of patient and public involvement in the research process are to be understood. Few of the health literacy studies in our review demonstrated patient and public involvement as integral to the research process adopted. Adding PPI to research can enhance quality and appropriateness of the research at every stage, but also holds cultural and ontological challenges for researchers used to being in control. For best effect, PPI should be included at the outset and continue throughout the research. High quality PPI can help develop the evidence base and inform practice for future interventions to improve health literacy among older people.
Patient and public involvement
Roberts D, Reid J, Conner A, Barrer S, Miller K, Ziegler C. A replicable model of a health literacy curriculum for a third-year clerkship. Teaching and Learning in Medicine. 2012;24(3):200–10.
Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000;15(3):259–67.
Jordon J, Buchbinder R, Osborne R. Conceptualising health literacy from a patient perspective. Patient Educ Couns. 2010;79:36–42.
ABS: Experimental Estimates and Projections, Aboriginal and Torres Strait Islander Australians, 1991 to 2021 In., vol. Cat. No. 3238.0: Australian Bureau of Stastistics; 2009.
HLS-EU Consortium: Comparative Report of Health Literacy in Eight EU Member States. The European Health Literacy Survey HLS-EU. In.; 2012: 92.
Paasche-Orlow MK, Parker RM, Gazmararian JA, Nielsen-Bohlman LT, Rudd RR. The prevalence of limited health literacy. J Gen Intern Med. 2005;20(2):175–84.
Eichler K, Wieser S, Brügger U. The costs of limited health literacy: a systematic review. International journal of public health. 2009;54(5):313–24.
Australian Commission on Safety and Quality in Health Care: Health Literacy: Taking action to improve safety and quality. In. Sydney: Commonwealth of Australia; 2014: 96.
Heijmans M, Uiters E, Rose T, Hofstede J, Deville W, van der Heide I, Boshuisen H, Rademaker J: Study on sound evidence for a better understanding of health literacy in the European Union. In: RfS Chafea/2014/health/01. European Commission; 2015.
Health UDo, Services H, prevention OoD, promotion H: national action plan to improve health literacy. Washington, DC: Department of Health and Human Services 2010.
Rowlands G, Protheroe J, Price H, Gann B, Rafi I: Health Literacy: Report from an RCGP-led health literacy workshop. In.: Royal College of General Practitioners; 2014: 36.
Kindig DA, Panzer AM, Nielsen-Bohlman L: Health Literacy:: A Prescription to End Confusion: National Academies Press; 2004.
Rootman I, Gordon-El-Bihbety D. A vision for a health literate Canada. Ottawa, ON: Canadian Public Health Association; 2008.
Francis C, Pirkis J, Dunt D, Blood RW, Davis C: Improving mental health literacy: a review of the literature: Department of Health and Ageing London; 2002.
Kwan B, Frankish J, Rootman I, Zumbo B, Kelly K, Begoray D, Kazanijan A, Mullet J, Hayes M. The development and validation of measures of “health literacy” in different populations. UBC Institute of Health Promotion Research and University of Victoria Community Health Promotion Research. 2006;
Sheridan SL, Halpern DJ, Viera AJ, Berkman ND, Donahue KE, Crotty K: Interventions for individuals with low health literacy: a systematic review. Journal of Health Communication 2011, 16(sup3):30–54.
Salter C, Brainard J, McDaid L, Loke Y. Challenges and opportunities: what can we learn from patients living with chronic musculoskeletal conditions, health professionals and Carers about the concept of health literacy. Using qualitative methods of inquiry? PLoS One. 2014;9(10)
IROHLA: IROHLA Project Progress Report 2015. In.: Irohla Consortium: Community Research and Development Information Service.
Thompson AGH. The meaning of patient involvement and participation in health care consultations: a taxonomy. Soc Sci Med. 2007;64(6):1297–310.
Wilson P, Mathie, E., Keenan, J., McNeilly, E., Goodman, C., Howe, A., Poland, F., Staniszewska, S., Kendall, S., Munday, D., Coew, M. and Peckham, S. : Research with patient and Public Involvement: a realist evaluation – the RAPPORT study. Health Serv Deliv Res 2015, 3(38).
Oliver S, Clarke-Jones L, Rees R, Milne R, Buchanan P, Gabbay J, Gyte G, Oakley A, Stein K: Involving consumers in research and development agenda setting for the NHS: developing an evidence-based approach. Health technology assessment (Winchester, England) 2004, 8(15):1–148, iii-iv.
Patient-Centred Outcomes Research Institute [https://www.pcori.org/].
Involve: Public involvement in research: values and principles framework. In. Eastleigh: INVOLVE; 2015.
Sacristán JA, Aguarón A, Avendaño-Solá C, Garrido P, Carrión J, Gutiérrez A, Kroes R, Flores A. Patient involvement in clinical research: why, when, and how. Patient preference and adherence. 2016;10:631–40.
Cooper ID. What is a “mapping study?”. Journal of the Medical Library Association: JMLA. 2016;104(1):76.
Brainard JLY, Salter C, Koós T, Csizmadia P, Makai A, Gács B, Szepes M. Healthy ageing in Europe: prioritizing interventions to improve health literacy. BMC Research Notes. 2016;9
Davies R. Older people in Europe: EU policies and programmes. In Edited by Service EPR. 2014;8
Patient and public involvement in health and social care research: A handbook for researchers [https://www.nihr.ac.uk/about-us/CCF/funding/how-we-can-help-you/RDS-PPI-Handbook-2014-v8-FINAL.pdf].
Aspinall EE, Beschnett A, Ellwood AF. Health literacy for older adults: using evidence to build a model educational program. Medical Reference Services Quarterly. 2012;31(3):302–14.
Blanson Henkemans OA, Rogers WA, Fisk AD, Neerincx MA, Lindenberg J, van der Mast CAPG. Usability of an adaptive computer assistant that improves self-care and health literacy of older adults. Methods Inf Med. 2008;47(1):82–8.
Dwamena FC, Mavis B, Holmes-Rovner M, Walsh KB, Loyson AC. Teaching medical interviewing to patients: the other side of the encounter. Patient Educ Couns. 2009;76(3):380–4.
Eckman MH, Wise R, Leonard AC, Dixon E, Burrows C, Khan F, Warm E. Impact of health literacy on outcomes and effectiveness of an educational intervention in patients with chronic diseases. Patient Educ Couns. 2012;87(2):143–51.
Ferreira M, Dolan, N., Fitzgibbon,M., Davis, T.,Gorby, N., Ladewski, L., Liu, D., Rademaker, A., Medio, F., Schmitt, B., Bennett aCL: Health care provider–directed intervention to increase colorectal cancer screening among veterans: results of a randomized controlled trial. J Clin Oncol 2005, 32(7):1548–1554.
Gray P, Turner S, Bentley G. Low health literacy as a barrier to medication adherence in patients with diabetes. American Journal for Nurse Practitioners. 2010;14(11–12):9.
Kagawa-Singer M, Tanjasiri, S. Valdez, A., Yu, H., Foo, MA.: Outcomes of a Breast Health Project for Hmong Women and Men in California. American Journal of Public Health 2009, 99(S2).
Mayberry L, Kripalani S, Rothman R, Osborn C. Bridging the digital divide in diabetes: family support and implications for health literacy. Diabetes Technol Ther. 2011;13(10):1005–12.
Murray MD, Young J, Hoke S, Tu W, Weiner M, Morrow D, Stroupe KT, Wu J, Clark D, Smith F, et al. Pharmacist intervention to improve medication adherence in heart FailureA randomized trial. Ann Intern Med. 2007;146(10):714–25.
Pomerantz K, Muhammad AA, Downey S, Kind T. Connecting for health literacy: health information partners. Health Promot Pract. 2010;11(1):79–88.
Welch JL, Siek KA, Connelly KH, Astroth KS, McManus MS, Scott L, Heo S, Kraus MA. Merging health literacy with computer technology: self-managing diet and fluid intake among adult hemodialysis patients. Patient Educ Couns. 2010;79(2):192–8.
Williams KP, Roman L, Meghea CI, Penner L, Hammad A, Gardiner J. Kin KeeperSM: Design and baseline characteristics of a community-based randomized controlled trial promoting cancer screening in black, Latina, and Arab women. Contemporary Clinical Trials. 2013;34(2):312–9.
Valle. R, Yamada, A-M, Matiella, AC: Fotonovelas: a health literacy tool for educating latino older adults about dementia. Clin Gerontol 2006, 30(1):71–88.
Poureslami I, Nimmon L, Doyle-Waters M, Rootman I, Schulzer M, Kuramoto L, FitzGerald JM. Effectiveness of educational interventions on asthma self-management in Punjabi and Chinese asthma patients: a randomized controlled trial. The Journal Of Asthma: Official Journal Of The Association For The Care Of Asthma. 2012;49(5):542–51.
Coughlan D, Sahm L, Byrne S. The importance of health literacy in the development of ‘self care’ cards for community pharmacies in Ireland. Pharmacy Practice (Internet). 2012;10(3):143–50.
Førland G, Ringsberg KC. Implementation of a standardised health education in a local context. A case study. Scand J Caring Sci. 2013;27(3):724–32.
Schulz PJ, Rubinelli S, Zufferey MC, Hartung U. Coping with chronic lower back pain: designing and testing the online tool ONESELF. J Comput-Mediat Commun. 2010;15(4):625–45.
AgeUK: Fit as a fiddle: Evaluation report. In. Ecorys UK with Centre for Social Gerontology, University of Keele: Age UK; 2007–2012.
Long AF, Gambling T. Enhancing health literacy and behavioural change within a tele-care education and support intervention for people with type 2 diabetes. Health Expect. 2012;15(3):267–82.
Goeman D, Jenkins C, Crane M, Paul E, Douglass J. Educational intervention for older people with asthma: a randomised controlled trial. Patient Educ Couns. 2013;93(3):586–95.
Peters M, Godfrey, Christina., McInerney, Patricia,, Soares, Cassia., Hanan, Khalil., and Parker, Deborha. : The Joanna Briggs Institute Reviewers' Manual 2015: Methodology for JBI scoping reviews. Adelaide, SA Australia: The Joanna Briggs Institute; 2015.
Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, Suleman R. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect. 2014;17(5):637–50.
Staniszewska S, Brett J, Simera I, Seers K, Mockford C, Goodlad S, Altman D, Moher D, Barber R, Denegri S. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. Research Involvement and Engagement. 2017;3(1):13.
Ocloo J, Matthews R. From tokenism to empowerment: progressing patient and public involvement in healthcare improvement. BMJ Quality &amp; Safety. 2016;25(8):626.
Lopes E, Carter D, Street J. Power relations and contrasting conceptions of evidence in patient-involvement processes used to inform health funding decisions in Australia. Soc Sci Med. 2015;135:84–91.
We are indebted to the reviewers and editors who gave many positive comments to improve our manuscript. Many thanks also to partners in the IROHLA consortium who supported our research.
The European Union’s Seventh Framework Programme (FP7/2007–2013) supported this work under grant agreement No. 305831, to fund the Intervention Research on Health.
Literacy among the Ageing Population (IROHLA) project. IROHLA was co-ordinated by the University Medical Center Groningen. The views expressed here are those of the authors and not the funders.
Availability of data and materials
All the studies used in the mapping review are available from searchable databases.
Ethics approval and consent to participate
Secondary analysis of published research was used for this mapping review, therefore, ethics approval and consent to participate was not necessary.
Consent for publication
None required as no individual data were used in the mapping review.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.