This article has Open Peer Review reports available.
“Is all the stuff about neurons necessary?” The development of lay summaries to disseminate findings from the Newcastle Cognitive Function after Stroke (COGFAST) study
© The Author(s). 2017
Received: 20 December 2016
Accepted: 7 August 2017
Published: 11 September 2017
Plain English Summary
Why did we do this study?
It can be difficult for scientists to communicate their research findings to the public. This is partly due to the complexity of translating scientific language into words that the public understand. Further, it may be hard for the public to find out about and locate information about research studies. We aimed to adapt some scientific articles about the links between dementia and stroke into lay summaries to be displayed online for the general public.
How did we do it?
We collaborated with five people from a volunteer organisation, VOICENorth. They took part in two group discussions about studies reporting on the link between dementia and stroke, and selected four studies to translate into lay summaries and display on a website. We discussed the layout and language of the summaries and made adaptations to make them more understandable to the general public.
What did we find?
We were able to work with members of the public to translate research findings into lay summaries suitable for a general audience. We made changes to language and layout including the use of ‘question and answer’ style layouts, the addition of a reference list of scientific terms, and removing certain words.
What does this mean?
Working with members of the public is a realistic way to create resources that improve the accessibility of research findings to the wider public.
Scientific research is often poorly understood by the general public and difficult for them to access. This presents a major barrier to disseminating and translating research findings. Stroke and dementia are both major public health issues, and research has shown lifestyle measures help to prevent them. This project aimed to select a series of studies from the Newcastle Cognitive Function after Stroke cohort (COGFAST) and create lay summaries comprehensible and accessible to the public.
We used a focus group format to collaborate with five members of the public to review COGFAST studies, prioritise those of most interest to the wider public, and modify the language and layout of the selected lay summaries. Focus groups were audio-taped and the team used the data to make iterative amendments, as suggested by members of the public, to the summaries and to a research website. We calculated the Flesch reading ease and Flesch-Kincaid grade level for each summary before and after the changes were made.
In total, we worked with five members of the public in two focus groups to examine draft lay summaries, created by researchers, relating to eight COGFAST studies. Members of the public prioritised four COGFAST lay summaries according to the importance of the topic to the general public. We made a series of revisions to the summaries including the use of ‘question and answer’ style layouts, the addition of a glossary, and the exclusion of scientific jargon. Group discussion highlighted that lay summaries should be engaging, concise and comprehensible. We incorporated suggestions from members of the public into the design of a study website to display the summaries. The application of existing quantitative tools to estimate readability resulted in an apparently paradoxical increase in complexity of the lay summaries following the changes made.
This study supports previous literature demonstrating challenges in creating generic guidelines for researchers to create lay summaries. Existing quantitative metrics to assess readability may be inappropriate for assessing scientific lay summaries. We have shown it is feasible and successful to involve members of the public to create lay summaries to communicate the findings of complex scientific research.
Not applicable to the lay summary project.
KeywordsStroke Dementia Dissemination Lay summaries COGFAST
Public understanding of science
Scientific research is often poorly understood by the general public and difficult for them to access. This presents a major barrier to disseminating and translating research findings. It is widely accepted that research should be disseminated to the public. Firstly, many research studies are funded by taxpayers in the UK via seven research councils and the National Institute for Health and Research (NIHR), part of the Department of Health . As key stakeholders in research funding, the public have a right to expect findings to be communicated to them. Secondly, individuals often have an interest in specific research, especially if they are personally affected by the topic; understanding research findings may directly benefit them or their families through gaining relevant knowledge. In an era when the media can present confusing and conflicting messages about public health, it is important for the public to be able to access validated information that they can understand. Thirdly, the public may be more willing to contribute to ongoing research through a better understanding of what is involved and achieved. Accordingly, many grant applications now require evidence of plans to include members of the public in their research . As of May 2014, the application form for NIHR funding must include a good quality plain English summary . Improving the dissemination of research findings is one goal of a systematic process of “patient and public involvement and engagement” (PPI/E) in scientific research, increasingly advocated by research funders in the UK and elsewhere . Co-creating lay summaries and other resources that are suitable for a general audience is one example of PPI activity that may facilitate the dissemination of research findings.
How do we make research easily accessible and understandable?
Development of lay summaries are one solution to improve readability of research which might, in turn, facilitate public understanding [5, 6]. The “Natural Ground” project, established by the Association of Medical Research Charities (AMRC)to explore public and patient involvement (PPI) in allocating charity grants, found that lay people believed that academics were more likely to concentrate on areas of ‘exciting research’ in preference to those of public interest . They also highlighted the need for better access to the results of research which should be written in plain English, including the use of lay summaries. Furthermore, they suggested that the public could be successfully involved in developing lay summaries, however this would require sufficient training, mentoring and continuous support for the lay people recruited.
Similarly, the “Patients Participate” project identified poor writing style and the use of scientific jargon as barriers to the public understanding of research. The project advocated for all UK authored research articles to have a lay summary, but noted that there was a need for the development of guidelines and templates for authors of research articles to use when developing lay summaries .
It is thus acknowledged that the development of plain English versions of research results, including lay summaries, is not necessarily easy. Firstly, preparation of such resources requires the allocation of additional time and funding. Secondly, translation of scientific language to plain English is complex, and there may be a need to produce a variety of formats to suit the diversity of the intended audience .
Dissemination of lay summaries
Further to the production of lay summaries, members of the public also need to be able to access them. The internet has emerged as an important method for dissemination of health-related information . The internet has advantages over other channels of dissemination; information can be accessed quickly, easily updated, and offer access to a wider audience than printed materials [9, 10]. However, this advantage is contingent on internet access which is not universal .
In this paper we report on the process of involving members of the public in the co-creation, improvement and dissemination of lay summaries in relation to the Newcastle Cognitive Function after Stroke (COGFAST) study.
The Newcastle Cognitive Function after Stroke (COGFAST) cohort study is an example of biomedical research with findings of interest to the public and important public health messages. In the UK, one in six people over 75 will have a stroke at some point in their lifetime. Thereafter, they are at a nine-fold increased risk of developing post-stroke dementia [12, 13]. The Newcastle COGFAST cohort project aims to investigate why this risk is higher.
COGFAST recruited 415 older people with a stroke between 1999 and 2003. Patients were aged 75 or older at the time of their stroke and selected using hospital based stroke registers in the north east of England. Analysis of COGFAST data has confirmed that stroke survivors are at increased risk of developing dementia, and that there are modifiable risk factors such as stopping smoking and increasing physical activity levels which can reduce this risk . Accordingly, it is important that COGFAST findings are understandable and accessible to the public.
To select and prioritise individual studies from the COGFAST project of relevance and interest to members of the public.
To produce lay summaries relating to the selected studies.
To make these lay summaries accessible to the public via a website.
We chose to define “lay people” in accordance with INVOLVE as, “neither academic researchers nor health or social care professionals” .
Step 1: Construction of first draft lay summary
Question and answer layout with pictures.
Question and answer layout without pictures.
Question and answer layout with tables and graphs.
The project team collaborated to agree the content and terminology included in first draft lay summaries.
Step 2: First focus group
Identification of volunteer members of the public
A description of collaborators attending the focus groups
Volunteer 1 is a male in his 70s whose mother died of Alzheimer’s disease. His daughter’s mother-in-law developed Lewy body dementia.
Volunteer 2 is a male in his 50s and had a stroke at the age of 39. His father has dementia.
Volunteer 3 is a male in his 70s who is a retired teacher. His wife is a manager of a care home, and his mother had a stroke leading to poor cognitive function. He also belongs to a writers group.
Volunteer 4 is a female in her 60s. Her father died with dementia and her mother had a stroke.
Volunteer 5 is a female in her 80s currently experiencing memory problems and took part to find out what she could do to improve her memory and how she can help others.
Volunteers 1, 2, 3 and 4 attended the first focus group. Volunteers 1, 4 and 5 attended the second focus group. Reasons that volunteers were unable to attend included illness, forgetting the session or other commitments.
First focus group structure
We sent the first drafts of the eight COGFAST lay summaries via email to the collaborators 1 week before the first focus group. At the focus group, we also provided collaborators with a paper copy of each of the corresponding eight chosen COGFAST journal articles. An interviewer (SB) asked open-ended questions  to elicit thoughts on the lay summaries, in particular about the language and structure.
We distributed a feedback sheet to enable collaborators to provide written comments and to score each summary on its importance to them individually and the public in general (the feedback sheet is available as Additional file 1). The scale ranged from 1 to 10, with 1 signifying the least important and 10 being the most important. Questions included in the feedback sheet were based on the findings of the Natural Ground project . Prompted by the scoring, the group discussed which four lay summaries they preferred to be taken forward for the study website, and why particular summaries should be excluded.
Step 3: Revision of first draft of 4 lay summaries
Based on the discussion and written feedback, the project team edited the first drafts of the four prioritised lay summaries and sent version two draftsback to the collaborators prior to a second focus group.
Step 4: Second focus group
Using a similar procedure to the first focus group, the four prioritised COGFAST lay summaries were presented to the group by the interviewer who sought collaborators’ suggestions for further improvement of language and structure. An additional activity in the second focus group involved the interviewer demonstrating a range of websites [23–25, 28–31] to illustrate examples of website formatting. Collaborators were asked about their preferences in terms of website layout.
Step 5: revision and assessment of readability
Based on the findings from the second focus group, the project team finalised the draft of the four lay summaries and developed a layout for the COGFAST website. In addition, in order to assess for readability of the summaries and evaluate change from first to final draft, the Flesch reading ease scale and the Flesch-Kincaid grade level was applied to the first and the final versions.
The 1949 Flesch reading ease scale  was adapted in 1975 by Kincaid and became known as the Flesch-Kincaid grade level . The scores for these tools are derived from parameters such as average number of words per sentence and the average number of syllables per word. Text that is understandable to the public should aim to have a Flesch reading ease score of 60 or over (of a total possible score of 100)  - this is equivalent to Flesch-Kincaid reading grade of twelfth grade (US high school level, year 13/s year A-level UK equivalent). The Flesch Kincaid method is the earliest and most widely used method of assessing readability and has previously been applied to health information for patients . Since then other readability tools have been developed such as Frys Readability graph, McLaughlin’s SMOG grading and the gunning FOG index, although there is a lack of consensus as to which is most appropriate for health related literature . We chose the Flesch Kincaid method in this case due its simplicity, and availability through word processing software. We applied the Flesch scale and allocated a grade using Flesch-Kincaid to the first draft of each of the four prioritised COGFAST lay summaries. The scores were later compared to those relating to the final lay summaries.
Step 6: Dissemination via COGFAST website
Based on collaborators’ views about the websites examined during the second focus group, SB used a University owned software programme to create a COGFAST website.
In accordance with Health Research Authority guidelines we were working “with” the members of VOICENorth to co-create resources about prior research findings from the COGFAST project. As such, the volunteers were not research “participants” or “subjects”, rather they were part of a team contributing to the collaborative process of translation of academic journal articles to lay summaries . As this constituted PPI activity rather than research, formal research ethics approval was not required. However, volunteers were aware that they were not obliged to take part and that they could retire from the project at any time. Volunteers provided written consent to audio-record the focus groups and for anonymous quotation to be published in our project report.
Step 1: Construction of first draft lay summary
The first drafts of the initial eight selected COGFAST studies were developed through collaboration between the project team and volunteer members of the public. An example first draft is available as Additional file 2.
Step 2: First focus group
“Is all the stuff about neurons necessary? Shrinkage is surely all that is required?”
As a result some language was revised; however it was also advised by collaborators not to ‘dull down’ the text, for example:
“I was a bit worried about the word cohort because I think a lot of people who haven’t done statistical biology will not know what it is… if you replace it with ‘this is a collection of studies”
In terms of presenting data, collaborators concluded that there was no need to quantify findings:
“Replace getting dementia with developing dementia.”
“I am not sure if numbers matter. If it is an increased risk, it is an increased risk… to ease lay people into it, quantifying it doesn’t add anything.”
Consequently we changed the summaries to include less jargon and only use numbers when essential. Collaborators also suggested that most definitions should be removed from the lay summaries and put into a glossary of terms on the website.
“I think you need to have a statistical mind to understand what has been put down, you need to make it a little more user friendly.”
“A slab of text is difficult to concentrate on.”
Considering images, collaborators were more comfortable with pictures than graphs and tables. They agreed that graphs could be included if they were easy to interpret but that tables should be removed. As a result, we only retained a single graph within the eight summaries:
“If it wasn’t in bite size pieces it didn’t stick in the same.”
“Pictures can explain things better than words.”
The order of sections was discussed and collaborators indicated that aims should be placed earlier in the summary. Further, they endorsed the use of the Alzheimer’s Society template of including a “quick read” section .
“The Sun certainly wouldn’t put them (tables and figures) in and neither would the Times, I think that gives you a good indication that charts or whatever are not that helpful to the lay reader.”
“Put the aims up front so people immediately know what it’s about.”
As a result, we created a quick summary and placed it at the start with the aims re-sited at the beginning of the full summary.
“Include a short quick lay summary before the full lay summary.”
One of the aims of the first focus group was to prioritise four of the eight first draft lay summaries to be adapted and disseminated via the COGFAST website. Collaborators rated the eight studies on their importance, to them individually and as they perceived to the public in general. Some felt that they should be prioritised on usefulness, others on interest, depending on the reader’s circumstances. Despite the difference of opinion, the group agreed that it was still important to encapsulate both interest and usefulness in prioritisation and so the papers chosen were not necessarily those which were most important to the individual collaborators. Two of the summaries [14, 19] were selected as they were felt to be of interest to the public and two others [16, 17] because they identified modifiable lifestyle risk factors.
Step 3: Revision of first draft of 4 lay summaries
Changes to the first drafts of COGFAST lay summaries
Replacement of jargon
Omission of numbers
Preparation of a separate glossary of terms
Use of question and answer layout
Inclusion of pictures
Omission of graphs and tables
Inclusion of a “quick read” section
Step 4: Second focus group
Collaborators reviewed the four revised lay summaries. The group agreed that the lay summary headings were suitable as they were short and simple, but suggested a series of spelling and grammar adjustments. The collaborators re-emphasised the importance of colour, images and text in small sections to make the summary more engaging.
To construct the website such that additional COGFAST summaries could be added in the future.
To include an introductory page to explain what the COGFAST cohort is.
A glossary of terms labelled A-Z
Lay summaries to be made available as a PDF to print.
Scientific terms in the lay summaries to be hyperlinked to the glossary.
‘Research for scientists’ section to include website links to the original papers.
To include a ‘contact us’ section to provide information for the public about how to donate their brain or participate in a study.
Step 5: revision and assessment of readability
On the basis of the discussion in the second focus group, the project team finalised the versions of the four lay summaries to be made available to the public on the COGFAST website. The final version of the example lay summary is available as Additional file 4.
Flesch reading ease and Flesch-Kincaid grade level of the first draft of each lay summary compared to the final version
Lay summary number
Flesch Reading Ease
Flesch-Kincaid Grade Level
First draft (before focus group)
(After focus group 2)
(before focus group)
(after focus group 2)
Step 6: dissemination via COGFAST website
The COGFAST website  incorporated the formatting and design preferences of the collaborators as listed above, and is now available for members of the public to access. There is scope to expand the website to link to external sites relating to stroke and to dementia, and to add to the collection of lay summaries.
Prioritisation, adaptation and dissemination of lay summaries
We have shown it is feasible and successful to work with members of the public to prioritise and adapt lay summaries to communicate the findings of complex scientific research. The focus group format was an effective way to create useful lay summaries and an appropriate design for a website to effectively disseminate the information. The collaborators appeared to be relaxed and comfortable, which is known to facilitate a more successful exchange of ideas .
Conversations emerging from the focus groups directed a series of suggestions to improve the original drafts of the lay summaries – a number of these adaptations align with previous literature around the production of lay summaries. For example, our collaborators identified that whilst unnecessary complexity should be avoided, language should not be “dumbed down” too much. Similarly, it is known that attempts to form “plain English” run the risk of resulting in “poor English” . Our collaborators also agreed that scientific language should be avoided where possible but, when essential, a definition could be included. An evident strength of involving members of the public in our project was their ability to identify jargon missed by the academic team due to their familiarity with scientific terms.
Collaborators were also able to make valuable suggestions as to appropriate formatting of lay summaries and of a website to display them. For example, they preferred headings containing questions rather than statements. Following on from concerns about complex scientific terms, the group stressed the importance of a glossary of terms as a separate section to the website. Surprisingly, we did not find a glossary of terms on similar websites. The collaborators suggested the glossary would allow readers to easily refer to definitions if they needed to. By contrast, if all terms were defined within the body of the lay summary, the group believed this would be cumbersome and repetitive – an important barrier to engagement with the content. Their insights are likely to have led to a more accessible collection of resources from the point of view of members of the public, rather than something designed solely by an academic team. To promote longevity, a further valuable conclusion from the focus group was that the website should possess enough flexibility to allow further lay summaries to be added and adapted.
The applicability of existing measures of reading ease
We expected Flesch reading ease scores and Flesch-Kincaid grade levels would correspond with the subjective views of collaborators. However, members of the first focus group criticised the lay summary with the second highest reading ease score (71) for its complexity. This is likely to be due to the use of scientific terms which could not be identified by these scales. Comparison of scores between first drafts and final versions of the four prioritised lay summaries suggested that final versions were more complex than the originals. This paradoxical finding suggests that the Flesch reading ease and Flesch-Kincaid grade level alone are not reliable methods of judging the suitability of a scientific lay summary. Given that scientific research is complex and varies greatly in terminology, we conjecture that it would be difficult to create a specific template or quantitative assessment tool that would be suitable for this purpose. However, we endorse the use of existing general guidelines on the production of lay summaries in conjunction with input from members of the public.
We acknowledge a series of limitations. Our method of seeking volunteers meant that our collaborators were not necessarily representative of the general public. Firstly, the group were highly educated; collaborators themselves acknowledged that they may have a higher level of scientific knowledge than average. For example, one volunteer (a retired teacher who studied biology) conceded he could understand tables and graphs, whereas a lay person may not be able to. Throughout, collaborators attempted to take into account how other lay people might vary in their ability to interpret the text. Secondly, all the collaborators had prior experience of involvement in other scientific engagement activities through VOICENorth. Those with enthusiasm and interest in academic activity and dissemination, those with availability, and those with access to a computer are more likely to have volunteered. Finally, all the collaborators had personal experience of a relative or friend with dementia or stroke. As a result, their suggestions may have influenced the type of language used in lay summaries. For example, one volunteer expressed that the language needed to more heartfelt.
Consequently, our group of collaborators may not be representative of a typical ‘lay person’ (if such a thing exists). However, we argue that these individuals are representative of those most likely to access and benefit from the COGFAST website. It may be that purposive sampling of members of the public who comprise the most likely audience of a dissemination strategy is more fruitful than random sampling.
Due to the time and funding constraints of the project, there were only two focus groups lasting 90 min each. This limited the time for discussion – not all the collaborators were able to contribute all of their suggestions. Further, some contributed more than others during the focus groups. To avoid the undue influence of more vocal collaborators, the feedback form allowed team members to offer written reflections to complement the verbal discussion. An alternative method to improve the data produced might be to use one-to-one interviews to allow uninhibited, in-depth conversation, although this might limit the achievement of consensus of views.
One way to facilitate future improvement to the COGFAST summaries would be to include an option for lay readers to provide feedback on the website, as recommended by Patients Participate , to allow for further editing. Lastly, we acknowledge the inherent flaw of using the internet to disseminate lay summaries given a proportion of the public (approximately 11% of households) are not online . An alternative may be a COGFAST newsletter sent in the post with the lay summaries included or publicising the summaries elsewhere, for example, within VOICENorth’s regular newsletter.
Whilst this project used focus groups to develop lay summaries and design a website, there are supplementary methods that could have been used to improve the usability of the lay summaries and COGFAST website. The concept of “usability testing” is becoming more prevalent in response to the increasing use of the internet as a way of communicating. Essentially, any information presented via a website must meet the needs of its intended audience which requires planning, testing and amending (user research). The US government has established a website providing thorough guidance on website usability and the basics of user research . Focus groups are cited as one potential method for understanding user needs, but there are other approaches such as “parallel design” and application of “System Usability Scales” (SUS) that could be adopted to make the COGFAST website more accessible than its current format .
Involving members of the public in the collaborative prioritisation and revision of a series of lay summaries in relation to the COGFAST study led to iterative improvements of the initial drafts prepared by the academic team (see Additional files 2, 3 and 4). We suggest that the co-creation of scientific lay summaries should not rely solely on existing general guidelines, nor that they be assessed using existing measures of reading ease. Rather, that collaboration with members of the public to revise and refine content and layout of lay summaries is more likely to achieve the desired outcome of readability and comprehension.
We would like to thank our volunteer collaborators and the VOICENorth team for their support with recruitment and organisation.
The COGFAST study was funded by the Medical Research Council, UK in accordance with the following grant numbers: 2004 (G9817621); 2005-2010 (G0500247); 2008-2013 (RCUK G0700718).
Availability of data and materials
Original articles and abstracts relating to the COGFAST study are available through other publishers, some as open access. The lay summaries created during this project can be located on the COGFAST website: https://research.ncl.ac.uk/cogfast/researchforthepublic/. Audio-recordings and written feedback forms are not publicly available as they contain personal details of collaborators.
ET, LA, and SB designed the study and drafted the original lay summaries. SB led the focus groups and collected the data. ET, SB and AP processed and analysed the data. RK and LA approved the final versions of the lay summaries for publication on the website. ET, SB, AP and LA contributed to the drafting of this article. All authors read and approved the final manuscript.
ET is a lecturer in ageing at Newcastle University.
SB is a Biomedical Sciences graduate.
AP is a UK trained junior doctor, now based in Australia.
LA is a clinical senior lecturer and consultant geriatrician at Newcastle University.
RK is lead Principal Investigator of the COGFAST study and Professor of Cerebrovascular Pathology at Newcastle University.
Ethics approval and consent to participate
In accordance with INVOLVE guidelines on patient and public involvement in the dissemination of research, formal research ethics approval was not required. However, collaborators were aware that taking part was voluntary and that they could stop contributing at any time.
Consent for publication
Lay collaborators were asked to provide written consent before each focus group for the discussion to be audio-recorded, and for anonymised quotation to be reproduced in our report and published.
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- National Institute for Health Research. About NIHR. 2016. http://www.nihr.ac.uk/about-us/how-we-are-managed/. Accessed 24 Feb 2016.Google Scholar
- Auckland S. Involving users in the research process. National Institute for Health Research. 2010. http://www.rds-london.nihr.ac.uk/RDSLondon/media/RDSContent/files/PDFs/Involving-Users-in-the-Research-Process.pdf. Accessed 24 Feb 2016.Google Scholar
- Involve. National Institute for Health Research. Plain English summaries in National Institute for Health Research (NIHR) funded research. 2017. http://www.invo.org.uk/plainenglishsummaries-newsletter/. Accessed 18 Mar 2017.
- Involve. National Institute for Health Research. About Involve. 2017. http://www.invo.org.uk/about-involve/. Accessed 18 Mar 2017.
- Kuehne LM, Olden JD. Opinion: lay summaries needed to enhance science communication. Proc Natl Acad Sci U S A. 2015;112(12):3585–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Denegri S, Faure H. It’s plain and simple: transparency is good for science and in the public interest. Trials. 2013;14:215.View ArticlePubMedPubMed CentralGoogle Scholar
- Association of Medical Research Charities. Natural ground paths to patient and public involvement for medical research charities. 2009. http://www.amrc.org.uk/sites/default/files/doc_lib/2009-10%20Natural%20ground.pdf. Accessed 24 Feb 2016.Google Scholar
- JISC. Patients participate! Workshop report. 2012. http://blogs.ukoln.ac.uk/patientsparticipate/files/2011/09/WebPatientsParticipateSummaryReport.pdf. Accessed 25 Feb 2016.Google Scholar
- Shiovitz S, et al. Dissemination of quality-of-care research findings to breast oncology surgeons. Journal of Oncology Practice. 2011;7(4):257–62.View ArticlePubMedPubMed CentralGoogle Scholar
- Duffy M. The internet as a research and dissemination resource. Health Promot Int. 2000;15:349–53.View ArticleGoogle Scholar
- Office for national statistics: Internet access – households and individuals: 2016. http://www.ons.gov.uk/peoplepopulationandcommunity/householdcharacteristics/homeinternetandsocialmediausage/bulletins/internetaccesshouseholdsandindividuals/2016. Accessed 18 Aug 2016.
- Savva GM, Stephan BC. Epidemiological studies of the effect of stroke on incident dementia: a systematic review. Stroke. 2010;41(1):e41–6.View ArticlePubMedGoogle Scholar
- Kokmen E, et al. Dementia after ischemic stroke: a population-based study in Rochester, Minnesota (1960–1984). Neurology. 1996;46:154–9.View ArticlePubMedGoogle Scholar
- Allan LM, et al. Long term incidence of dementia, predictors of mortality and pathological diagnosis in older stroke survivors. Brain. 2011;134(12):3713–24.View ArticlePubMed CentralGoogle Scholar
- Involve. National Institute for health and Research. Jargon Buster. 2015. http://www.invo.org.uk/resource-centre/jargon-buster/?letter=L. Accessed 4 Mar 2016.
- Firbank MJ, et al. Neuroimaging predictors of death and dementia in a cohort of older stroke survivors. J Neurol Neurosurg Psychiatry. 2012;83(3):263–7.View ArticlePubMedGoogle Scholar
- Gemmell E, et al. Hippocampal neuronal atrophy and cognitive function in delayed poststroke and aging-related dementias. Stroke. 2012;43(3):808–14.View ArticlePubMedGoogle Scholar
- Stephens S, et al. Neuropsychological characteristics of mild vascular cognitive impairment and dementia after stroke. Int J Geriatr Psychiatry. 2004;19(11):1053–7.View ArticlePubMedGoogle Scholar
- Allan LM, et al. Long-term incidence of depression and predictors of depressive symptoms in older stroke survivors. Br J Psychiatry. 2013;203(6):453–60.View ArticlePubMedGoogle Scholar
- Morris CM, et al. NOS3 gene rs1799983 polymorphism and incident dementia in elderly stroke survivors. Neurobiol Aging. 2011;32(3):554.e1–6.View ArticleGoogle Scholar
- Ballard CG, et al. APOE epsilon4 and cognitive decline in older stroke patients with early cognitive impairment. Neurology. 2004;63(8):1399–402.View ArticlePubMedGoogle Scholar
- Gemmell E, et al. Neuron volumes in hippocampal subfields in delayed poststroke and aging-related dementias. J Neuropathol Exp Neurol. 2014;73(4):305–11.View ArticlePubMedGoogle Scholar
- Alzheimer's Society. 2016. https://www.alzheimers.org.uk/. Accessed 4 Mar 2016.
- Stroke. Research. 2016. https://www.stroke.org.uk/research. Accessed 5 Mar 2016.
- Cognitive Function & Ageing Study. What are the cognitive function and ageing studies.2016 www.cfas.ac.uk. Accessed 4 Mar 2016.Google Scholar
- Newcastle University. Voice North. 2016. http://www.voicenorth.org/about-us/. Accessed 19 Nov 2016.
- Krueger RA, Casey MA. Focus groups: a practical guide for applied research. 5th ed. SAGE: California; 2015.Google Scholar
- University College London. Patients. 2016. https://www.ucl.ac.uk/cromis-2/patients. Accessed 7 Mar 2016.Google Scholar
- National Stroke Association. Medical risk factors. 2016. http://www.stroke.org/understand-stroke/preventing-stroke/medical-risk-factors. Accessed 4 Mar 2016.Google Scholar
- Canadian Study of Health and Aging. 2002. http://www.csha.ca/. Accessed 4 Mar 2016.
- Canadian Study of Health and Ageing. Introduction to the CSHA. 2002. http://csha.ca/r_intro_to_CSHA.asp. Accessed 4 Mar 2016.Google Scholar
- Flesch R. The art of readable writing. New York: Harper & Ro; 1949. p. 149.Google Scholar
- Kincaid JP, et al. Naval technical training command; 1975. p. 49.Google Scholar
- Office for National Statistics. Reading age. 2015. http://style.ons.gov.uk/how-to-write-for-the-web/how-we-read-on-the-web/reading-age/. Accessed 1 Mar 2016.Google Scholar
- Cooley ME, et al. Patient literacy and the readability of written cancer educational materials. Oncol Nurs Forum. 1995;22(9):1345–51.PubMedGoogle Scholar
- Badarudeen M, Sabharwal S. Assessing readability of patient education materials: current role in Orthopaedics. Clin Orthop Relat Res. 2010;468(10):2572–80.View ArticlePubMedPubMed CentralGoogle Scholar
- Health Research Authority/INVOLVE. Public involvement in research and research ethics committee review. 2016. http://www.hra.nhs.uk/documents/2016/05/hra-involve-updated-statement-2016.pdf. Accessed Apr 2017.
- Newcastle University. 2016 https://research.ncl.ac.uk/cogfast/home/. Accessed Mar 2017.
- Morgan DL. Planning focus groups. California: SAGE Publications; 1997.Google Scholar
- US Department of Health and Human Services. Usability.gov. https://www.usability.gov/. Accessed Mar 2017.
- US Department of Health and Human Services. Usability.gov. https://www.usability.gov/what-and-why/user-research.html. Accessed Apr 2017.