Using nominal group technique to advance power assisted exercise equipment for people with stroke
Research Involvement and Engagement volume 7, Article number: 68 (2021)
Power assisted exercise is accessible and acceptable for people with stroke. The potential for technological advancement of the equipment to improve the user experience has been identified. Involvement of end users and service providers in the design of health technologies is essential in determining how said technology is perceived and adopted. This project invited people with stroke and service providers to influence design features and determine machine selection in the preliminary stages of a codesign research programme.
To capture the perspectives of people with stroke and professionals working with people with stroke about proposed digitalisation of power assisted exercise equipment and select machines for prototype development.
Nominal group technique was used to capture the perspectives, ideas, preferences and priorities of three stakeholder groups: people with stroke (n = 3, mean age 66 years), rehabilitation professionals (n = 3) and exercise scientists (n = 3). Two questions underpinned the structure of the events; ‘What does an assistive exercise machine need to do to allow the person with stroke to engage in exercise?’ and ‘Which machines would you prioritise for use with People with Stroke?’ Attendees were invited to cast votes to indicate their preferred machines.
Synthesis of the data from the NGT identified four domains; software and interface, exercise programme, machine and accessories, setting and service. Three preferred machines from a range of nine were identified through vote counting.
Nominal group technique directed the selection of machines to be included in the development of the proposed technology. The vision shared by users during the structured discussion shaped the subsequent steps in the design and testing of the new technology.
Patient and service provider contribution
The opinions and preferences of people with stroke, rehabilitation professionals and exercise scientists were central to key decisions which will shape the digitalisation of power assisted equipment, influence future research and guide implementation of the new technologies.
Plain English Summary
Seated power assisted exercise machines assist different combinations of movement and can help people with stroke to take part in exercise programmes. Nine seated machines are manufactured in the UK. It was identified that the machines could be improved through development of technology to detect and display the user’s physical effort during exercise. The research team successfully applied for funding to design and develop a new programme to display and measure user effort whilst exercising on the equipment. At the outset of the project the research team needed to make decisions about the capabilities of the new technology and select three machines from the range of nine to be prototyped. We used a method called nominal group technique during which end users with stroke, rehabilitation and exercise professionals were invited to structured meetings to share their ideas. At the end of the meetings the groups voted on their preferred machines. The ideas expressed during the meetings were listed and guided the ongoing development of the technology. The importance of a user-friendly interface was emphasised. The three machines which were allocated the most votes across the user groups were selected to be redesigned and developed with the new technology. The involvement of users at the outset of the design project ensured that they directly influenced the selection of machines and features of the new technology. Nominal group technique was an effective way of ensuring that all attendees had the opportunity to share their ideas and perspectives.
Involvement of end users and service providers in the design of health technologies is essential in determining how said technology is perceived and adopted . User involvement is fundamental for creating a positive technology-based experience that is meaningful for the end-user . The adoption of user involvement principles in the development of new assistive technologies generates a partnership between consumers and providers and shifts the traditional dynamic of “doing for” the user to “doing with” . An understanding of the experiences and priorities of future users guides co-design projects and mixed methods are used to capture a rounded user perspective .
User involvement in technology design refers to an iterative, cyclic approach to product development during which clinicians, patients and carers influence and evaluate the new technology [2, 4]. The four stage Medical Device Technology framework (MDT) proposed by Shah et al.  emphasised continuous user involvement, starting with idea generation to visualise the new product. Patient and Public Involvement (PPI) can facilitate early collaboration between patients, service providers and researchers . Effective PPI enhances transparency in research processes and is particularly crucial in the development and implementation of assistive technologies .
Inclusion of end users is evolving as they have become active partners in their own disease management and, as such, take part in research ‘with’ the research team rather than being participants of research done ‘to’ or ‘about’ them [7, 8]. However, reported barriers to effective and inclusive patient involvement in health technology decision making include under-representation, limited transparency and inaccessible consultation methods . The reporting of PPI has been inconsistent with little information about the context, process or impact of public/end user involvement . Volunteers who engage in user consultation have indicated that they would like their involvement to be more visible including during dissemination . Guidelines to support the reporting of PPI have been developed to enhance awareness of PPI activities and the subsequent influence on research design, interpretation of outcomes and dissemination .
The boundaries between PPI and research can be blurred and different perspectives regarding the remit and reporting of PPI have been articulated [6, 10]. Qualitative research requires data collection and analysis for the purpose of an improved in-depth understanding of a topic and development of new theoretical perspectives; whereas PPI entails user group consultation to ensure end users’ active involvement in decisions about research priorities, design and conduct . Integrated partnership approaches which involve data collection and analysis for the purpose of decision making and change has been identified as a third division positioned between PPI and qualitative research .
The MDT framework  was selected to underpin this iterative design project focussed on power assisted exercise (PAE) for People with Stroke (PwS). The model developed by Shah et al.  ensured that an inclusive approach to user involvement was sustained and disseminated from the point of preliminary idea generation to the development and testing of the new technology. The four-stage framework comprises (1) idea generation, (2) device design, (3) prototype testing, (4) field testing. This report describes the idea generation stage which was succeeded by co-design through storyboarding (stage two) and usability testing (stage three). Shah et al.  emphasised the importance of diversity in the identification of stakeholders and their model stipulates inclusion of professional users and expert end users. Strategies to enable PwS to engage in PPI include support and reimbursement for travel, tiered levels of involvement and dedicated professional support to manage challenges associated with communication and concentration .
Power assisted exercise for people with stroke
People with limited mobility following stroke experience difficulty in accessing conventional exercise interventions and are under-represented in the growing body of evidence informing exercise for PwS . PAE machines are accessible and acceptable for people with complex neurological impairment and limited mobility following stroke; the multi-directional, global movement patterns facilitated by the equipment are associated with improved mobility and user independence . Users need to have independent sitting balance and be able to process brief instructions or demonstration to use the equipment safely .
Guidance on exercise interventions for PwS stipulate specific parameters for aerobic conditioning and resistance training to optimise physiological response . PAE machines offer varied speed settings but the duration and intensity of exercise is not based upon the exercise prescription detailed in published guidelines . Furthermore, the existing software does not measure or quantify the physical effort generated by the user. Real-time feedback during exercise has been associated with physical improvements amongst PwS . Digitalisation of rehabilitation interventions creates the opportunity to optimise performance feedback and the potential to introduce cloud-based rehabilitation and monitoring . Advancement of PAE to align the training stimulus with published guidelines for individual users and generate digitised biofeedback on user effort is currently being explored through a proof of concept co-design project. Resource planning at the outset of the project required the research team to select three priority machines from a range of nine to establish the proof of feasibility of the proposed technology. This paper reports on a user involvement exercise which aimed to capture the perspectives of service providers and PwS and rank the nine machines according to user preference during the planning phase of the project.
Nominal group technique
Nominal group technique (NGT) is a consensus method which incorporates idea generation and collection, ordered group discussion and anonymous ranking of preference through voucher allocation by individual members . NGT is a formal consensus development method based on structured group discussion; the method prevents individual participants from controlling the discussion and ensures all groups members have the opportunity to share their suggestions and opinions . It aims to achieve agreement or convergence of opinion around a particular topic and gauge the strength of that convergence and may be applied to determine priorities .
NGT is well suited to user involvement as it promotes equal representation from all participants through chaired discussion and vote counting . The translation of NGT findings into the preliminary phases of co-design projects ensures meaningful representation of the user perspective . NGT has been applied previously to obtain views and gain consensus on interventions for supporting PwS and is an accessible method for participants with communication impairment which is experienced by one third of the stroke population [21,22,23]. NGT is particularly useful where participants are likely to have diverse views on a subject or where limited research evidence is available .
The aims of the NGT process were to capture the user perspective of the proposed digitalisation of PAE equipment for PwS, identify and categorise priority design features and select three specific machines for prototype development.
Tritter  created a framework for conceptualising PPI which identified direct or indirect; individual or collective; and reactive or proactive models of involvement. The model of PPI adopted through this application of NGT was collective, direct and proactive as it captured a group perspective to shape and influence the focus of the proposed project. PwS, exercise scientists, rehabilitation experts and researchers came together to determine machine selection and priority design features for the advanced equipment. An ethos of collaboration was promoted through the chaired and structured discussion integral to NGT and the use of anonymous votes to determine machine selection. Separate sessions were scheduled for the professional user (PU) group and expert user (EU) group to ensure an honest exchange of opinion between the PU group and optimise empowerment amongst the EU group [2, 13].
At the outset of the project, a team of experts was identified to ensure representation from PwS, health care services and academia. To be considered for invitation to the PU meeting, expertise in either stroke rehabilitation, clinical exercise prescription or PAE equipment was required. Seven experts employed by the host institution comprising four physiotherapists and three exercise scientists were invited to the PU meeting. To be considered for invitation to the EU meeting, service users were required to have a diagnosis of stroke and experience of using PAE equipment. Five members of the service user group at the host institution who met this criterion were identified and invited to the EU meeting. The NGT meetings were chaired by the first author (RY) who is a research physiotherapist and directly supported by a Professor of Rehabilitation (KS). In addition, a specialist neurological physiotherapist (HL) with experience of qualitative research methods for PwS supported the EU meeting to facilitate communication and inclusion of all attendees .
An ethically conscious approach was adopted throughout the NGT sessions held with the PU and EU groups . Ethics committee approval was not required as the remit of this activity was PPI to facilitate user involvement at the outset of the programme. Written information about the meeting was circulated to potential attendees two weeks in advance. Signed permission was obtained from all attending NGT members which included authorisation to audio record the event and publish findings. The users involved in the NGT meetings were made aware that they could withdraw their contribution during or up to one week following the meeting to allow time for reflection upon the session and their contribution.
The NGT meetings took place in accessible seminar rooms at the host institution. Transport was provided for attendees of the EU event and travel costs were reimbursed for attendees of the PU event . Ground rules and objectives were communicated at the outset to set the tone of the session and promote a shared understanding of its context. The meeting addressed two questions and followed a structured format which comprised individual ideas generation in silence (written down), sharing one by one from each participant until no further ideas remained unsaid, structured discussion as a group to allow ideas to group into themes and individual voting (Table 1). The technique prevents individual participants from controlling the discussion and ensures all groups members have the opportunity to share their suggestions and opinions . The events were recorded on an Olympus WS-811 Dictaphone and field notes were retained for analysis.
As this was a PPI activity rather than primary research, the intention was to summarise and categorise the ideas shared in response to the questions posed rather than to generate new theories or perspectives. The audio recordings were transcribed verbatim and the written lists generated by participants were copied into the transcription. The first author (RY) familiarised herself with the content through repeated reading and note taking.
Key stages which underpin qualitative content analysis were adopted to interpret and organise the information captured during the NGT events [25, 26]. Two rehabilitation experts from health care services (KB, GC) were identified to support the lead author (RY) in the organisation and categorisation of the transcripts. The three analysts independently coded and categorised the content of the transcripts. The interpretation and categorisation of the transcripts remained close to the manifest content to ensure a concrete rather than abstracted interpretation of the written and verbal suggestions . Alignment of content back to the topics which had emerged during step five of the events ensured that the interpretation and categorisation of the transcripts remained close to the priorities emphasised by the NGT event attendees. Discussion between the analysts led to agreement upon four domains . The content of the domains was tabulated with columns to represent the perspectives articulated by the PU and EU groups respectively.
The number of votes allocated to each machine were counted and recorded by RY at the end of each event. The count from the EU group (n = 3) was adjusted through multiplication to equalise with the proportion of votes from the PU (n = 6) group. The top three preferred machines were determined by the highest total count.
Membership of the professional user meeting
Six out of seven invited experts in rehabilitation or exercise science attended the PU meeting. The PU group included a clinical physiotherapist, research physiotherapist, a higher degree physiotherapy graduate with a specialist interest in PAE and three exercise scientists with expertise in physiology, muscular performance and clinical populations (Table 2). The Managing Director of the PAE equipment manufacturer attended the meeting to answer any queries, observe the discussion and capture insight into the perspectives of the invited experts.
Membership of the expert user meeting
Three out of five invited service users with a diagnosis of stroke and experience of using PAE machines attended the EU meeting. The three attendees of the EU meeting were female with one-sided weakness following stroke. Detail regarding experience of PAE is detailed in Table 3.
Four content domains were identified through analysis of the written notes and transcripts captured during steps tree, four and five of the NGT meetings. These were; (1) software and interface, (2) exercise programme, (3) machine and accessories, and (4) setting and service. The features suggested by the expert groups associated with each of these categories are detailed in Table 4. Priorities identified across both groups are indicated in bold font.
Software and interface
This domain summarised the content relevant to the suggested features, functionality and aesthetics of the user interface to enable the user to engage in programme selection and receive feedback on their exercise performance. There were two subcategories; (a) interface and (b) measurement of performance.
A user-friendly visual platform for the software was prioritised by both expert groups and the EU attendees highlighted the need to be able to reach the interface from either the right or left side. The PU group emphasised the importance of a fun and motivating interface using twenty-first century technology, and potential for gamification of exercise through the interface.
Measurement of performance
Comparison of performance between sessions was identified as a priority feature by both groups. Amongst the PU group, the exercise scientists emphasised the importance of inter-session comparison and identified several options for units of measurement including watts, power, range of movement, heart rate and calorie expenditure. However, it was acknowledged that values such as watts and power may not be meaningful to end-users. The EU group also identified the potential value of inter-session comparison;
If there was something that kept…nowadays you would expect something computerised, technology. You’d log in …. it would have kept the data for you. Week by week. (E2).
The physiotherapists in the PU group specifically emphasised the potential value of feedback on symmetry in terms of the effort detected from the right and left side.
This domain encompassed the exercise stimulus created by the machine and the exercise programme relayed through the interface. There were two subcategories; (a) movement stimulus and (b) physiological demand.
Functional, simple and efficient patterns of assisted movement were prioritised by both expert groups. The physiotherapists in the PU group and EU members highlighted the importance of machine-initiated movement for people with neurological impairment and suggested that the perfect machine would facilitate good alignment and direction of movement. The physiotherapists in the PU group and EU attendees identified reduced muscle tightness and tone as desired response to the exercise programme.
The machines need to be encouraging me to focus on extension because obviously flexion is like, well I do it far more than I want to…. I would like to see that reflected in the way that the machines work, and record the effort so you could actually do more of that which I want to do, not this (indicates flexion) because I do that plenty. (E3).
The exercise scientists suggested that the option to progress from assisted to resisted movement would be an additional asset to align with overload principle of training whereby the physical challenge is incremented to promote improved strength and fitness. The PU group identified those machines which assisted trunk movement as important as they enabled a stretch which would not be possible to achieve independently.
Well that one (side bend stepper) did so much, I was so thrilled with it that I said could she put it on for a couple minutes more? Because, from my physio, I know that my back needs stretching. Because otherwise the muscles just tighten up. (E1).
The attendees of the PU group emphasised the importance of creating physiological overload through progressive levels of physical challenge to stimulate adaptation to the demand of the exercise. Improvements in various aspects of muscular performance were specifically highlighted by the exercise scientists, alongside the option to adapt the target intensity according to fluctuations in user wellbeing;
“There needs to be options for progression and regression,” (ES2)… “Yes, so not because you can’t be bothered today but if they’ve got other issues and comorbidities and today is a bad day but they still want to be able to exercise.” (P1).
Machine and accessories
This domain was emphasised more by the EU group; although the PU group also highlighted the importance of safe and accessible machines. This domain is subdivided into two categories; (a) accessibility and (b) features and accessories.
The importance of being able to safely transition on and off the machines with minimal assistance was emphasised by both groups. The physiotherapists in the PU group specifically suggested equal access from either side and safety features to minimise risk of injury. The EU group wanted the machines to be height adjustable, to enable easier mount and dismount from the seated equipment.
I’m only five foot two inch, I need a step to get on some of the machines, getting on can feel like a workout in itself. (E3).
Features and accessories
Bespoke support structures for the limbs, hands and feet were suggested by both groups alongside the importance of user-friendly, removable attachments for the limbs. The physiotherapists from the PU group emphasised the need for effective support of posture and alignment. Additional features suggested by the EU group included secure walking aid storage and a reach bar to enable users to secure their balance whilst mounting and dismounting the equipment.
Setting and service
Attendees of both groups indicated the importance of types of setting and service where PAE for PwS may be offered and another category emerged as a result: (a) team and (b) environment.
Both groups identified the importance of a skilled team to support users during their programme of PAE. Essential skills of a service provider team identified by the EU group included knowledge of the machines, movement patterns and the availability of staff or volunteers to provide assistance when required. The PU group identified the ability to educate, provide reassurance and support realistic goals.
A client centred service which was adapted to the needs of each individual was highlighted as important by both groups.
Well, sometimes, the helpers come to help me, and I’ve finished on one machine and they want to go straight onto the next…and I say I’m sorry, I’ve got to rest for a minute. Because I can’t rush from one thing to another. I need the time to get around. And then I’m aware that someone else is obviously waiting for your machine. (E1).
The EU group also identified the value of the physiotherapy led guidance when using PAE machines. The PU group emphasised the importance of social and peer support in exercise venues and the creation of an atmosphere which facilitates the development of friendships between users.
The anonymised machine preferences indicated by vouchers placed on a photograph of each machine were recorded and the votes from the EU (n = 3) group were multiplied twofold to ensure equal representation of machine preference with the PU group (n = 6). The three most popular machines were the Cross Cycle (23), Chest and Legs (22) and the Rotatory Torso (18). The least popular machines were the Tummy Crunch (4) and Seated Abductor (4).
The Side Bend Stepper was most popular amongst the EU group, gaining 7 out of the total 30 tokens available. However, only 3 tokens were placed on this machine from the PU group making it the fourth ranked machine overall. All nine machines gained a minimum of two tokens from the EU group whereas the Tummy Crunch and Seated Abductor gained no tokens from the PU group. The machines which predominantly assist limb movement gained the majority of votes from the PU group in contrast to the user by experience group who indicated more preference for those machines which assist movement of the trunk. The ranking of machines is displayed in Table 5.
The use of NGT methods generated novel ideas linked to the question and provided a focus for understanding user priorities at the outset of the co-design project. The NGT method elicited a list of suggested features to enhance the equipment and structured group discussion captured the importance of an individualised, science informed exercise programme. Expert consensus enabled the selection of three specific machines through token placement and ranking. The value of a motivating and progressive PAE programme which can be used independently was articulated by both expert groups. Areas of convergence between the expert groups were identified.
Value of diverse user involvement
The features associated with the proposed PAE programme combine elements of exercise training and therapeutic rehabilitation. The exercise scientists emphasised the training overload principle to elicit a physiological response; whereas the physiotherapists and EU group discussed the value of efficient, goal oriented, reciprocal movement patterns. The range of priorities expressed illustrated the value of consultation with diverse experts in the preliminary phase of the co-design project. Published exercise guidelines for PwS have focussed on improvements in aerobic capacity and muscular performance ; whereas physical rehabilitation for PwS has prioritised quality of movement and functional recovery . Assisted exercise enhances motor recovery and improves aerobic capacity for PwS  and therefore may bridge the historical gap which has existed between exercise and rehabilitation perspectives.
Embracing a digitalised future
The introduction of assistive technologies in rehabilitation has the potential to enable users to gain empowerment over their recovery and move towards a therapist-directed rather than therapist-dependent rehabilitation programme. Both expert groups emphasised the importance of a user-friendly interface which can be operated independently by the end user. Prioritised suggestions included motivational features, graded progression and real time feedback. Previous exploration of home-based technology through co-design with PwS also highlighted the value of user feedback, motivational gamification and independent use .
Assistive technologies may be perceived as detached and impersonal , the importance of an individualised user experience was articulated during the group discussions. In the context of PAE, an individualised user experience would facilitate the user to develop a bespoke relationship with the interface to enable an adaptable, goal-oriented exercise experience and access personalised digital information regarding progress and achievements. The emotional response triggered by interaction with technology may be influenced by the product’s quality, function and individual meaning . Customizable health technologies matched to the users’ needs and preferences has been identified as a priority .
Both groups embraced the prospect of a digitalised programme able to generate a numerical record of performance and achievement. The digitalisation of user data can enable remote supervision of rehabilitation programmes by healthcare professionals . However, a recent study to introduce wearable technologies to monitor activity amongst exercise referral scheme participants was abandoned due to poor recruitment and retention . Achieving the required balance between support, supervision and monitoring amongst older adults has been identified as a challenge by physiotherapists; individualised behaviour change interventions integrated with exercise prescription may enhance retention and reported experience .
Service and setting
Discussion regarding the setting and service was initiated by attendees during both NGT events. Attendees of the expert groups envisaged a client centred, accessible facility operated by knowledgeable staff. PwS have reported perceived improvement in physical performance and participation associated with venue-based exercise , although leisure service providers have reported feeling under-confident with the stroke population due to challenges associated with their ability to access standard exercise equipment . Assisted exercise programmes have been reported as acceptable and feasible for PwS in leisure settings and, for some participants, represented a stepping stone towards the use of conventional equipment .
The preferences shared by the members of the NGT enabled the selection of three machines from a range of nine to be prioritised for technological advancement. The EU group were all regular users of the range of equipment and their preference pattern suggested a level of appreciation for all nine machines in comparison to the PU group who indicated a greater preference for the machines which predominantly assisted limb movement. Our findings indicated that the EU group valued those machines which assist trunk movement and this highlighted the importance of capturing the perspective of the end user in decision making . Trunk control is an important predictor of mobility following stroke  and assistive interventions have been previously recommended to address deficits in trunk movement . The PU group expressed a preference for those machines which more closely resemble conventional gym equipment. The three prioritised machines include a combination of conventional and novel models, representing the views of all stakeholders. This divergence in opinion emphasised the importance of user involvement; continued engagement with PU and EU representatives will be sustained throughout the programme of research.
Application of nominal group technique to Patient Public Involvement
This user involvement report has shown the importance of early stakeholder engagement at the outset of a programme of research aimed at improving PAE for PwS. Historically, the way in which PPI has been conducted has been criticised as being tokenistic and professional led . NGT has been previously implemented in PPI activities  and, in our experience, enabled all attendees to share their perspectives, ideas, experiences and preferences. NGT enabled the adoption of a collective, direct and proactive model of PPI , which empowered PwS and service providers to shape key priorities and direct important decisions.
The research team acknowledge limitations associated with the NGT exercise reported in this paper. On reflection, a collective event which combined EU and PU representation may have generated cross fertilisation of perspectives and greater depth of discussion. Subsequent user involvement methods employed during stage two of the design project did integrate PU with EU groups. Some experience of using PAE equipment was considered necessary to be eligible as an expert by experience. This limited the number of PwS able to make an informed contribution to the events, and of the five identified experts by experience, only three were able to attend. All of the EU attendees with stroke were female and had committed to investment in their recovery through third sector exercise and rehabilitation services, the opinions and preferences expressed may not have been representative of the wider stroke population. Narrow user representation has been previously reported as a limitation in patient involvement in health technology funding decisions . It was also noted that there was a gender split across the PU group, with an all-male representation from the exercise scientists and all-female group of physiotherapists. Future activities should aim for an optimal balance of representation to promote equality and diversity of perspectives shared.
However, this report exemplifies how NGT can generate a vision for an intelligent, individualised, goal orientated technology centred around users’ preferences and priorities. In the context of this project is facilitated the development of more targeted digitalisation of PAE machines for PwS which are subsequently more likely to be acceptable to the user population. The use of NGT enables the capture a range of perspectives which can enrich research design and implementation.
This article has summarised the application of NGT to facilitate user involvement in the priorities identified at the outset of a programme of research focussed on technological advancement of PAE for PWS. The findings indicated a readiness amongst the stroke rehabilitation community to embrace digitalisation and progress the development of intelligent technologies. Congruence and divergence in the opinions and emphases shared amongst the selected attendees were identified, and perspectives were aligned with different fields of knowledge and experience represented across the expert groups. The importance of an empowering and positive user experience was emphasised by all attendees. The structured discussion and consensus voting generated ideas which will shape the digitalisation of PAE, influence future research and guide implementation of the new technologies.
The perspectives captured from this initial user involvement exercise determined which machines were selected to be prototyped to test the feasibility of the new technology. The vision for the user interface generated during the NGT discussion represented the first stage of the medical device technology framework which underpinned the overall design and feasibility testing programme. The perspectives and ideas captured shaped the subsequent methods implemented to design and prototype the new technology. The prototyped technology will be tested during stages three and four by representative users in laboratory and field settings to determine feasibility and promote an iterative approach towards ongoing development.
Availability of data and materials
Raw data generated during the PPI events reported in this manuscript are stored in audio and electronic written format at Sheffield Hallam University. Derived data supporting the findings of this study are available from the corresponding author (RY) on request.
Medical Device Technology
Patient Public Involvement
Power assisted exercise
People with stroke
Nominal group technique
Nasr N, Leon B, Mountain G, et al. The experience of living with stroke and using technology: opportunities to engage and co-design with end users. Disabil Rehabil Assist Technol. 2016;11(8):653–60. https://doi.org/10.3109/17483107.2015.1036469.
Shah SGS, Robinson I, AlShawi S. Developing medical device technologies from users’ perspectives: a theoretical framework for involving users in the development process. Int J Technol Assess Health Care. 2009;25(4):514–21.
Desmond D, Layton N, Bentley J, et al. Assistive technology and people: a position paper from the first global research, innovation and education on assistive technology (GREAT) summit. Disabil Rehabil Assist Technol. 2018;13(5):437–44. https://doi.org/10.1080/17483107.2018.1471169.
Petersen M, Hempler NF. Development and testing of a mobile application to support diabetes self-management for people with newly diagnosed type 2 diabetes: a design thinking case study. BMC Med Inform Decis Mak. 2017;17(1):91.
Pandya-Wood R, Barron DS, Elliott J. A framework for public involvement at the design stage of NHS health and social care research: time to develop ethically conscious standards. Res Involv Engagem. 2017. https://doi.org/10.1186/s40900-017-0058-y.
Williamson T, Kenney L, Barker AT, et al. Enhancing public involvement in assistive technology design research. Disabil Rehabil Assist Technol. 2015;10(3):258–65.
Higginbottom G, Liamputtong P. Participatory qualitative research methodologies in health. Los Angeles: SAGE; 2015.
National Institute for Health Research. INVOLVE; Current Work. Accessed 05 01 2021. https://www.invo.org.uk/current-work/.
Lopes E, Street J, Carter D, Merlin T. Involving patients in health technology funding decisions: stakeholder perspectives on processes used in Australia. Health Expect. 2016;19(2):331–44. https://doi.org/10.1111/hex.12356.
Staniszewska S, Brett J, Simera I, et al. GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research. BMJ. 2017. https://doi.org/10.1136/bmj.j3453.
Daveson BA, de Wolf-Linder S, Witt J, et al. Results of a transparent expert consultation on patient and public involvement in palliative care research. Palliat Med. 2015;29(10):939–49. https://doi.org/10.1177/0269216315584875.
Hoddinott P, Pollock A, O’Cathain A, et al. How to incorporate patient and public perspectives into the design and conduct of research [version 1; referees: 2 approved, 1 approved with reservations]. F1000 Res. 2018. https://doi.org/10.12688/f1000research.15162.1.
Harrison M, Palmer R. Exploring patient and public involvement in stroke research: a qualitative study. Disabil Rehabil. 2015;37(23):2174–83.
Lloyd M, Skelton DA, Mead GE, Williams B, Wijck F. Physical fitness interventions for nonambulatory stroke survivors: a mixed-methods systematic review and meta-analysis. Brain Behav. 2018. https://doi.org/10.1002/brb3.1000.
Young R, Richards E, Darji N, et al. Power assisted exercise for people with complex neurological impairment: a feasibility study. Int J Ther Rehabil. 2018;25(6):262–71.
Mackay-Lyons M, Billinger SA, Eng JJ, et al. Aerobic exercise recommendations to optimize best practices in care after stroke: AEROBICS 2019 update. Phys Ther. 2020;100(1):149. https://doi.org/10.1093/ptj/pzz153.
Lewek MD, Feasel J, Wentz E, Brooks FP, Whitton MC. Use of visual and proprioceptive feedback to improve gait speed and spatiotemporal symmetry following chronic stroke: a case series. Phys Ther. 2012;92(5):748. https://doi.org/10.2522/ptj.20110206.
Hossain MS, Hoda M, Muhammad G, Almogren A, Alamri A. Cloud-supported framework for patients in post-stroke disability rehabilitation (report). Telemat Inform. 2018;35(4):826. https://doi.org/10.1016/j.tele.2017.12.001.
Harvey N, Holmes CA. Nominal group technique: an effective method for obtaining group consensus. Int J Nurs Pract. 2012;18(2):188–94. https://doi.org/10.1111/j.1440-172X.2012.02017.x.
McMillan S, King M, Tully M. How to use the nominal group and delphi techniques. Int J Clin Pharm. 2016;38(3):655–62. https://doi.org/10.1007/s11096-016-0257-x.
Condon L, Benford P, Kontou E, Thomas S, Walker M. The use of carer perspectives and expert consensus to define key components of a biopsychosocial support intervention for stroke carers. Top Stroke Rehabil. 2019;26(6):440.
Stroke Association. What is aphasia? Accessed 26/08/2021 https://www.stroke.org.uk/what-is-aphasia.
Hinckley J, Boyle E, Lombard D, Bartels-Tobin L. Towards a consumer-informed research agenda for aphasia: preliminary work. Disabil Rehabil. 2014;36(12):1042. https://doi.org/10.3109/09638288.2013.829528.
Tritter JQ. Revolution or evolution: the challenges of conceptualizing patient and public involvement in a consumerist world. Health Expect. 2009;12(3):275–87. https://doi.org/10.1111/j.1369-7625.2009.00564.x.
Erlingsson C, Brysiewicz P. A hands-on guide to doing content analysis. Afr J Emerg Med. 2017;7(3):93. https://doi.org/10.1016/j.afjem.2017.08.001.
Graneheim UH, Lindgren B, Lundman B. Methodological challenges in qualitative content analysis: a discussion paper. Nurse Educ Today. 2017;56:29–34. https://doi.org/10.1016/j.nedt.2017.06.002.
Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. https://doi.org/10.1177/1049732305276687.
Michielsen M, Vaughan-Graham J, Holland A, Magri A, Suzuki M. The bobath concept—a model to illustrate clinical practice. Disabil Rehabil. 2019;41(17):2080–92. https://doi.org/10.1080/09638288.2017.1417496.
Linder SM, Rosenfeldt AB, Davidson S, et al. Forced, not voluntary, aerobic exercise enhances motor recovery in persons with chronic stroke. Neurorehabil Neural Repair. 2019;33(8):681–90. https://doi.org/10.1177/1545968319862557.
Bedaf S, Marti P, De Witte L. What are the preferred characteristics of a service robot for the elderly? A multi-country focus group study with older adults and caregivers. Assist Technol. 2019;31(3):147–57. https://doi.org/10.1080/10400435.2017.1402390.
Hawkins J, Charles J, Edwards M, et al. Acceptability and feasibility of implementing accelorometry-based activity monitors and a linked web portal in an exercise referral scheme: feasibility randomized controlled trial. J Med Internet Res. 2019;21(3): e12374. https://doi.org/10.2196/12374.
Arkkukangas M, Sundler AJ, Söderlund A, Eriksson S, Johansson A. Older persons’ experiences of a home-based exercise program with behavioral change support. Physiother Theory Pract. 2017;33(12):905–13. https://doi.org/10.1080/09593985.2017.1359869.
Young R, Broom D, Sage K, Crossland K, Smith C. Experiences of venue based exercise interventions for people with stroke in the UK: a systematic review and thematic synthesis of qualitative research. 2019.
Condon M, Guidon M. A survey of exercise professionals’ barriers and facilitators to working with stroke survivors. Health Soc Care Commun. 2018;26(2):250–8. https://doi.org/10.1111/hsc.12517.
Kerr A, Cummings J, Barber M, et al. Community cycling exercise for stroke survivors is feasible and acceptable. Top Stroke Rehabil. 2019;26(7):485–90. https://doi.org/10.1080/10749357.2019.1642653.
Verheyden G, Nieuwboer A, Van de Winckel A, De Weerdt W. Clinical tools to measure trunk performance after stroke: a systematic review of the literature. Clin Rehabil. 2007;21(5):387–94. https://doi.org/10.1177/0269215507074055.
Criekinge TV, Saeys W, Hallemans A, Vereeck L, De Hertogh W, Truijen S. Associations between trunk and gait performance after stroke. Gait Posture. 2017;57:179–80. https://doi.org/10.1016/j.gaitpost.2017.06.355.
Helen Luckie (physiotherapist) supported the running of the NGT event for EU. Howard Blackburn (manufacturer) supported the PU NGT event.
The PPI events reported in this manuscript were part of a programme of research funded by the Research England Connecting Capability Fund through their Grow MedTech programme (Grant No. POF00095): https://growmed.tech/about/. The lead author was appointed to a temporary research assistant contract which resourced the time committed to the analysis and reporting of findings.
Ethics approval and consent to participate
Ethics committee approval was not required as the remit of this activity was PPI to facilitate user involvement at the outset of the programme. Written information about the meeting was circulated to potential attendees two weeks in advance. Signed permission was obtained from all attending NGT members which included authorisation to audio record the event and publish findings.
Consent for publication
Signed permission was obtained from all attending NGT members which included authorisation to audio record the event and publish findings.
The work published in this manuscript is part of a programme of research examining power assisted exercise as part of the lead author’s doctoral study. An academic collaboration between the equipment manufacturer and Sheffield Hallam University exists in which machines have been provided for use in kind. There is no restriction or clauses on publishing negative findings.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Young, R., Sage, K., Broom, D. et al. Using nominal group technique to advance power assisted exercise equipment for people with stroke. Res Involv Engagem 7, 68 (2021). https://doi.org/10.1186/s40900-021-00311-z