The standard view of this forum does not always work well with assistive technology. We also provide a simpler view, which still contains all features. Switch to simple view.
Susie

Susie Fong Post 1

7 December 2015, 5:21 PM Edited by the author on 7 January 2016, 7:26 AM

Unit III: Thought question 1

Is the evidence of impact we have looked at sufficiently impressive? Can you identify:
• Evidence of impact on the research process?
• Evidence of impact on research outcomes?
• Evidence of impact on patients and members of the public?
• Evidence of impact on researchers?
Do you think there are gaps in the evidence and if so where?

We look forward to your thoughts!

Gillian Wallace

Gillian Wallace Post 2 in reply to 1

10 February 2016, 8:57 PM

In case study 2, there is evidence that research outcomes can be impacted by PPI. As discussed in previous thought questions, it is clear that the research priorities of patients may differ from those of the researchers. Case study 2 is a great example of this, demonstrating the real value and impact of PPI.

In case study 1, the evidence supporting the impact of PPI is less so than in case study 2 and 3. Possibly, I think that even without PPI, it would be fairly clear that parents of children with asthma would support a research study into prevention of exacerbations, therefore the aim of PPI here may be to ‘endorse’ the research bid and secure funding, rather than use patient/public’s ideas to (consulting rather than collaborating). Also, with ‘consultation’ of parents, it could have been decided by researchers alone that school holidays would impact the timing of interventions, and that invitations should be addressed to parents rather than children. In addition, it is a good idea involve children be involved by choosing the logo, however this is a less involved version of PPI (consulting rather than collaborating), and perhaps the children could have designed the logo. Case study 3 shows the strongest form evidence supporting PPI (full collaboration), for which impact is evidenced by actually having patients ideas turn into research (e.g. PhD funded studentships and patients as co-facilitators).

Valeria Kovacs

Valeria Kovacs Post 3 in reply to 1

13 February 2016, 1:10 PM

The PLEASANT study has a webpage: https://www.shef.ac.uk/scharr/sections/dts/ctru/pleasant/index, where one can find the study description and information about PPI in the study.

There were 3 PPI consultation events. For each of the consultations a report recorded: activities held, topics discussed, input from children and parents, changes made upon PPI recommendations and a summary of the consultation (you can find them on the webpage).

After reading the reports I found that PPI had a big impact on the research process, namely:

  • PPI suggested that letters should be addressed to parents instead of children
  • PPI suggested changes to the letters
  • PPI asked for translations to be available
  • PPI suggested changing the timing of sending the letters to be more appropriate
  • PPI suggested minor changes to the lay summary of the REC application to make it more understandable
  • Logo was developed together with PPI

I could not find evidence of impact on research outcomes, on patients and members of the public or on researchers. However, the researchers state in the webpage that: “A paper reflecting on the PPI in the design and conduct of this study will be submitted to a peer-reviewed journal at the end of the trial.” Maybe in that paper this gap in evidence could be found.

Staniszewska et al sate in their paper that: “better reporting will strengthen the PPI evidence-base”1 and for this purpose they developed a CONSORT-like guidance,2 the GRIPP checklist. I agree that if PPI impact is assessed and reported in a standard format, like the one proposed by the authors, one could easily understand “what PPI works, for whom, in what circumstances and why.”1

1. Staniszewska S, Brett J, Mockford C, Barber R. The GRIPP checklist: strengthening the quality of patient and public involvement reporting in research. Int J Technol Assess Health Care [Internet]. 2011 Oct [cited 2015 Feb 19];27(4):391–9. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22004782

2. Brett J, Staniszewska S, Mockford C, Herron-Marx S, Hughes J, Tysall C, et al. Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect [Internet]. 2014 Oct [cited 2016 Jan 6];17(5):637–50. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22809132

Maeve Kelsey

Maeve Kelsey Post 4 in reply to 3

14 February 2016, 11:02 PM Edited by the author on 14 February 2016, 11:20 PM

Unit 3 describes the impact of PPI through three separate case studies which are impressive examples.

The PLEASANT trial describes how PPI can impact the research process. Consulting children with asthma and their parents prior to the funding application, resulted in improved invitation letters going to parents/guardians rather than children. Letters were sent at a more appropriate time and children designed the logo.

In case study 2, people affected by stroke were consulted about the design of a clinical trial. PPI resulted in a change in outcome measures, the assessment questionnaires were adjusted to reflect the impact of treatment on communication, mood, cognitive function, tiredness and sleep. The results of the study became more relevant to people affected by stroke.

Case study 3 describes how a UK asthma charity funded their own research centre ( run by the University of Edinburgh) to reduce asthma exacerbations and deaths and improve asthma.This is a collaboration where researchers and patients can work together in research. Research priorities were picked by asthma sufferers throughout the UK. Every project run by the Centre has PPI at all stages which impacts:

  • research topics
  • training for researchers and students
  • study design
  • funding decisions
  • facilitation
  • interviewing new researchers
  • dissemination

Case studies and personal accounts of PPI experiences are useful to report PPI experiences. However more evidence is required for objective analysis of it's measurable impact in research and healthcare. I am uncertain of what measures are best in evaluating this.

Allison Worth

Allison Worth Post 5 in reply to 3

16 February 2016, 12:24 PM

The PLEASANT trial PPI paper has just been published, so there is more detail  should you be interested:

http://journals.cambridge.org/download.php?file=%2FPHC%2FS1463423616000025a.pdf&code=8ba6c0da48a755e1e4a6c55bf429b91c

Allison

Valeria Kovacs

Valeria Kovacs Post 6 in reply to 5

17 February 2016, 11:53 AM

Hi Allison,

thanks for the link!

Do you know if we have full access to the article?

(or I may just be doing something wrong...)

Thanks!

Allison Worth

Allison Worth Post 7 in reply to 6

17 February 2016, 3:23 PM

Hi Valeria

You should be able to but there seem to be some problems with the journal's website at the moment. Susie will upload a pdf of the paper so you can access it

Allison

Valeria Kovacs

Valeria Kovacs Post 8 in reply to 7

18 February 2016, 10:23 PM

Hi Allison,

Thanks for your reply! looking forward to reading the paper smile

KR

Valeria

IRENE RWOMUSHANA Post 9 in reply to 7

19 February 2016, 5:16 PM

Thank you, Allison, I've been able to access the website without any trouble. It could be because I am logged onto the University's VPN- that always helps.

IRENE RWOMUSHANA Post 10 in reply to 1

24 February 2016, 8:09 AM

Response to thought question 1

The three case studies presented clearly show substantial evidence of positive impact on the quality of research. The effect was on research processes, outcomes, the researchers themselves, patients and members of the lay public concerned.

The studies are a good illustration that every trial situation is unique and, therefore, PPI will be different in each situation. The study outcomes, local regulations, and study participants determine methods and evaluation of PPI that will be used. Qualitative methods are required, for example in surveys, to determine if there is an impact on outcomes, the research process, the patients, members of the public, participant observation in real time, and the researchers.

 In the PLEASANT trial, successive consultations with parents/guardians and asthma-affected children/students significantly influenced the trial preparations, intervention timing, and eventual data interpretation. The research outcomes would, conceivably, be positively influenced.

Similarly, PPI in the trial on acute stroke increased the interest of patients and the public in such a way that they were free to advise on the study design and types of outcome measures. As a consequence, the researchers introduced new outcome measures through enhancing the standard assessment questionnaire; thus making the study results “more relevant to the patients”.

The AUKCAR scenario is perhaps the most impressive of the examples. The Centre applies PPI throughout, from research proposal and design to results dissemination.

The impact is, correspondingly, far more comprehensive. There are remarkable effects on individuals’ and families’ lives; subsequent approaches to patient management and follow up strategies, among others, are cited.

It is difficult to determine if there are gaps in the evidence, given that methods of research conduct and PPI impact assessment may vary considerably. The PPI impact on quantitative study methods, for instance, is not particularly highlighted in the case studies considered.

Adam Wilson Post 11 in reply to 10

1 March 2016, 9:51 PM

As mentioned in the lessons, robust evidence of the positive effect on research of patient/public involvement is relatively few and far between. The existence of sound guidance, the consistency in which the impact of PPI is judged, and the almost infinite variety of research it can be applied to, all contribute to the problems in establishing a robust evidence base.

However, the  case studies covered in the lessons do help demonstrate evidence of the positive impact on the quality of research. Each of the examples demonstrated an impact on different aspects of the research, including research processes, outcomes, the researchers patients and members of the public.

KR

adam 

Mariam Hassan

Mariam Hassan Post 12 in reply to 1

6 March 2016, 5:58 PM

As others have mentioned all three studies show evidence of PPI impact

The PLEASANT trial PPI activity had impact on the trial procedures (wording , timing and recipients of the study invitation letter) Like Gillian my first thought was also that this was common sense and researchers could have come up with these solutions themselves including the idea to involve children in design of study logo. However i would acknowledge that as a researcher I know that sometimes we get so lost in the science of the study proposal that common sense often eludes us smile

In the stroke study (Ali et al)PPI resulted in impact on research outcomes based on feedback from patients

AUKCAR by Asthma Charity certainly shows full cycle collaborative PPI impact as mentioned by others as well. However this would only be possible in centres conceived with this idea in mind and with trained experienced people involved at the outset who ensure that PPI is integrated in every step of the research activity 

Olivia's log and comment from a member of the patient advisory group shows the positive impact PPI has on those involved in it however such evidence does not exist for researchers . For researchers almost all impact is based on material gains from PPI (improved research quality , funding , PhD studentships) however i believe a not so explored area of PPI impact would be the personal sense of fulfilment a researcher feels when collaborating with service users in research resulting in more meaningful outcome