Development of performance indicators for patient and public involvement in hospital: expert consensus recommendations based on the available evidence
Purpose: This study aimed to use available evidence and expert consensus to develop performance indicators of patient and public involvement in hospital.
Methods: A 3-step process was used to develop the indicators. Firstly, key indicators and recommendations were identified from the literature and distributed over 5 domains: customer satisfaction, complaint management, customer orientation, voice of customer and patients’ right. A multidisciplinary panel of medical professionals (n=8) rated and prioritized the indicators via 2-round Delphi technique. Subsequently, the panel assessed the indicators at two consensus meetings.
Findings: Of the 41 draft performance indicators, the expert panel members achieved positive consensus on 33 indicators. Also two indicators were developed on experts' opinions.
Conclusion: About 35 patient and public involvement performance indicators were identified. Evidence support was available for most indicators. The set of indicators provides a baseline for patient and public involvement among stakeholders enabling them to evaluate and improve their accountability.
Sarah Squire, Hill P. The Expert Patients Programme. Clinical Governance: An InternationalJournal. 2006;11(1):17-21.
Squire Sarah, Greco Michael, O’Hagan Bridget, Dickinson Kathy, Wall Debbie. Being patient-centred: creating health care for our grandchildren. Clinical Governance: An InternationalJournal. 2006;11(1):8-16.
R Chambers, G Wakley. making clinical governance work for you. Radcliffe Medical Press; 2000
R Matthews. patient and public involvement In: E. Haxby DH, and S. Jaggar, editor. An introduction to clinical governance and patient safety: OXFORD university press; 2010. p. 313-21.
Gagliardi Anna R, Lemieux-Charles Louise, Adalsteinn D. Brown, Sullivan Terrence , Goel Vivek. Barriers to patient involvement in health service planning and evaluation: An exploratory study. Patient Education and Counseling 2008;70: 234-41.
Hon Kevin Barron, Davia Amess, Charlotte Atkins, Ronnie Campbell, al e. patient and public involvement in the NHS. London: House of Commons,health committee; 2007. p. 103.
What is PPI? Toolkit for for involving patients and the public in lambeth PCT: Lambeth primary care Trust,NHS; 2004. p. 2-6.
Sofaer Shoshanna, Firminger Kirsten. Patient perceptions of the quality of health services. Ann Rev Public Health. 2005;26:513-59.
Betty Chewning, Carma L. Bylund, Bupendra Shah, Arora NK, Jennifer A. Gueguen, Makoul G. Patient preferences for shared decisions: A systematic review. Patient Education and Counselling 2012;86:9-18.
Jenkinson C, Coulter A, Bruster S, Richards N, Chandola T. Patients’ experiences and satisfaction with health care: results of a questionnaire study of specific aspects of care. Qual Saf Health Care. 2002;11:335-9.
Shilling V, Jenkins V, L F. Factors affecting patient and clinician satisfaction with the clinical consultation: can communication skills training for clinicians improve satisfaction? Psychooncology. 2003;12:599-611.
Grol Richard, Wensing Michel, Eccles Martin. Improving patient care; the implementation of change in clinical practice. London: Elsevier; 2005.
Ouwens Mariëlle , Hermens Rosella , Hulscher Marlies , Vonk-Okhuijsen Saskia, Tjan-Heijnen Vivianne, Termeer René , et al. Development of indicators for patient-centred cancer care. Support Care Cancer. 2010;18:121-30.
Patient and Public Involvement Strategy,Valuing People. Plymouth Hospitals NHS Trust.; 2008-2013.
Marshall MN, Shekelle PG, Davies HTO, PC S. Public reporting on quality in the United States and the United Kingdom. Health Affair. 2003;22:134–48.
Jones Jeremy , Hunter Duncan Consensus methods for medical and health services research. British Medical Journal. 1995;311:376–80.
Jeremiah Mwangi, Jo Groves, Tritter J. patient-centred healthcare indicators review: International Alliance of Patients’ Organizations; 2012 Contract No.: Document Number|.
Okoli Chitu , Pawlowski Suzanne D. The Delphi method as a research tool: an example,design considerations and applications. Information & Management. 2004;42:15-29.
Linstone HA. The Delphi technique. Handbook of Futures Research. Westport, CT: Greenwood Press; 1978.
Thangaratinam Shakila , We Redman Charles The Delphi technique. The Obstetrician& Gynaecologist. 2005;7(120-125).
oprational indicators[in Persian]. Kerman university of medical science; 2012 [updated 2012; cited 2012 03/01]; Available from: http://cg.kmu.ac.ir/Images/UserUpload/Document/CG/HakemiyatBalini/Amozesh/shakheshayeamalkardi.doc.
Steven Lewis. Patient-Centered Care: An Introduction to What It Is and How to Achieve It. A Discussion Paper for the Saskatchewan Ministry of Health. Saskatchewan Ministry of Health; 2009.
Gabel Jon R, T. Lo Sasso Anthony, Rice Thomas. Consumer-Driven Health Plans: AreThey More Than Talk Now? Health Affairs. 2002;Web Exclusive:395-407.
Lewis S. Patient-Centered Care: An Introduction to What It Is and How to Achieve It. Saskatchewan Ministry of Health; 2009.
Advancing the Practice of Patient- and Family-Centered Care: How to Get Started. Bethesda,Maryland: Institute for Patient- and Family-Centered Care; 2011.
Emami Razavi Hassan, Gholam Reza Masumi, Jalili Mohammad, Siahtir Maryam. Emergency Department indicators(1). Ministery of health and medical education; 2011.
Karen Luxford, Donella Piper, Nicola Dunbar, Naomi Poole. PATIENT-CENTRED CARE:IMPROVING QUALITY AND SAFETY BY FOCUSING CARE ON PATIENTSAND CONSUMERS. Australian Commission on Safety and Quality in Health Care; 2010. p. 30.
BABIARZ J. Improving patient satisfaction through employee satisfaction: focus on nursing satisfaction with support services. Hospital management and development: patient care. 2009.
Mariëlle Ouwens, Rosella Hermens, Marlies Hulscher, Vonk-Okhuijsen S, Tjan-Heijnen V, René Termeer, et al. Development of indicators for patient-centred cancer care. Support Care Cancer. 2010;18:121-30.
hospital indicators[in Persian]. Shiraz-Iran: Shiraz university of medical science; 2012 [updated 2012; cited 2012 03/01]; Available from: http://darman.sums.ac.ir/planing/images/planing/file/sh.xls.
National Minimum Standards and Regulations for Independent Health Care. In: Department of health The Stationery Office, editor. London: Secretary of State for
involving patients and the public in health care, a discussion document. In: department of Human Services, editor. london; 2001.
Pan-Canadian Primary Health Care Indicators. Canadian Institute for Health Information; 2006.
Virginia Minogue , Barrie Holt, Kate Karban, Simon Gelsthorpe, Sarah Firth, Ramsay T. Service User and Carer Involvement in Mental Health Education, Training and Research – ALiterature Review. Mental Health and Learning Disabilities Research and Practice. 2009: 211 - 27.
Ron Schellings, Brigitte AB Essers, Alfons G Kessels, Florian Brunner, Tijmen van de Ven, Robben PB. The development of quality indicators in mental healthcare: a discrete choice experiment. BMC Psychiatry. 2012;12(103).
NHS Executive. Patient partnership: Building a collaborative strategy. Leeds: NHS Executive.; 1996.
Standards for Patient-Centered Medical Home (PCMH). Washington, DC National Committee for Quality Assurance (NCQA); 2011.
Tere Dawson, Lauren Cordwell, Tony McBride, Child J. recommended suite of consumer, carer and community participation standards for victorian public health services-Final report. Health Issues Centre; 2009.
Doing it whit us not for us: strategic direction 2010-13. Participation in your health service system: Victorian consumers, carers, and community working together with their health services and the Department of Health. . Victorian Government, Department of Health, Melbourne,Victoria: Hospital and Health Service Performance Division; 2011.
Ann-Christine Andersson, Anna Olheden. Patient participation in quality improvement: managers’ opinions of patients as resources. Journal of Clinical Nursing,. 2012;21:3590-3.
Bethesda. Advancing the Practice of Patient- and Fa mily-Centered Care: How to Get Started. Institute for Patient- and Family-Centered Care; 2011.
Framework for Public & Service User Involvement in Health and Social Care Regulation in Ireland. Healthcare and social care regulation forum, ; 2009.
cancer program standards 2012:Ensuring Patient-Centered Care. chicago: American college of surgeons; 2011.
Lindsay Mitchell. A PPI Good Practice Handbook for UK Health Care Regulators. london; 2010.
Gabel J, R. A, T. Lo Sasso, T. Rice. Consumer-Driven Health Plans: AreThey More Than Talk Now? Health Affairs. 2002.
Mike J Crawford, Deborah Rutter, Catherine Manley, Timothy Weaver, Kamaldeep Bhui, Naomi Fulop, et al. Systematic review of involving patients in the planning and development of health care. BMJ 2002;325.
How to develop a community participation plan, Participation in your health service system. Victorian consumers, carers, and the community working, together with their health services; 2006.
UK Parliament. Learning from Bristol: The report of the public inquiry into children’s heart surgery at the Bristol Royal Infirmary 1984- 1995. London: The Stationery Office.; 2001.
Indicators for quality improvement,full indicator list. england: The health and social care information center, NHS; 2009.
Ann-Christine Andersson, Anna Olheden. Patient participation in quality improvement: managers’ opinions of patients as resources. Journal of Clinical Nursing. 2012;21:3590-3.
Anthony Burrell, et al. Clinical Indicator User Manual 2012, Intensive Care version 4. The Australian Council on Healthcare Standards; 2012.
Uphoff Eleonora, Wennekes Lianne, Punt Cornelis, Grol Richard P, Wollersheim Hub, Hermens Rosella, et al. Development of Generic Quality Indicators for Patient-Centered Cancer Care by Using a RAND Modified Delphi Method. Cancer Nursing. 2012;35(1):29-37.
Participation indicators, Participation in your health service system. In: Department of Human Services, editor.: Victorian consumers, carers and the community working together with their health service; 2005.
National Consumer and Carer Forum. Consumer and Carer Participation Policy - A Framework for the Mental Health Sector. National Consumer and Carer Forum of Australia; 2005.
International Alliance of Patients’ Organizations. Declaration on Patient-Centred Healthcare. 2006 [updated 2006; cited 2012 03/10]; Available from: www.patientsorganizations.org/declaration.