Protocol for Evaluation of eLearning of Quality Improvement Methods

Quality Improvement Clinical Trial

Official title:

Evaluation of eLearning of Quality Improvement Methods

Clinical Trial Details — Status: Completed

Administrative data

• NCT number: NCT02907541
• Other study ID #: QI4U
• Status: Completed
• Phase: N/A
• Start date: January 2017
• Est. completion date: December 2018

Study information

• Verified date: January 2019
• Source: Chelsea and Westminster NHS Foundation Trust
• Contact: n/a
• Is FDA regulated: No
• Study type: Interventional

Clinical Trial Summary

This study evaluates the use of eLearning of quality improvement methods. Participants who use eLearning only, facilitated learning only and a combination of eLearning and facilitated learning will complete questionnaires and be interviewed to establish the effect of eLearning of quality improvement methods to improve knowledge, change in behaviour and impact on healthcare services for better patient care.

Description:

Quality improvement (QI) is an increasingly important element of delivering health care. Learning and feeling confident in using QI methods is an essential part of healthcare practice. eLearning is a cost effective way of capacity building to a large cohort of health care professionals and service users. National Institute of Health Research Collaboration for Leadership in Health Research and Care Northwest London has developed a suite of eLearning modules (QI4U) to support an introductory understanding of technical aspects of QI. This protocol describes a trial to evaluate the experience of learning, knowledge gained, change in behaviour, and impact of eLearning of QI methods.

Participants will belong to one of three Groups of learners over the course of 12 months:

learners using only QI4U (group 1); people using only facilitated learning (Group 2); and learners using a combination of QI4U and facilitated learning (Group 3). The Kirkpatrick model will be used to evaluate the learning. The primary outcome of interest will be transfer of knowledge gained from learning into clinical practice for service improvement by individuals (level 3). Secondary outcomes will include reaction or experience of QI4U, knowledge gained, and the results or impact of learning through QI4U on service improvement (levels 1, 2 and 4).

Transfer of knowledge into clinical practice will be assessed by interviews with individual learners. Experience of eLearning and knowledge gained will be assessed using feedback forms, questionnaires, time spent doing QI4U and reflective logs. Impact will be assessed by interviews with organisational leads with a high prevalence of QI4U learners.

This study will provide evidence on the effectiveness of using eLearning as a means for learning QI. It will serve to evaluate learners' experience of using eLearning and the impact of various training methods within the context of learning QI.

Recruitment information / eligibility

• Status: Completed
• Enrollment: 250
• Est. completion date: December 2018
• Est. primary completion date: November 2018
• Accepts healthy volunteers: Accepts Healthy Volunteers
• Gender: All
• Age group: 18 Years and older

Eligibility

Inclusion Criteria:

• clinicians, managers, commissioners, service users and carers, and researchers who have an interest in learning QI methods.

Exclusion Criteria:

• No exclusion criteria

Related Conditions & MeSH terms

• eLearning
• Learning
• Quality Improvement

Intervention

Other:
• QI4U learning
Learners will have access to 8 QI methods modules on QI4U
• Facilitated learning
Learners will have access to quarterly learning events and bespoke training on QI methods through facilitated peer-to-peer learning workshops
• QI4U and Facilitated learning
Learners will have access to the 8 QI modules on QI4U and attend quarterly learning events and bespoke training on QI methods through peer-to-peer learning workshops

Locations

Country	Name	City	State
United Kingdom	Nihr Clahrc Nwl	London

Sponsors (3)

Lead Sponsor	Collaborator
Chelsea and Westminster NHS Foundation Trust	National Institute for Health Research, United Kingdom, OCB Media

Country where clinical trial is conducted

United Kingdom, 

References & Publications (10)

Batalden P, Davidoff F. Teaching quality improvement: the devil is in the details. JAMA. 2007 Sep 5;298(9):1059-61. — View Citation

Boonyasai RT, Windish DM, Chakraborti C, Feldman LS, Rubin HR, Bass EB. Effectiveness of teaching quality improvement to clinicians: a systematic review. JAMA. 2007 Sep 5;298(9):1023-37. Review. — View Citation

George PP, Papachristou N, Belisario JM, Wang W, Wark PA, Cotic Z, Rasmussen K, Sluiter R, Riboli-Sasco E, Tudor Car L, Musulanov EM, Molina JA, Heng BH, Zhang Y, Wheeler EL, Al Shorbaji N, Majeed A, Car J. Online eLearning for undergraduates in health professions: A systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health. 2014 Jun;4(1):010406. doi: 10.7189/jogh.04.010406. — View Citation

Glasziou P, Ogrinc G, Goodman S. Can evidence-based medicine and clinical quality improvement learn from each other? BMJ Qual Saf. 2011 Apr;20 Suppl 1:i13-17. doi: 10.1136/bmjqs.2010.046524. — View Citation

Mann KJ, Craig MS, Moses JM. Quality improvement educational practices in pediatric residency programs: survey of pediatric program directors. Acad Pediatr. 2014 Jan-Feb;14(1):23-8. doi: 10.1016/j.acap.2012.11.003. — View Citation

Ogrinc G, Headrick LA, Morrison LJ, Foster T. Teaching and assessing resident competence in practice-based learning and improvement. J Gen Intern Med. 2004 May;19(5 Pt 2):496-500. — View Citation

Singh MK, Ogrinc G, Cox KR, Dolansky M, Brandt J, Morrison LJ, Harwood B, Petroski G, West A, Headrick LA. The Quality Improvement Knowledge Application Tool Revised (QIKAT-R). Acad Med. 2014 Oct;89(10):1386-91. doi: 10.1097/ACM.0000000000000456. — View Citation

Wang Y-S, Wang H-Y, Shee DY. Measuring e-learning systems success in an organizational context: Scale development and validation. Comput. Human Behav. 2007;23:1792-808.

Wong BM, Etchells EE, Kuper A, Levinson W, Shojania KG. Teaching quality improvement and patient safety to trainees: a systematic review. Acad Med. 2010 Sep;85(9):1425-39. doi: 10.1097/ACM.0b013e3181e2d0c6. Review. — View Citation

Wutoh R, Boren SA, Balas EA. eLearning: a review of Internet-based continuing medical education. J Contin Educ Health Prof. 2004 Winter;24(1):20-30. Review. — View Citation

Outcome

Type	Measure	Description	Time frame	Safety issue
Primary	Transfer of knowledge of QI method into clinical practice	Change in behaviour that is a result of learning of QI methods into service improvement projects	6-8 months
Secondary	Experience of learning measured using eLearning systems success construct questionnaire	The investigators will use the eLearning systems success construct questionnaire. This is a 36 item survey questionnaire that includes system quality, user satisfaction, net benefits and information quality. Survey items will be rated using a seven-point Likert scale indicating the degree to which respondents agree or disagree.	Immediately after learning.
Secondary	Knowledge gained measured through the knowledge of QI methods questionnaire	Knowledge of QI methods will be assessed through a question bank of multiple choice questions, the order of the questions are presented in random and learners' knowledge is scored as a percentage of correct answers.	pre learning, immediately after learning and 6-8 months after learning.
Secondary	Impact of QI4U learning	Impact of QI4U on QI through interviews with executives from trusts that have large cohorts of learners using QI4U	6-8 months

External Links

•   Academy of Medical Royal Colleges: Quality Improvement - training for better outcomes report
•   Habits of an improver report
•   Mapping research capacity activities in the CLAHRC community report
•   QI4U website