An exploration of training using the CUSUM method for depicting learning curves in simulation-based training for fiberoptic bronchoscopy

Zhang Ningchen; Sun Chen; Tian Yuan; Yu Chunhua

doi:10.3760/cma.j.cn116021-20240212-01910

您当前的位置：

首页 >

文章列表页 >

An exploration of training using the CUSUM method for depicting learning curves in simulation-based training for fiberoptic bronchoscopy

PUMC Column on Exploring Postgraduate Education in Anesthesiology | 更新时间：2024-12-26

- An exploration of training using the CUSUM method for depicting learning curves in simulation-based training for fiberoptic bronchoscopy
- Chinese Journal of Medical Education Research Vol. 23, Issue 12, Pages: 1618-1624(2024)
- 作者机构：
  
  中国医学科学院　北京协和医学院　北京协和医院麻醉科，北京　100730
- 作者简介：
  
  Yu Chunhua, Email: yuchh@pumch.cn
- 基金信息：
  
  National High Level Hospital Clinical Research Funding(2022-PUMCH-A-148)
- DOI：10.3760/cma.j.cn116021-20240212-01910
  CLC： R614
- Published：20 December 2024，
  
  Received：12 February 2024，
- 稿件说明：
移动端阅览
张宁晨, 孙琛, 田园, 等. 使用累积和分析法描绘学习曲线在纤支镜模拟教学中的培训探索[J]. 中华医学教育探索杂志, 2024, 23(12): 1618-1624.

ZHANG NINGCHEN, SUN CHEN, TIAN YUAN, et al. An exploration of training using the CUSUM method for depicting learning curves in simulation-based training for fiberoptic bronchoscopy. [J]. Chinese journal of medical education research, 2024, 23(12): 1618-1624.
张宁晨, 孙琛, 田园, 等. 使用累积和分析法描绘学习曲线在纤支镜模拟教学中的培训探索[J]. 中华医学教育探索杂志, 2024, 23(12): 1618-1624. DOI： 10.3760/cma.j.cn116021-20240212-01910.

ZHANG NINGCHEN, SUN CHEN, TIAN YUAN, et al. An exploration of training using the CUSUM method for depicting learning curves in simulation-based training for fiberoptic bronchoscopy. [J]. Chinese journal of medical education research, 2024, 23(12): 1618-1624. DOI： 10.3760/cma.j.cn116021-20240212-01910.

摘要

目的

分析并描绘麻醉科住院医师通过纤支镜定位技能的模拟训练学习曲线，探讨无操作经验的住院医师在接受模拟训练前后技能提升的情况。

方法

记录2022年3月至5月期间，北京协和医院麻醉科的30名无纤支镜操作经验的住院医师，通过模拟器进行纤

支镜定位技能的300次模拟训练学习经历。采用累积和分析法（cumulative sum analysis，CUSUM）来描绘学习曲线，旨在比较受试者培训前后在首次图像显示完成时间及完成全部6个图像所需时间上的变化，并探讨初步掌握该技能所需的操作例数。使用统计分析软件R（版本4.2.2）来对数据进行分析。计量资料用（均数±标准差）表示，采用Shapiro-Wilk法进行正态性检验。若数据服从正态分布，则使用独立样本

检验进行组间比较；服从偏态分布的计量资料组间比较采用Mann-Whitney

检验。学习曲线的拟合则通过CUSUM法完成。所有统计检验均设定为双侧检验，检验水准

=0.05。

结果

在完成首个图像显示时间方面，达到CUSUM分界次数后，有5名受试者差异无统计学意义（

0.05）。结合原始数据及CUSUM曲线分析，原因可能是其中4人在分界次数前后的操作时间波动较大，导致在分界次数上差异无统计意义；另外1人则可能因为在前3~4例中的学习时间较短，导致经过培训后提升不明显。在完成全部操作时间方面，达到CUSUM分界次数后，有4名受试者同样差异无统计学意义（

0.05）。结合原始数据及CUSUM曲线分析，原因可能是其中3人在分界次数前后的操作时间波动较大，导致在分界次数上差异无统计学意义；另外1人也同样考虑在前3~4例中的学习时间较短，导致尽管经过培训但提升不明显。

结论

综合考虑完成首个图像显示所需的时间及完成全部6个图像观察所需时间的变化，在经过模拟器进行纤支镜模拟训练后，无经验的麻醉科住院医师至少需进行4次操作，方可初步掌握纤支镜操作技能。

Abstract

Objective

To analyze and describe the learning curve of resident physicians in the Department of Anesthesiology during simulation-based training for positioning with fiberoptic bronchoscopy

and evaluate the improvement of skills after the simulation-based training of residents without operating experience.

Methods

The learning records of 300 training sessions using a simulator for bronchoscopy-based positioning were retrieved from March to May 2022 for 30 residents without experience in bronchoscopy in the Department of Anesthesiology of Peking Union Medical College Hospital. Cumulative sum analysis (CUSUM) was employed to depict the learning curve

aiming to compare changes in the time required to display the first image and to complete all six images before and after training

as well as to explore the number of operations necessary for the initial acquisition of this skill. Data analysis was performed using R statistical software (version 4.2.2). For quantitative data

the Shapiro-Wilk test was used to assess normality

and the data were expressed as mean

± standard deviation. If the data followed a normal distribution

an independent samples

-test was used for comparisons between groups. For data that followed a skewed distribution

the Mann-Whitney

test was employed for comparisons between groups. The learning curve was fitted using the CUSUM method. All statistical tests were two-sided with a significance level of 0.05.

Results

In terms of the time required for completing the first image display

after reaching the CUSUM inflection point of operation times

five subjects did not show a significant difference (

0.05). Based on the analysis of the raw data and the CUSUM curve

the observed insignificant difference may be attributed to the significant fluctuations in operating times for four individuals around the inflection point

resulting in no statistically significant differences in the operation times at the inflection point. Additionally

the fifth individual exhibited insignificant improvement following training due to relatively short learning time during the initial three to four operations. In terms of time to complete all operations

after reaching the CUSUM inflection point of operation times

four subjects did not show a significant difference (

0.05). Based on the analysis of the raw data and the CUSUM curve

the insignificant difference may be attributed to the significant fluctuations in operating times for three individuals around the inflection point

resulting in no statistically significant differences in the operation times at the inflection point. Moreover

the fourth individual exhibited insignificant improvement following training due to relatively short learning time during the initial three to four operations.

Conclusions

Considering the variations in the time required to complete the first image display and the overall time required to observe all six images

inexperienced anesthesiology residents can initially acquire skills in bronchoscopy after at least four operations during simulation-based training for fiberoptic bronchoscopy.

关键词

学习曲线模拟教学纤支镜操作气道管理

Keywords

Learning curveSimulation-based teachingBronchoscopy operationAirway management

references

Marsland C, Larsen P, Segal R, et al. Proficient manipulation of fibreoptic bronchoscope to carina by novices on first clinical attempt after specialized bench practice [J]. Br J Anaesth, 2010, 104(3): 375-381. DOI: 10.1093/bja/aeq005http://dx.doi.org/10.1093/bja/aeq005.

Ernst A, Wahidi MM, Read CA, et al. Adult bronchoscopy training: current state and suggestions for the future: chest expert panel report [J]. Chest, 2015, 148(2): 321-332. DOI: 10.1378/chest.14-0678http://dx.doi.org/10.1378/chest.14-0678.

Gopal M, Skobodzinski AA, Sterbling HM, et al. Bronchoscopy simulation training as a tool in medical school education [J]. Ann Thorac Surg, 2018, 106(1): 280-286. DOI: 10.1016/j.athoracsur.2018.02.011http://dx.doi.org/10.1016/j.athoracsur.2018.02.011.

Stather DR, MacEachern P, Chee A, et al. Trainee impact on procedural complications: an analysis of 967 consecutive flexible bronchoscopy procedures in an interventional pulmonology practice [J]. Respiration, 2013, 85(5): 422-428. DOI: 10.1159/000346650http://dx.doi.org/10.1159/000346650.

Ouellette DR. The safety of bronchoscopy in a pulmonary fellowship program [J]. Chest, 2006, 130(4): 1185-1190. DOI: 10.1378/chest.130.4.1185http://dx.doi.org/10.1378/chest.130.4.1185.

Kennedy CC, Maldonado F, Cook DA. Simulation-based bronchoscopy training systematic review and meta-analysis [J]. Chest, 2013, 144(1): 183-192. DOI: 10.1378/chest.12-1786http://dx.doi.org/10.1378/chest.12-1786.

Kennedy CC, Cannon EK, Warner DO, et al. Advanced airway management simulation training in medical education: a systematic review and meta-analysis [J]. Crit Care Med, 2014, 42(1): 169-178. DOI: 10.1097/CCM.0b013e31829a721fhttp://dx.doi.org/10.1097/CCM.0b013e31829a721f.

Baker PA, Weller JM, Baker MJ, et al. Evaluating the ORSIM® simulator for assessment of anaesthetists' skills in flexible bronchoscopy: aspects of validity and reliability [J]. Br J Anaesth, 2016, 117(Suppl 1): i87-i91. DOI: 10.1093/bja/aew059http://dx.doi.org/10.1093/bja/aew059.

Dalal PG, Dalal GB, Pott L, et al. Learning curves of novice anesthesiology residents performing simulated fibreoptic upper airway endoscopy [J]. Can J Anaesth, 2011, 58(9): 802-809. DOI: 10.1007/s12630-011-9542-2http://dx.doi.org/10.1007/s12630-011-9542-2.

Melvin MT, Siddiqui NT, Wild E, et al. Achieving competency in fiber-optic intubation among resident physicians after higher- versus lower-fidelity task training: a randomized controlled study [J]. Anesth Analg, 2023, 137(1): 200-208. DOI: 10.1213/ANE.0000000000006283http://dx.doi.org/10.1213/ANE.0000000000006283.

Zhu D, Hong P, Zhu J, et al. Cumulative sum analysis of the learning curve for modified retroperitoneoscopic living-donor nephrectomy [J]. Urol Int, 2018, 101(4): 425-436. DOI: 10.1159/000493765http://dx.doi.org/10.1159/000493765.

Noyez L. Cumulative sum analysis: a simple and practical tool for monitoring and auditing clinical performance [J]. Health Care: Current Reviews, 2014, 2(1): 113e5. DOI: 10.4172/hccr.1000113http://dx.doi.org/10.4172/hccr.1000113.

Johnson C, Roberts JT. Clinical competence in the performance of fiberoptic laryngoscopy and endotracheal intubation: a study of resident instruction [J]. J Clin Anesth, 1989, 1(5): 344-349. DOI: 10.1016/0952-8180(89)90073-1http://dx.doi.org/10.1016/0952-8180(89)90073-1.

Latif RK, Bautista A, Duan X, et al. Teaching basic fiberoptic intubation skills in a simulator: initial learning and skills decay [J]. J Anesth, 2016, 30(1): 12-19. DOI: 10.1007/s00540-015-2091-zhttp://dx.doi.org/10.1007/s00540-015-2091-z.

Jiang G, Chen H, Wang S, et al. Learning curves and long-term outcome of simulation-based thoracentesis training for medical students [J]. BMC Med Educ, 2011, 11: 39. DOI: 10.1186/1472-6920-11-39http://dx.doi.org/10.1186/1472-6920-11-39.

Parotto M, Jiansen JQ, AboTaiban A, et al. Evaluation of a low-cost, 3D-printed model for bronchoscopy training [J]. Anaesthesiol Intensive Ther, 2017, 49(3): 189-197. DOI: 10.5603/AIT.a2017.0035http://dx.doi.org/10.5603/AIT.a2017.0035.

姜柏林，赵莹，鞠辉，等. 高仿真模拟训练在纤维支气管镜插管教学中的应用及学习曲线研究[J]. 中华医学教育杂志， 2016， 36（1）： 93-97. DOI: 10.3760/cma.j.issn.1673-677X.2016.01.025http://dx.doi.org/10.3760/cma.j.issn.1673-677X.2016.01.025.

姜柏林，鞠辉，姚兰，等. 虚拟现实模拟装置和模拟气道在麻醉科纤支镜插管培训中的应用比较[J]. 中华医学教育探索杂志， 2016， 15（3）： 291-295. DOI: 10.3760/cma.j.issn.2095-1485.2016.03.019http://dx.doi.org/10.3760/cma.j.issn.2095-1485.2016.03.019.

陈昌林，李洪琼，王艺铮，等. 虚拟现实模拟装置在纤支镜插管培训中的应用[J]. 继续医学教育， 2023， 37（6）： 73-76. DOI: 10.3969/j.issn.1004-6763.2023.06.019http://dx.doi.org/10.3969/j.issn.1004-6763.2023.06.019.

Medford AR. Learning curves for bronchoscopy and simulation [J]. Clin Med, 2013, 13(4): 418-419. DOI: 10.7861/clinmedicine.13-4-418http://dx.doi.org/10.7861/clinmedicine.13-4-418.

McSparron JI, Michaud GC, Gordan PL, et al. Simulation for skills-based education in pulmonary and critical care medicine [J]. Ann Am Thorac Soc, 2015, 12(4): 579-586. DOI: 10.1513/AnnalsATS.201410-461ARhttp://dx.doi.org/10.1513/AnnalsATS.201410-461AR.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Effectiveness of distance interactive learning in image recognition and learning intentions for ultrasound airway management

A study of design of a process indicator for anesthesia induction and its feasibility in self-directed simulation-based teaching

The role of virtual reality simulation training in laparoscopic skills training for young physicians

Application of transesophageal echocardiography simulation training system in standardized training and teaching of anesthesia residents

Study on the development and practice of East Airway Simulation Training Course

Related Author

Yu Chunhua

Zhang Yuelun

Lang Jiaxin

Tian Yuan

Chen Shaohui

Zhang Xiuhua

Zhu Bo

Te Rigele

Related Institution

Medical Science Research Center, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences

Department of Hepatobiliary Surgery, Zhengzhou Central Hospital Affiliated to Zhengzhou University

Department of Basic Disciplines, Henan Geology Mineral College

Science and Education Section, Zhengzhou Central Hospital Affiliated to Zhengzhou University

Department of Anesthesia and Perioperative Medicine, The First Affiliated Hospital of Nanjing Medical University

⁰