Construction and validation of a laparoscopic skills assessment system based on entrustable professional activities

Liang Yao; Zhao Baiwei; Li Tang; Tan Yubao; Huang Wan; Zhang Kunsong; Kuang Ming

doi:10.3760/cma.j.cn116021-20250211-02055

您当前的位置：

首页 >

文章列表页 >

Construction and validation of a laparoscopic skills assessment system based on entrustable professional activities

Research on entrustable professional activities | 更新时间：2025-07-01

- Construction and validation of a laparoscopic skills assessment system based on entrustable professional activities
- Chinese Journal of Medical Education Research Vol. 24, Issue 6, Pages: 751-756(2025)
- 作者机构：
  
  1.华南恶性肿瘤防治全国重点实验室/广东省恶性肿瘤临床医学研究中心/中山大学肿瘤防治中心胃外科，广州 510060
  2.中山大学肿瘤防治中心科教处临床技能培训中心，广州 510060
  3.中山大学附属第一医院肝胆胰外科中心，广州 510080
  4.中山大学中山医学院，广州 510080
- 作者简介：
  
  Kuang Ming, Email: kuangmingsysu@163.com
- 基金信息：
  
  Education Innovation Program of China Medical Board(22-493)
- DOI：10.3760/cma.j.cn116021-20250211-02055
  CLC： R-615
- Received：11 February 2025，
  
  Published：20 June 2025
- 稿件说明：
移动端阅览
梁垚, 赵百伟, 李瑭, 等. 基于置信职业行为的腹腔镜技能考评体系构建与验证[J]. 中华医学教育探索杂志, 2025, 24(6): 751-756.

Liang Yao, Zhao Baiwei, Li Tang, et al. Construction and validation of a laparoscopic skills assessment system based on entrustable professional activities[J]. Chinese journal of medical education research, 2025, 24(6): 751-756.
梁垚, 赵百伟, 李瑭, 等. 基于置信职业行为的腹腔镜技能考评体系构建与验证[J]. 中华医学教育探索杂志, 2025, 24(6): 751-756. DOI： 10.3760/cma.j.cn116021-20250211-02055.

Liang Yao, Zhao Baiwei, Li Tang, et al. Construction and validation of a laparoscopic skills assessment system based on entrustable professional activities[J]. Chinese journal of medical education research, 2025, 24(6): 751-756. DOI： 10.3760/cma.j.cn116021-20250211-02055.

摘要

目的

基于置信职业行为（entrustable professional activities，EPAs），构建并验证胜任力导向的腹腔镜技能ECM考评体系（ECM system for assessment of laparoscopic skills，ESALS）。

方法

成立由5家医疗机构15名成员组成的研究小组，以腹腔镜技能阶段式培训课程（staged training and assessment of laparoscopic skills，STALS）为EPAs蓝本，综合运用范围综述、行为事件访谈和K-J法构建ESALS。对49名学员和10名专科医师（包括5名新手和5名专家）分别进行基础技能和高级技能评价，并与基础腹腔镜技能训练评估（training and assessment of basic laparoscopic techniques，TABLT）和全球腹腔镜手术技能评估（global operative assessment of laparoscopic skills，GOALS）等评估工具对比分析。运用SPSS 23.0软件进行Mann-Whitney

检验，相关性分析采用Spearman系数。

结果

纳入13篇文献，访谈10名高级职称外科医师，构建了包含10项置信行为、8个维度胜任力特征和5个置信级别的ESALS。基础技能评价中，ESALS与TABLT评分显著正相关（

=0.881，

0.001）；高级技能评价中，新手组与专家组在ESALS各项胜任力评分上差异有统计学意义（

0.05），但GOALS评分显示两组在组织处理能力方面差异无统计学意义。

结论

ESALS评价全面、标准精细、反馈精准，评估效能不劣于经典工具。未来需扩大样本量验证其普适性，并开发电子化工具提升应用效率。

Abstract

Objective

To construct and validate a competency-oriented entrustable professional activities (EPAs)-Competency-Milestones system for assessment of laparoscopic skills (ESALS).

Methods

A research team composed of 15 members from five medical institutions was established. Taking the Staged Training and Assessment of Laparoscopic Skills program as the basis for EPAs

ESALS was constructed through scoping review and behavioral event interviews and the use of the Kawakita Jiro method. ESALS was applied to evaluate 49 trainees and 10 specialists (including 5 novices and 5 experts) on basic and advanced laparoscopic skills

respectively

in comparison with two other assessment tools—the Training and Assessment of Basic Laparoscopic Techniques (TABLT) and the Global Operative Assessment of Laparoscopic Skills (GOALS). Perform Mann Whitney U test using SPSS 23.0 software

and use Spearman coefficient for correlation analysis.

Results

Through reviewing 13 literuature articles and interviewing 10 senior sur

geons

the ESALS was developed

comprising 10 EPAs

8 dimensions of competency characteristics

and 5 entrustable levels. In the basic skills evaluation

the ESALS score was significantly positively correlated with the TABLT score (

=0.881

0.001). In the advanced skills evaluation

significant differences were observed between the novice and expert groups in all the ESALS competency scores (all

0.05)

while no difference was detected in the GOALS score of tissue handling ability.

Conclusions

ESALS provides comprehensive evaluation

detailed standards

and precise feedback

with comparable efficacy to conventional tools. Future work should focus on expanding sample size to verify its generalizability and developing an electronic tool to enhance application efficiency.

关键词

Keywords

references

De Win G , Van Bruwaene S , Kulkarni J , et al . An evidence-based laparoscopic simulation curriculum shortens the clinical learning curve and reduces surgical adverse events [J ] . Adv Med Educ Pract , 2016 , 7 : 357 - 370 . DOI: 10.2147/AMEP.S102000 http://dx.doi.org/10.2147/AMEP.S102000 .

Wagner M , Gomez-Garibello C , Seymour N , et al . An argument-based validation study of the fundamentals of laparoscopic surgery (FLS) program [J ] . Surg Endosc , 2023 , 37 ( 7 ): 5351 - 5357 . DOI: 10.1007/s00464-023-10020-1 http://dx.doi.org/10.1007/s00464-023-10020-1 .

Liang Y , Huang H , Tan YB , et al . Construction and implementation of a laparoscopic skill training course based on a smartphone application and virtual reality [J ] . BMC Med Educ , 2024 , 24 ( 1 ): 1111 . DOI: 10.1186/s12909-024-06066-x http://dx.doi.org/10.1186/s12909-024-06066-x .

Thinggaard E , Bjerrum F , Strandbygaard J , et al . Validity of a cross-specialty test in basic laparoscopic techniques (TABLT) [J ] . Br J Surg , 2015 , 102 ( 9 ): 1106 - 1113 . DOI: 10.1002/bjs.9857 http://dx.doi.org/10.1002/bjs.9857 .

Vassiliou MC , Feldman LS , Andrew CG , et al . A global assessment tool for evaluation of intraoperative laparoscopic skills [J ] . Am J Surg , 2005 , 190 ( 1 ): 107 - 113 . DOI: 10.1016/j.amjsurg.2005.04.004 http://dx.doi.org/10.1016/j.amjsurg.2005.04.004 .

Seymour NE , Nepomnayshy D , De S , et al . What are essential laparoscopic skills these days? Results of the SAGES Fundamentals of Laparoscopic Surgery (FLS) Committee technical skills survey [J ] . Surg Endosc , 2023 , 37 ( 10 ): 7676 - 7685 . DOI: 10.1007/s00464-023-10238-z http://dx.doi.org/10.1007/s00464-023-10238-z .

ten Cate O . Entrustability of professional activities and competency-based training [J ] . Med Educ , 2005 , 39 ( 12 ): 1176 - 1177 . DOI: 10.1111/j.1365-2929.2005.02341.x http://dx.doi.org/10.1111/j.1365-2929.2005.02341.x .

Torralba KD , Jose D , Katz JD . Competency-based medical education for the clinician-educator: the coming of milestones version 2 [J ] . Clin Rheumatol , 2020 , 39 ( 6 ): 1719 - 1723 . DOI: 10.1007/s10067-020-04942-7 http://dx.doi.org/10.1007/s10067-020-04942-7 .

齐心 . 置信职业行为的演进、内涵与实践 [J ] . 中华医学教育探索杂志， 2024 ， 23 （ 9 ）： 1153 - 1160 . DOI: 10.3760/cma.j.cn116021-20240201-01830 http://dx.doi.org/10.3760/cma.j.cn116021-20240201-01830 .

Arksey H , O'Malley L . Scoping studies: towards a methodological framework [J ] . Int J Soc Res Methodol , 2005 , 8 ( 1 ): 19 - 32 . DOI: 10.1080/1364557032000119616 http://dx.doi.org/10.1080/1364557032000119616 .

乔丽花 . 运用行为事件访谈法提炼顶尖医师胜任力要素的研究 [D ] . 北京：北京中医药大学， 2016 .

张阳 . 中国临床医学专业本科毕业生岗位胜任力模型构建与现状调查研究 [D ] . 沈阳：中国医科大学， 2019 . DOI: 10.27652/d.cnki.gzyku.2019.000198 http://dx.doi.org/10.27652/d.cnki.gzyku.2019.000198 .

刘明 . Colaizzi七个步骤在现象学研究资料分析中的应用 [J ] . 护理学杂志， 2019 ， 34 （ 11 ）： 90 - 92 . DOI: 10.3870/j.issn.1001-4152.2019.11.090 http://dx.doi.org/10.3870/j.issn.1001-4152.2019.11.090 .

王郁，鄢晓丽，张俊辉，等 . KJ法在应届医学研究生压力质性研究中的应用 [J ] . 检验医学与临床， 2020 ， 17 （ 11 ）： 1509 - 1511， 1514 . DOI: 10.3969/j.issn.1672-9455.2020.11.011 http://dx.doi.org/10.3969/j.issn.1672-9455.2020.11.011 .

Lerner V , DeStephano C , Ulrich A , et al . A systematic review of validity evidence for the fundamentals of laparoscopic surgery examination in gynecology [J ] . J Minim Invasive Gynecol , 2021 , 28 ( 7 ): 1313 - 1324 . DOI: 10.1016/j.jmig.2021.04.010 http://dx.doi.org/10.1016/j.jmig.2021.04.010 .

胡建昆，周总光，杨昆，等 . 中国腹腔镜技术考核与评价标准体系（CLSTA） [J ] . 中国实用外科杂志， 2021 ， 41 （ 9 ）： 993 - 996 . DOI: 10.19538/j.cjps.issn1005-2208.2021.09.02 http://dx.doi.org/10.19538/j.cjps.issn1005-2208.2021.09.02 .

Tricard T , Pan J , Song Q , et al . Validation of the objective structured assessment of technical skill (OSATS) in China [J ] . J Surg Educ , 2025 , 82 ( 1 ): 103304 . DOI: 10.1016/j.jsurg.2024.103304 http://dx.doi.org/10.1016/j.jsurg.2024.103304 .

张波，孙博，梁宗康，等 . 腹腔镜手术技能评价工具的发展与现状 [J ] . 腹部外科， 2024 ， 37 （ 5 ）： 384 - 391， 395 . DOI: 10.3969/j.issn.1003-5591.2024.05.014 http://dx.doi.org/10.3969/j.issn.1003-5591.2024.05.014 .

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Research on the development of entrustable professional activity indicators for residents in China: a systematic review

基于置信职业行为构建胜任力导向的肿瘤学实习考评体系

Competency evaluation of dermatology physicians receiving residency training based on entrustable professional activities

Construction of an assessment tool for laparoscopic left lateral sectionectomy skills based on the Delphi-AHP method

The evolution, connotation, and practice of entrustable professional activities

Related Author

Yao Weiwu

Fan Xiaoyu

Shi Dandan

Zhu Caisong

Xiao Zhengguang

Min Qinghua

Lü Liangjing

Xing Yue

Related Institution

Academic Affairs Office, Shanghai Jiao Tong University School of Medicine

Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine

Editorial Office of Journal of Diagnostics Concepts & Practice, Department of Science and Technology Development, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine

Dean's Office, Tongren Hospital, Shanghai Jiao Tong University School of Medicine

Department of Imaging, Tongren Hospital, Shanghai Jiao Tong University School of Medicine

⁰