Abstract
Background
Mastering laparoscopic surgical skills requires considerable time and effort. The Virtual Basic Laparoscopic Skill Trainer (VBLaST-PT©) is being developed as a computerized version of the peg transfer task of the Fundamentals of Laparoscopic Surgery (FLS) system using virtual reality technology. We assessed the learning curve of trainees on the VBLaST-PT© using the cumulative summation (CUSUM) method and compared them with those on the FLS to establish convergent validity for the VBLaST-PT©.
Methods
Eighteen medical students from were assigned randomly to one of three groups: control, VBLaST-training, and FLS-training. The VBLaST and the FLS groups performed a total of 150 trials of the peg-transfer task over a 3-week period, 5 days a week. Their CUSUM scores were computed based on predefined performance criteria (junior, intermediate, and senior levels).
Results
Of the six subjects in the VBLaST-training group, five achieved at least the “junior” level, three achieved the “intermediate” level, and one achieved the “senior” level of performance criterion by the end of the 150 trials. In comparison, for the FLS group, three students achieved the “senior” criterion and all six students achieved the “intermediate” and “junior” criteria by the 150th trials. Both the VBLaST-PT© and the FLS systems showed significant skill improvement and retention, albeit with system specificity as measured by transfer of learning in the retention test: The VBLaST-trained group performed better on the VBLaST-PT© than on FLS (p = 0.003), whereas the FLS-trained group performed better on the FLS than on VBLaST-PT© (p = 0.002).
Conclusions
We characterized the learning curve for a virtual peg transfer task on the VBLaST-PT© and compared it with the FLS using CUSUM analysis. Subjects in both training groups showed significant improvement in skill performance, but the transfer of training between systems was not significant.
Similar content being viewed by others
References
Shah J, Buckley D, Frisby J, Darzi A (2003) Depth cue reliance in surgeons and medical students. Surg Endosc 17(9):1472–1474. doi:10.1007/s00464-002-9178-y
Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30(7):617–620
Adams JA (1987) Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. Psychol Bull 101(1):41–74
Powers TW, Murayama KM, Toyama M, Murphy S, Denham EW 3rd, Derossis AM et al (2002) Housestaff performance is improved by participation in a laparoscopic skills curriculum. Am J Surg 184(6):626–629 discussion 629–630
Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967
Fried GM (2008) FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg 12(2):210–212
Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B et al (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135(1):21–27
Sankaranarayanan G, Lin H, Arikatla VS, Mulcare M, Zhang L, Derevianko A et al (2010) Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer. J Laparoendosc Adv Surg Tech A 20(2):153–157
Biau DJ, Resche-Rigon M, Godiris-Petit G, Nizard RS, Porcher R (2007) Quality control of surgical and interventional procedures: a review of the CUSUM. Qual Saf Health Care 16(3):203–207
Williams SM, Parry BR, Schlup MM (1992) Quality control: an application of the cusum. BMJ 304(6838):1359–1361
Zhang L, Grosdemouge C, Arikatla VS, Ahn W, Sankaranarayanan G, De S et al (2012) The added value of virtual reality technology and force feedback for surgical training simulators. Work 41:2288–2292
Fraser SA, Feldman LS, Stanbridge D, Fried GM (2005) Characterizing the learning curve for a basic laparoscopic drill. Surg Endosc 19(12):1572–1578
Magill RA (2007) Motor learning and control: concepts and applications. McGraw-Hill, Boston
Cook JA, Ramsay CR, Fayers P (2007) Using the literature to quantify the learning curve: a case study. Int J Technol Assess Health Care 23(2):255–260
Rosser JC, Rosser LE, Savalgi RS (1997) Skill acquisition and assessment for laparoscopic surgery. Arch Surg 132(2):200–204
Shapiro SJ, Paz-Partlow M, Daykhovsky L, Gordon LA (1996) The use of a modular skills center for the maintenance of laparoscopic skills. Surg Endosc 10(8):816–819
Melvin WS, Johnson JA, Ellison EC (1996) Laparoscopic skills enhancement. Am J Surg 172(4):377–379
McCarter FD, Luchette FA, Molloy M, Hurst JM, Davis K, Johannigman JA et al (2000) Institutional and individual learning curves for focused abdominal ultrasound for trauma. Ann Surg 231(5):689–700
Schlup MMT, Williams SM, Barbezat GO (1997) ERCP: a review of technical competency and workload in a small unit. Gastrointest Endosc 46(1):48–52
Van Rij AM, McDonald JR, Pettigrew RA, Putterill MJ, Reddy CK, Wright JJ (1995) Cusum as an aid to early assessment of the surgical trainee. Br J Surg 82(11):1500–1503
Li JCM, Lo AWI, Hon SSF, Ng SSM, Lee JFY, Leung KL (2012) Institution learning curve of laparoscopic colectomy—a multi-dimensional analysis. Int J Colorectal Dis 27(4):527–533
Pendlimari R, Holubar SD, Dozois EJ, Larson DW, Pemberton JH, Cima RR (2012) Technical proficiency in hand-assisted laparoscopic colon and rectal surgery: determining how many cases are required to achieve mastery. Arch Surg 147(4):317–322
Bartlett A, Parry B (2001) Cusum analysis of trends in operative selection and conversion rates for laparoscopic cholecystectomy. ANZ J Surg 71(8):453–456
Fraser SA, Bergman S, Garzon J (2012) Laparoscopic splenectomy: learning curve comparison between benign and malignant disease. Surg Innov 19(1):27–32
Jaffer U, Cameron AEP (2008) Laparoscopic appendectomy: a junior trainee’s learning curve. JSLS 12(3):288–291
Kye B-H, Kim J-G, Cho H-M, Kim H-J, Suh Y-J, Chun C-S (2011) Learning curves in laparoscopic right-sided colon cancer surgery: a comparison of first-generation colorectal surgeon to advance laparoscopically trained surgeon. J Laparoendosc Adv Surg Tech A 21(9):789–796
Okrainec A, Ferri LE, Feldman LS, Fried GM (2011) Defining the learning curve in laparoscopic paraesophageal hernia repair: a CUSUM analysis. Surg Endosc 25(4):1083–1087
Son G-M, Kim J-G, Lee J-C, Suh Y-J, Cho H-M, Lee Y-S et al (2010) Multidimensional analysis of the learning curve for laparoscopic rectal cancer surgery. J Laparoendosc Adv Surg Tech A 20(7):609–617
Murzi M, Cerillo AG, Bevilacqua S, Gilmanov D, Farneti P, Glauber M (2012) Traversing the learning curve in minimally invasive heart valve surgery: a cumulative analysis of an individual surgeon’s experience with a right minithoracotomy approach for aortic valve replacement. Eur J Cardiothorac Surg 41(6):1242–1246
Bokhari MB, Patel CB, Ramos-Valadez DI, Ragupathi M, Haas EM (2011) Learning curve for robotic-assisted laparoscopic colorectal surgery. Surg Endosc 25(3):855–860
Buchs NC, Fo Pugin, Bucher P, Hagen ME, Chassot G, Koutny-Fong P et al (2012) Learning curve for robot-assisted Roux-en-Y gastric bypass. Surg Endosc 26(4):1116–1121
Novotny T, Dvorak M, Staffa R (2011) The learning curve of robot-assisted laparoscopic aortofemoral bypass grafting for aortoiliac occlusive disease. J Vasc Surg 53(2):414–420
Calsina L, Clara A, Vidal-Barraquer F (2011) The use of the CUSUM chart method for surveillance of learning effects and quality of care in endovascular procedures. Eur J Vasc Endovasc Surg 41(5):679–684
Naik VN, Devito I, Halpern SH (2003) Cusum analysis is a useful tool to assess resident proficiency at insertion of labour epidurals. Can J Anaesth 50(7):694–698
Lerch L, Donald JC, Olivotto IA, Lesperance M, van der Westhuizen N, Rusnak C et al (2007) Measuring surgeon performance of sentinel lymph node biopsy in breast cancer treatment by cumulative sum analysis. Am J Surg 193(5):556–560. doi:10.1016/j.amjsurg.2007.01.012
Kinsey SE, Giles FJ, Holton J (1989) Cusum plotting of temperature charts for assessing antimicrobial treatment in neutropenic patients. BMJ 299(6702):775–776
Papanna R, Biau DJ, Mann LK, Johnson A, Moise KJ Jr (2011) Use of the Learning Curve-Cumulative Summation test for quantitative and individualized assessment of competency of a surgical procedure in obstetrics and gynecology: fetoscopic laser ablation as a model. Am J Obstet Gynecol 204(3):218.e1–218.e9. doi:10.1016/j.ajog.2010.10.910
Lane NE (1987) Skill acquisition rates and patterns: issues and training implications. Springer, New York
Scott DJ, Young WN, Tesfay ST, Frawley WH, Rege RV, Jones DB (2001) Laparoscopic skills training. Am J Surg 182(2):137–142
Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12(9):1117–1120
Kolozsvari NO, Kaneva P, Brace C, Chartrand G, Vaillancourt M, Cao J et al (2011) Mastery versus the standard proficiency target for basic laparoscopic skill training: effect on skill transfer and retention. Surg Endosc 25(7):2063–2070
Feldman LS, Cao J, Andalib A, Fraser S, Fried GM (2009) A method to characterize the learning curve for performance of a fundamental laparoscopic simulator task: defining “learning plateau” and “learning rate.”. Surgery 146(2):381–386
Acknowledgments
This work was supported by the NIBIB/NIH Grant # R01EB010037. The authors thank the dedicated medical students who participated in the study. We also thank Saurabh Dargar for helping us to put together the VBLaST-PT© interface.
Disclosures
Likun Zhang, Venkata Sreekanth Arikatla, Cristol Grosdemouge, and Drs. Ganesh Sankaranarayanan, Woojin Ahn, Jesse M. Rideout, Scott K. Epstein, Daniel B. Jones, Suvranu De, and Caroline G. L. Cao have no conflict of interest or financial ties to disclose. Steven D. Schwaitzberg had a research Grant from Ethicon and is a consultant for Olympus, Styker, MITI, Acuity Bio, Neatstich, and Surgicquest. Daniel B. Jones is a consultant for Allurion.
Funding
NIBIB/NIH Grant # R01EB010037
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, L., Sankaranarayanan, G., Arikatla, V.S. et al. Characterizing the learning curve of the VBLaST-PT© (Virtual Basic Laparoscopic Skill Trainer). Surg Endosc 27, 3603–3615 (2013). https://doi.org/10.1007/s00464-013-2932-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-013-2932-5