Operator performance

An important element of simulator performance is the capacity of simulators to distinguish operator expertise. Most studies on operator performance have utilized “metrics.” 1) 2) 3) 4) 5) 6) 7) 8) 9) 10) 11).

Tool acceleration 12) , applied forces 13) 14) 15) 16) 17) 18) 19) have all been studied. An operator’s performance metrics can be compared with previously defined proficiency benchmarks. The operator could then be placed into 1 of 2 or more groups with specific levels of psychomotor expertise 20) 21).

1)
Choudhury N, Gelinas-Phaneuf N, Delorme S, Del Maestro R (2013) Fundamentals of neurosurgery: virtual reality tasks for training and evaluation of technical skills. World Neurosurg 80(5):e9–e19
2)
Gelinas-Phaneuf N, Del Maestro RF (2013) Surgical expertise in neurosurgery: integrating theory into practice. Neurosurgery 73(suppl_1):S30–S38
3)
Gelinas-Phaneuf N, Choudhury N, Al-Habib AR, Cabral A, Nadeau E, Mora V et al (2014) Assessing performance in brain tumor resection using a novel virtual reality simulator. Int J Comput Assist Radiol Surg 9(1):1–9
4) , 13)
Azarnoush H, Alzhrani G, Winkler-Schwartz A, Alotaibi F, Gelinas-Phaneuf N, Pazos V, Choudhury N, Fares J, DiRaddo R, del Maestro R (2015) Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection. Int J Comput Assist Radiol Surg 10(5):603–618
5)
Cline BC, Badejo AO, Rivest II, Scanlon JR, Taylor WC, Gerling GJ (2008) Human performance metrics for a virtual reality simulator to train chest tube insertion. IEEE SIEDS :168–173
6)
Kazemi H, Rappel JK, Poston T, Hai Lim B, Burdet E, Leong TC (2010) Assessing suturing techniques using a virtual reality surgical simulator. Microsurgery. 30(6):479–486
7)
Trejos AL, Patel RV, Malthaner RA, Schlachta CM (2014) Development of force-based metrics for skills assessment in minimally invasive surgery. Surg Endosc 28(7):2106–2119
8)
Kovac ERA, Azhar A, Quirouet J, Delisle, Anidjar M (2012) Construct validity of the lapSim virtual reality laparoscopic simulator within a urology residency program. CUAJ 6(4):253
9)
Alotaibi FE, Al Zhrani G, Bajunaid K, Winkler-Schwartz A, Azarnoush H et al (2015) Assessing neurosurgical psychomotor performance: role of virtual reality simulators, current and future potential. SOJ Neurol 2(1):1–7
10)
Alotaibi FE, AlZhrani GA, Mullah MA, Sabbagh AJ, Azarnoush H, Winkler-Schwartz A et al (2015) Assessing bimanual performance in brain tumor resection with NeuroTouch, a virtual reality simulator. Oper Neurosurg 11(1):89–98
11)
Alotaibi FE, AlZhrani GA, Sabbagh AJ, Azarnoush H, WinklerSchwartz A, Del Maestro RF (2015) Neurosurgical assessment of metrics including judgment and dexterity using the virtual reality simulator NeuroTouch (NAJD Metrics). Surg Innov 22(6):636–642
12)
Jensen Ang WJ, Hopkins ME, Partridge R, Hennessey I, Brennan PM, Fouyas I, Hughes MA (2013) Validating the use of smartphone-based accelerometers for performance assessment in a simulated neurosurgical task. Oper Neurosurg 10(1):57–65
14)
Azarnoush H, Siar S, Sawaya R, Zhrani GA, Winkler-Schwartz A, Alotaibi FE, Bugdadi A, Bajunaid K, Marwa I, Sabbagh AJ, del Maestro R (2017) The force pyramid: a spatial analysis of force application during virtual reality brain tumor resection. J Neurosurg 127(1):171–181
15)
Sawaya R, Bugdadi A, Azarnoush H, Winkler-Schwartz A, Alotaibi FE, Bajunaid K, AlZhrani GA, Alsideiri G, Sabbagh AJ, Del Maestro RF (2017) Virtual reality tumor resection: the force pyramid approach. Operative Neurosurgery. 14(6):686–696
16)
Bugdadi A, Sawaya R, Olwi D, AlZahrani G, Azarnoush H, Sabbagh A et al (2018) Automaticity of force application during simulated brain tumor resection: testing the Fitts and Posner model. J Surg Educ 75(1):104–115
17)
Sawaya R, Alsidieri G, Bugdadi A, Winkler-Schwartz A, Azarnoush A, Bajunaid K, AJ JS, Del Maestro R (2018) Development of a performance model for virtual reality tumor resections. J Neurosurg 1(aop):1–9
18)
Winkler-Schwartz A, Bajunaid K, Mullah MA, Marwa I, Alotaibi FE, Fares J et al (2016) Bimanual psychomotor performance in, bimanual dexterity, and the effect of stress neurosurgical resident applicants assessed using NeuroTouch, a virtual reality simulator. J Surg Educ 73(6):942–953
19)
Bajunaid K, Mullah MA, Winkler-Schwartz A, Alotaibi FE, Fares J, Baggiani M et al (2017) Impact of acute stress on psychomotor bimanual performance during a simulated tumor resection task. J Neurosurg 126(1):71–80
20)
Alzhrani G, Del Maestro RF (2014) A validation study of NeuroTouch in neurosurgical training. LAP LAMBERT Academic Publishing, Saarbrücken
21)
Alzhrani G, Alotaibi F, Azarnoush H, Winkler-Schwartz A, Sabbagh A, Bajunaid K et al (2015) Proficiency performance benchmarks for removal of simulated brain tumors using a virtual reality simulator NeuroTouch. Journal of Surgical Education 72(4): 685–696