Key Takeaways From the ISASS Webinar Series on Current and Emerging Techniques in Endoscopic Spine Surgery | Part 2: Polytomous Rasch Analysis of Learning Curve and Surgeon Endorsement of Biportal, Interlaminar, and Transforaminal Endoscopic Stenosis Decompression, Discectomy, and Laminectomy in Combination With Interspinous Process Spacers

Prewebinar descriptive statistics of the level of importance of the learning curve to master endoscopic spine surgery: (a) 80.3% of surgeons indicated that there is a learning curve to overcome. (b) The percentage breakdown from low- to high-level endorsement is shown within each learning item. Approximately half of the responding surgeons endorsed cadaver courses and high-volume surgical practice as essential elements in overcoming the learning curve. Receiving supervised training during a 1-year fellowship or master’s program was less supported. Autodidactic learning was considered the least appropriate.

Postwebinar descriptive statistics of the level of importance of the learning curve to master endoscopic spine surgery: (a) 81.8% of surgeons indicated that there is a learning curve to overcome. (b)The percentage breakdown from low- to high-level endorsement is shown within each learning item. More than half of respondents strongly endorsed cadaver courses (60.9%) and having a mentor (57.8%) in overcoming the learning curve. A high-volume surgical practice (48.8%) was also seen as essential in overcoming the learning curve. Receiving supervised training during a 1-year fellowship (34.1%) or master’s (27.9%) program was less supported. Autodidactic learning (27.9%) also lacked high-level support.

Prewebinar descriptive statistics of level of confidence in achieving favorable clinical outcomes with (a) lateral canal decompression done either with unilateral biportal endoscopic (UBE) decompression or with percutaneous endoscopic interlaminar decompression, (b) UBE decompression for either central canal stenosis or herniated disc, and (c) transforaminal endoscopic decompression and simultaneous placement of an interspinous process spacer (ISP). Prewebinar survey responses showed higher-level endorsements for the interlaminar lateral canal decompression (43.5%; a). The highest endorsement for the UBE central canal decompression for stenosis was 34.5%, and the highest disapproval for herniated discs was 35.2% (b). Only 27.9% of surgeons gave a high-level endorsement for the combination of transforaminal endoscopic decompression with simultaneous placement of an ISP, with nearly equal levels of endorsement throughout the other categories (c).

Postwebinar descriptive statistics of level of confidence in achieving favorable clinical outcomes with (a) lateral canal decompression done either with unilateral biportal endoscopic (UBE) decompression or with percutaneous endoscopic interlaminar decompression, (b) UBE decompression for either central canal stenosis or herniated disc, and (c) transforaminal endoscopic decompression and simultaneous placement of an interspinous process spacer. Postwebinar survey responses showed an endorsement shift to higher-level categories (levels 4 and 5) for the interlaminar lateral canal decompression (78.7%), up from 67.6%, and the UBE lateral canal decompression of 48.9% up from 44.7% (a). There was a minimal response shift for the UBE laminectomy decompression of the central canal for either stenosis or herniated disc (b). There was an endorsement for the combination of transforaminal endoscopic decompression with simultaneous placement of an interspinous process spacer with a high-level endorsement (categories 4 and 5) of 63.6%, up from 49.2% prewebinar (c).

Wright plot obtained in the polytomous Rasch analysis of prewebinar (left panel) and postwebinar (right panel) survey responses regarding the importance of mastering the endoscopy learning curve, which was the easiest item for responding surgeons to agree on. The item response theory polytomous Rasch partial agreement analysis was employed to assess spine surgeons’ level of endorsement of the 6 frequently employed endoscopic spine surgery training methods (test items). On the left side of the Wright plot, the responding surgeons’ latent traits are written in logits (log odds) as estimates of true intervals of item difficulty and surgeon ability and intensity of partial agreement. The surgeons, represented by horizontal bars at the top, represented the highest level of endorsement. On the right of the Wright plot, the harder-to-agree-on items are listed at the top vs the easier-to-agree-on ones at the bottom. Directly across from 0, those surgeons had a 50% chance of endorsing a test item. There were 4 assessment gaps on the prewebinar survey and 1 on the postwebinar survey. There was some redundancy between prewebinar test items, as shown by the same ranking for fellowship and master program and mentorship and cadaver course. Similar redundancy existed for test items fellowship and master program, as well as autodidactic learning in the postwebinar survey. Cadaver course and mentorship were the most preferred elements in the training of future endoscopic spine surgeons.

The person-item map of prewebinar (a) and postwebinar (b) survey responses shows the logarithmically transformed person and item positions on a unified continuum using the logit measurement unit, transitioning ordinal data to equal-interval data. This method charts both person and item positions (in logits) along the x axis. Within Rasch modeling, these values are labeled as “locations” rather than “scores.” A surgeon’s logit location indicates their natural log odds of agreement with a series of items. Individuals with pronounced adherence to the considered attitude affirm items favorably, positioning them further to the right on the scale. The solid dots indicate the mean person location scores. Disordered items are shown in red and ordered ones in black. Examining the order and location of these test items reveals an uneven distribution of the ranked order of item difficulties or intensities along the logit continuum, suggesting a poor fit to the Rasch model without any statistically significant difference between the observed values and the values predicted by the model. In comparison to prewebinar descriptive statistics (Figure 1), the most high-intensity items were “autodidactic learning style,” “surgical master program in endoscopic spine surgery,” and having a “high volume practice” with the mean logit location shifted to the left. Because these items were out of order, some surgeons could not be measured as reliably as the majority by this set of items, indicating the test items were either too intense or not intense enough for them. The analysis also showed disordered thresholds of endorsement for the 5 of 6 test items. With the exception of “attending a cadaver course,” all test items were out of order (logits shown in red) in the prewebinar survey suggesting that surgeons had difficulty consistently discriminating between response categories ranging from strongly disagree (1), disagree (2), agree (3), and strongly agree (4)—a problem observed when there are too many response options not measuring the opinions. In the prewebinar survey, the mean logit locations for items “1-year fellowship” and “mentorship” were more shifted to the left of the plot and had an out of order (logits shown in red) wider spread, therefore showing less intense partial agreement for these items. Response analysis from the postwebinar survey for items “surgical master program in endoscopic spine surgery,” “attending a cadaver course,” “1-year fellowship,” and “mentorship” showed that the webinar shifted participants’ perceptions of the importance of having a mentor. This item solicited the highest in-order intensity response. In summary, the Rasch analysis of incoming pre- and postwebinar responses suggested that most surgeons considered having a mentor and attending cadaver courses as the most effective way to master the learning curve in endoscopic spine surgery. The person-item maps also illustrates that items were reasonably well distributed.

Wright plot obtained in the polytomous Rasch analysis of prewebinar (left panel) and postwebinar (right panel) survey responses. The item response theory polytomous Rasch partial agreement analysis was employed to assess spine surgeons’ level of endorsement of the 5 procedures (test items) presented during the webinar: (a) unilateral biportal endoscopic (UBE) laminectomy for central stenosis (UBE LAM STEN), (b) UBE laminectomy for herniated disc (UBE LAM HNP), (c) UBE decompression for lateral canal stenosis (UBE STEN), (d) percutaneous interlaminar endoscopic decompression for lateral canal stenosis (PEID, and (e) transforaminal endoscopic decompression with simultaneous interspinous process spacer for lateral canal stenosis (Endo + ISP). On the left side of the Wright plot, the responding surgeons’ latent traits are written in logits (log odds) as estimates of true intervals of item difficulty and surgeon ability or this study experience-based endorsements. The surgeons, represented by horizontal bars at the top, indicated a higher level of endorsement for the individual test components of endoscopic spinal surgery (positive logits) than those on the bottom (negative logits). On the right, the higher-level endorsement items are listed at the top vs the more controversial ones on the bottom. Directly across from 0, those surgeons had a 50% chance of endorsing a test item. One logit above suggests an approximately 25% chance that the test item was endorsed vs one logit below suggesting an approximately 75% chance of endorsement. There were no assessment gaps in the prewebinar survey but 2 in the postwebinar survey. Prewebinar survey analysis showed the log-ranking for UBE STEN, UBE LAM STEN, and Endo + ISP with similar locations in the Wright plot, suggesting that there was some redundancy between test items, and surgeons had difficulty discriminating them based on the survey questions. In the postwebinar survey, the items UBE LAM HNP, UBE LAM STEN, and UBE STEN were the most challenging to agree on. After the webinar, surgeons agreed more readily with the information presented on test item Endo + ISP. The item PEID was the easiest to agree on both before and after the webinar, suggesting wide acceptance of PEID among endoscopic spine surgeons in the treatment of lateral canal stenosis and HNP.

The person-item map of postwebinar survey responses shows the logarithmically transformed person and item positions on a unified continuum using the logit measurement unit, transitioning ordinal data to equal-interval data. This method charts both person and item positions (in logits) along the x axis (labeled “Latent Dimension”). Within Rasch modeling, these values are labeled as “locations” rather than “scores.” A surgeon’s logit location indicates their natural log odds of agreement with a series of items. Individuals with pronounced adherence to the considered attitude affirm items favorably, positioning them further to the right on the scale. The solid dots indicate the mean person location scores. Disordered items are shown in red and ordered ones in black. Examining the order and location of these test items reveals an uneven distribution of the ranked order of item difficulties or intensities along the logit continuum suggesting a poor fit to the Rasch model without any statistically significant difference between the observed values and the values predicted by the model suggesting that surgeons had difficulty consistently discriminating between response categories ranging from strongly disagree (1), disagree (2), agree (3), and to strongly agree (4)—a problem observed when there are too many response options not measuring the opinions. In comparison to the descriptive statistical prewebinar analysis (Figure 2), all procedural test items including (a) unilateral biportal endoscopic (UBE) laminectomy for central stenosis (UBE LAM STEN), (b) UBE laminectomy for herniated disc (UBE LAM HNP), (c) UBE decompression for lateral canal stenosis (UBE STEN), (d) percutaneous interlaminar endoscopic decompression for lateral canal stenosis (PEID), and (e) transforaminal endoscopic decompression with simultaneous interspinous process spacer for lateral canal stenosis (Endo + ISP) were challenging to agree upon based on the wide disorderly spread. After the webinar (descriptive statistics shown in Figure 3), the intensity of agreement, still disorderly except for PEID, increased as demonstrated by the logit locations having shifted to the right. The clinical evidence presented in these item presentations during the webinar was convincing to the webinar participants but most noticeably for PEID. The person-item maps on top of the graph also illustrate distribution gaps in the prewebinar analysis and normal distribution in the postwebinar analysis.

A sample item characteristic curves generated from prewebinar survey responses for unilateral biportal endoscopic decompression for lateral canal stenosis as part of a differential item functioning (DIF) detection process to detect item bias between orthopedic and neurosurgeons using the difNLR() and difORD() functions. Specifically, when DIF is identified in an item, 2 distinct curves are generated: one for the reference group (orthopedic surgeons) and another for the focal group (neurosurgeons). Alongside these curves, empirical probabilities are visualized as points, which indicate the proportion of correct responses relative to the participant’s ability level and group. The size of these points reflects the number of respondents at each ability level, which showed no significant difference between orthopedic (reference group) and neurosurgeons (focal group) with the statistics for DIF detection of 1.177 and a P value of 0.555 (Table 3). There were no displayable differences between orthopedic and neurosurgeons.