Journal DOI 10.68956/dyh5-kwte

Creative Commons source reading · Functional and stereotactic neurosurgery

Predicting seizure outcome after epilepsy surgery: Do we need more complex models, larger samples, or better data?

Maria H Eriksson; Mathilde Ripart; Rory J Piper; Friederike Moeller; Krishna B Das; Christin Eltze; Gerald Cooray; John Booth; Kirstie J Whitaker; Aswin Chari; Patricia Martin Sanfilippo; Ana Perez Caballero; Lara Menzies; Amy McTague; Martin M Tisdall; J Helen Cross; Torsten Baldeweg; Sophie Adler; Konrad Wagstyl

Originally published in Epilepsia · 2023-06-16

From the article

Selected source text. JournalOS removes markup and shortens excerpts where indicated. The full article provides the complete context.

Abstract

Objective The accurate prediction of seizure freedom after epilepsy surgery remains challenging. We investigated if (1) training more complex models, (2) recruiting larger sample sizes, or (3) using data-driven selection of clinical predictors would improve our ability to predict postoperative seizure outcome using clinical features. We also conducted the first substantial external validation of a machine learning model trained to predict postoperative seizure outcome. Methods We performed a retrospective cohort study of 797 children who had undergone resective or disconnective epilepsy surgery at a tertiary center. We extracted patient information from medical records and trained three models-a logistic regression, a multilayer perceptron, and an XGBoost model-to predict 1-year postoperative seizure outcome on our data set. We evaluated the performance of a recently published XGBoost model on the same patients. We further investigated the impact of sample size on model performance, using learning curve analysis to estimate performance at samples up to N = 2000. Finally, we examined the impact of predictor selection on model performance.

DISCUSSION

Up to one third of patients do not achieve seizure freedom through epilepsy surgery despite careful evaluation. 1 There has been a longstanding history of trying to identify these patients preoperatively, both through traditional statistical modeling approaches and more complex machine learning techniques. 3 , 4 , 5 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 These attempts have, however, had limited success.

CONCLUSIONS

Accurate prediction of seizure outcome after epilepsy surgery remains difficult. We highlight the importance of comparing traditional statistical modeling to complex machine learning techniques, as we show that these two approaches may perform equally well. We also demonstrate the importance of performing external validation of machine learning models, as we show that algorithms may underperform on other centers' data.

Editorial reading guide

  • How were patients or cases selected, and what did the authors use as a comparator?
  • Which outcomes, complications and follow-up intervals determine how far the findings apply?