Meta-analysis finds predictive models for post-ERCP pancreatitis show moderate accuracy

This systematic review and meta-analysis evaluated the accuracy, reliability, and risk of bias of predictive models for post-ERCP pancreatitis (PEP). The analysis included 23 studies (21 for model development, 2 for external validation) involving patients undergoing ERCP. The primary outcome was model performance, assessed through metrics including area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and calibration.

The pooled AUC for the two externally validated models was 0.79 (95% CI: 0.75–0.83). Machine learning models demonstrated a higher mean AUC of 0.84 compared to traditional logistic regression models, which had a mean AUC of 0.76. Common predictive factors identified across models included difficult cannulation, female sex, pancreatic duct dilation, and history of pancreatitis. The mean events per variable (EPV) across studies was 10.2, with a wide range from 2.2 to 22.4.

Safety and tolerability data were not reported. Key limitations include significant variability in model performance, lack of external validation for most models, and significant bias identified in many of the included studies. The practice relevance is that while predictive models show potential for improving patient risk stratification, their current clinical applicability is limited. These models require further external validation and refinement before they can be reliably implemented in clinical practice.

Researchers reviewed 23 studies that developed computer models to predict a patient's risk of developing pancreatitis after an ERCP procedure. ERCP is a common test for digestive problems. The models used patient information like age, medical history, and details about the procedure to estimate risk.

The review found that the models, when tested on new groups of patients, had moderate accuracy. Machine learning models were slightly more accurate than traditional statistical models. Common factors the models used to predict higher risk included being female, having a history of pancreatitis, and having a difficult procedure.

It's important to know this research is about the models themselves, not a new treatment. The studies had significant limitations, including a lack of real-world testing for many models and potential bias. This means doctors cannot confidently use these models in clinics yet. The findings suggest these tools have potential, but they need much more development and validation to be reliable for patient care.