biostudies-literatureUnknown2Wilimitis DCross-validation remains a popular means of developing and validating artificial intelligence for health care. Numerous subtypes of cross-validation exist. Although tutorials on this validation strategy have been published and some with applied examples, we present here a practical tutorial comparing multiple forms of cross-validation using a widely accessible, real-world electronic health care data set: Medical Information Mart for Intensive Care-III (MIMIC-III). This tutorial explored methods such as K-fold cross-validation and nested cross-validation, highlighting their advantages and disadvantages across 2 common predictive modeling use cases: classification (mortality) and regression (length of stay). We aimed to provide readers with reproducible notebooks and best practices for modelJMIR AIe49023https://www.ebi.ac.uk/biostudies/studies/S-EPMC11041453biostudies-literaturePractical Considerations and Applied Examples of Cross-Validation for Model Development and Evaluation in Health Care: Tutorial.PMC11041453Wilimitis DWalsh CGfalsePractical Considerations and Applied Examples of Cross-Validation for Model Development and Evaluation in Health Care: Tutorial.Cross-validation remains a popular means of developing and validating artificial intelligence for health care. Numerous subtypes of cross-validation exist. Although tutorials on this validation strategy have been published and some with applied examples, we present here a practical tutorial comparing multiple forms of cross-validation using a widely accessible, real-world electronic health care data set: Medical Information Mart for Intensive Care-III (MIMIC-III). This tutorial explored methods such as K-fold cross-validation and nested cross-validation, highlighting their advantages and disadvantages across 2 common predictive modeling use cases: classification (mortality) and regression (length of stay). We aimed to provide readers with reproducible notebooks and best practices for model2023-01-01T00:00:00Z2023 Dec2026-06-01T21:55:41.836Z2025-04-06T03:15:37.299ZS-EPMC110414533887553010.2196/49023