Reinforcement learning in densely recurrent biological networks.

ABSTRACT: Training highly recurrent networks is a technical challenge: gradient-based methods suffer from exploding or vanishing gradients, while purely evolutionary searches converge slowly. We introduce a hybrid, gradient-free optimization framework that implements reinforcement learning by coupling global evolutionary exploration with local direct search exploitation. The method, termed ENOMAD (Evolutionary Nonlinear Optimization with Mesh Adaptive Direct search), is benchmarked on a suite of food-foraging tasks instantiated in the fully mapped neural connectome of the nematode Caenorhabditis elegans. Crucially, ENOMAD leverages biologically derived weight priors, letting it refine-rather than rebuild-the organism's native circuitry. The resulting network significantly over-performs the un

SUBMITTER: Churchland MW 

PROVIDER: S-EPMC12803941 | biostudies-literature | 2026 Jan

REPOSITORIES: biostudies-literature