Encoder-Decoder Full Residual Deep Networks for Robust Regression and Spatiotemporal Estimation.

ABSTRACT: Although increasing hidden layers can improve the ability of a neural network in modeling complex nonlinear relationships, deep layers may result in degradation of accuracy due to the problem of vanishing gradient. Accuracy degradation limits the applications of deep neural networks to predict continuous variables with a small sample size and/or weak or little invariance to translations. Inspired by residual convolutional neural network in computer vision, we developed an encoder-decoder full residual deep network to robustly regress and predict complex spatiotemporal variables. We embedded full shortcuts from each encoding layer to its corresponding decoding layer in a systematic encoder-decoder architecture for efficient residual mapping and error signal propagation. We demonstrated, the

SUBMITTER: Li L 

PROVIDER: S-EPMC8665903 | biostudies-literature | 2021 Sep

REPOSITORIES: biostudies-literature