Deep Residual Network

Deep Residual Network

DRNs are small networks that aim to repeat the process to increase the depth of the network. Moreover, it also aims to give an intuitive insight in adding hidden layers. Therefore, new hidden layers learn something new by being fed inputs from previous hidden layers, essentially driving the new layer to learn something different. Fundamentally, DRNs are LSTM nodes but without gates. DRN works really well with image classification.

See Michael Dietz’s website on DRN
See Michael Dietz’s website on DRN

Leave a Reply

Your email address will not be published. Required fields are marked *