This paper aims to explore seven commonly used optimization algorithms in deep learning: SGD, Momentum-SGD, NAG, AdaGrad, RMSprop, AdaDelta, and Adam. Based on an overview of their theories and ...

Deep neural networks (DNNs) have become increasingly popular across a wide range of applications, but recent research has revealed their vulnerability to backdoor attacks. However, existing backdoor ...