Automatic differentiation (AD), also called algorithmic differentiation or simply "autodiff" is one of the basic algorithms hidden behind the deep learning framework such as tensorflow, pytorch, mxnet…
Softmax regression (SR) (or multinomial logistic regression) is a generalization of logistic regression to the case where we want to handle multiple classes.