News

Visual Studio Magazine7h
Linear Regression Using JavaScript
Dr. James McCaffrey presents a complete end-to-end demonstration of linear regression using JavaScript. Linear regression is ...
IEEE17d
A General Framework for Approximate and Delayed Gradient Descent for Decomposable Cost Functions - IEEE Xplore
We propose and analyze a generalized framework for distributed, delayed, and approximate stochastic gradient descent. Our framework considers n local agents who utilize their local data and ...
IEEE29d
Improving the Accuracy of Neural Network Pattern Recognition by Fractional Gradient Descent - IEEE Xplore
In this paper we propose the fractional gradient descent for increasing the training and work of modern neural networks. This optimizer searches the global minimum of the loss function considering the ...
GitHub29d
GitHub - lixilinx/psgd_torch: Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditioner and more)
Resources Preconditioned stochastic gradient descent, arXiv:1512.04202, 2015. (General ideas of PSGD, preconditioner fitting criteria and Kronecker product preconditioners.) Preconditioner on matrix ...