Lesser the Logistic Regression Cost Function, better the learning, more accurate will be our predictions. Learn With Jay. Logistic Regression Cost Function ¦ Machine Learning ¦ Simply Explained.