problem is that evaluating the second term in square brackets requires evaluating , and extra gradient evaluations are generally expensive and undesirable. Some ways around this problem are:

* Forgo the benefits of a clever descent direction by setting , and use line search to find a suitable step-size , such as one that satisfies the Wolfe conditions. A more economic way of choosing learning rates is backtracking line search,