Keep the gradient flowing fa.bianp.net

On the Link Between Optimization and Polynomials, Part 6.

fa.bianp.net·104w

Optimization Nuggets: Stochastic Polyak Step-size, Part 2

fa.bianp.net·128w

Optimization Nuggets: Stochastic Polyak Step-size

fa.bianp.net·135w

On the Convergence of the Unadjusted Langevin Algorithm

fa.bianp.net·150w

The Russian Roulette: An Unbiased Estimator of the Limit

fa.bianp.net·185w

Notes on the Frank-Wolfe Algorithm, Part III: backtracking line-search

fa.bianp.net·192w

On the Link Between Optimization and Polynomials, Part 5

fa.bianp.net·205w

Optimization Nuggets: Implicit Bias of Gradient-based Methods

fa.bianp.net·225w

Optimization Nuggets: Exponential Convergence of SGD

fa.bianp.net·228w

On the Link Between Optimization and Polynomials, Part 4

fa.bianp.net·264w

On the Link Between Optimization and Polynomials, Part 3

fa.bianp.net·270w

On the Link Between Optimization and Polynomials, Part 2

fa.bianp.net·280w

On the Link Between Polynomials and Optimization, Part 1

fa.bianp.net·317w

How to Evaluate the Logistic Loss and not NaN trying

fa.bianp.net·344w

Notes on the Frank-Wolfe Algorithm, Part II: A Primal-dual Analysis

fa.bianp.net·389w

Three Operator Splitting

fa.bianp.net·399w

Notes on the Frank-Wolfe Algorithm, Part I

fa.bianp.net·423w

Optimization inequalities cheatsheet

fa.bianp.net·485w

A fully asynchronous variant of the SAGA algorithm

fa.bianp.net·498w

Hyperparameter optimization with approximate gradient

fa.bianp.net·518w

Log in to enable infinite scrolling