How to compute Hessian-vector products?

With Thomas Moreau, Samuel Vaiter and Pierre Ablin we wrote a blogpost that got accepted in the blogpost track of ICLR2024. It explains the different ways to compute Hessian-Vector products with automatic differentiation and provides a benchmark comparing Jax and PyTorch in HVP computation. You can check it out here!

Mathieu Dagréou
Mathieu Dagréou
Ph.D. student in Machine Learning