How to compute Hessian-vector products?
With Thomas Moreau, Samuel Vaiter and Pierre Ablin we wrote a blogpost that got accepted in the blogpost track of ICLR2024. It explains the different ways to compute Hessian-Vector products with automatic differentiation and provides a benchmark comparing Jax
and PyTorch
in HVP computation. You can check it out here!