A python library providing support for higher-order optimization
higher is a library providing support for higher-order optimization, e.g. through unrolled first-order optimization loops, of “meta” aspects of these loops. It provides tools for turning existing torch.nn.Module instances “stateless”, meaning that changes to the parameters thereof can be tracked, and gradient with regard to intermediate parameters can be taken. It also provides a suite of differentiable optimizers, to facilitate the implementation of various meta-learning approaches.
Full documentation is available at https://higher.readthedocs.io/en/latest/.
- Python version >= 3.5
- PyTorch version >= 1.3
To install higher from PyPi:
pip install higher
To install higher from source:
git clone [email protected]:facebookresearch/higher.git
cd higher
pip install .
Alternatively python setup.py install will do the same thing.
If you use higher in your research and found