PyTorch Extension Library of Optimized Scatter Operations
PyTorch Scatter
This package consists of a small extension library of highly optimized sparse update (scatter and segment) operations for the use in PyTorch, which are missing in the main package.
Scatter and segment operations can be roughly described as reduce operations based on a given “group-index” tensor.
Segment operations require the “group-index” tensor to be sorted, whereas scatter operations are not subject to these requirements.
The package consists of the following operations with reduction types "sum"|"mean"|"min"|"max":
In addition, we provide the following composite functions which make use of scatter_* operations under the hood: scatter_std, scatter_logsumexp, scatter_softmax and scatter_log_softmax.
All included operations are broadcastable, work on varying data types, are implemented both for CPU and GPU with corresponding backward implementations, and are fully traceable.
Installation
Anaconda
Update: You