The Perceiver is kind-of a way-station on the way to what Google AI lead Jeff Dean has described as one model that could handle any task, and “learn” faster, with less data.

The authors see big potential for Perceiver to go places, writing that "Perceiver AR is a good candidate for a general-purpose, long-context autoregressive model." There's an extra ripple, though ...

Finally, there is an open-source implementation in PyTorch by members of the deep-learning community. In order to use it, you can use the following snippet: import torch from perceiver_pytorch ...