Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Inference on Specialized Hardware

This document will be completed soon with information on how to infer on specialized hardware. In the meantime you can check out the guide for inference on CPUs.

←Inference on many GPUs Instantiating a big model→

Transformers

Inference on Specialized Hardware