You are currently using the Kubernetes version. This message will be visible during all the test phase.

Optimum Neuron documentation

πŸ€— Optimum Neuron

You are viewing pr_1 version. A newer version undefined is available.
Hugging Face's logo
Join the Hugging Face community

and get access to the augmented documentation experience

to get started

πŸ€— Optimum Neuron

πŸ€— Optimum Neuron is the interface between the πŸ€— Transformers library and AWS Accelerators including AWS Trainium and AWS Inferentia. It provides a set of tools enabling easy model loading, training and inference on single- and multi-Accelerator settings for different downstream tasks. The list of officially validated models and tasks is available here.