This glossary defines general machine learning and Transformers terms to help you better understand the documentation. A. attention mask. The attention mask ...

transformer: self-attention based deep learning model architecture. Model inputs. Every model is different yet bears similarities with the others. Therefore ...

The documentation is organized into five sections: GET STARTED provides a quick tour of the library and installation instructions to get up and running.

HuggingFace Transformers · Transformers Notebooks · What 🤗 Transformers can do

API to access the contents, metadata and basic statistics of all Hugging Face Hub datasets. TRL. Train transformer language models with reinforcement learning.

Transformers · Glossary · Quicktour · Trainer

Question answering tasks return an answer given a question. If you've ever asked a virtual assistant like Alexa, Siri or Google what the weather is, then you've ...

More specifically, we will look at the three main types of tokenizers used in Transformers: Byte-Pair Encoding (BPE), WordPiece, and SentencePiece, and show ...

Pipelines. The pipelines are a great and easy way to use models for inference. These pipelines are objects that abstract most of the complex code from the ...

Transformers documentation · Pipelines for inference · Working with large models