Tag: Hugging Face

The encoder-decoder idea behind machine translation, summarization, and many generation tasks.

Tokenization is the first modeling decision in NLP: it decides what units a model can see, how rare terms are represented, and how multilingual systems handle domain language.

How Transformers combine self-attention, feed-forward layers, residuals, and positional information.

How discrete language becomes vector space, and why sentence embeddings matter for retrieval and evaluation.

注意力机制是一种学习到的上下文选择方式：每个 token 应该看哪里。

如何用监督数据把预训练语言模型适配到任务或领域。