Skip to content

Commit

Permalink
Fixed a minor issue with tutorial
Browse files Browse the repository at this point in the history
  • Loading branch information
ParishadBehnam committed Apr 9, 2024
1 parent 946e031 commit e198aec
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/_pages/tutorial.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,7 @@
# LLM2Vec Tutorial: Steps for transforming any decoder-only model into a text encoder
---
title: "LLM2Vec Tutorial: Steps for transforming any decoder-only model into a text encoder"
permalink: /tutorial/
---

LLM2Vec consists of 3 simple steps to transform decoder-only LLMs into text encoders: 1) enabling bidirectional attention, 2) training with masked next token prediction, and 3) unsupervised contrastive learning. The model can be further fine-tuned with supervised data. Here, we provide a tutorial on how to use the LlaMA models.

Expand Down

0 comments on commit e198aec

Please sign in to comment.