Skip to content

fix: special_tokens in the encode method to support the special tokens in the vocab #32

fix: special_tokens in the encode method to support the special tokens in the vocab

fix: special_tokens in the encode method to support the special tokens in the vocab #32