Calling tokenizer.encode('toString') errors due to bpe function

[jihan-yin]

const tokenizer = new GPT3Tokenizer({ type: 'gpt3' });
tokenizer.encode('toString')

will fail. This is because tokenizer.bpe('toString') returns the javascript function toString() instead of an actual string representing the token.

[jihan-yin]

This is because tokenizer.cache['toString'] = {function toString()}. Not sure how this is happening

[jihan-yin]

Currently resolving by adding

// @ts-ignore
tokenizer.cache['toString'] = 'toString';

The bpe still returns the javascript native function instead of token ids though, as tokenizer.encodings['toString'] is set to the function for some reason