Skip to content

Issues: dqbd/tiktoken

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

25 Open 59 Closed
25 Open 59 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Expose getEncodingNameForModel in wasm version?
#123 opened Nov 14, 2024 by jens-ghc
recursive use of an object detected which would lead to unsafe aliasing in rust
#119 opened Aug 22, 2024 by mogery
2
React native error SyntaxError: Invalid RegExp: Invalid escape] in react native expo.
#110 opened Jul 16, 2024 by djaffer
1
missing example code for js-tiktoken
#102 opened May 9, 2024 by coding22
1
Performance
#99 opened Apr 15, 2024 by steebchen
Add decode_with_offsets function (or PR guidance request)
#94 opened Mar 11, 2024 by Sam1320
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
#92 opened Feb 13, 2024 by TranquilMarmot
1
'TextEncoder' is not defined - MongoDB Functions
#91 opened Feb 11, 2024 by georgeherby
1
Add support for the newest Open AI embeddings models
#90 opened Feb 9, 2024 by AleksTrpkovski
2
Memory access out of bounds
#84 opened Jan 17, 2024 by maxdeichmann
3
Crash on React Native: SyntaxError: Invalid RegExp: Invalid escape
#82 opened Dec 1, 2023 by julian-hecker
2
How to count tokens for functions defined in the prompt?
#78 opened Oct 21, 2023 by vrde
1
Support fine tunned models
#76 opened Oct 17, 2023 by italojs
1
Cannot find module error
#75 opened Oct 17, 2023 by thdoan
1
What does free actually do?
#72 opened Sep 19, 2023 by disbelief
9
Raise error when concurrent to call new Tiktoken
#70 opened Sep 12, 2023 by qkxie
2
Error: null pointer passed to rust
#69 opened Sep 6, 2023 by emeeks
4
NPM package is very huge
#68 opened Aug 29, 2023 by anzemur
6
When I look at cl100k_base.json, I don't see the special tokens like <|im_start|>, but when I add them manually I get an error from the wasm
#65 opened Aug 5, 2023 by Evertt
2
Fatal crash: BasicBlock requested for unrecognized address
#62 opened Jul 13, 2023 by SamStenner
1
When running 1.0.7 there is a Missing tiktoken_bg.wasm error on AWS Lambda typescript
#61 opened Jul 10, 2023 by haibh-wanosoft
3
[js-tiktoken] memory leak
#50 opened Jun 13, 2023 by louis030195
3
Cloudflare worker Uncaught ReferenceError: FinalizationRegistry is not defined
#46 opened May 24, 2023 by EiffelFly
8
Automatically determine the environment
#43 opened May 16, 2023 by louis030195
3
Will there be support for deno deploy + esm.sh
#22 opened Mar 17, 2023 by deepak-coding-art
8
ProTip! Find all open issues with in progress development work with linked:pr.