Tiktokenizer Save
Online playground for OpenAPI tokenizers
Project README
Tiktokenizer
Online playground for openai/tiktoken, calculating the correct number of tokens for a given prompt.
Special thanks to Diagram for sponsorship and guidance.
https://user-images.githubusercontent.com/1443449/222598119-0a5a536e-6785-44ad-ba28-e26e04f15163.mp4
Acknowledgments
Open Source Agenda is not affiliated with "Tiktokenizer" Project. README Source: dqbd/tiktokenizer
Stars
539
Open Issues
9
Last Commit
1 month ago
Repository
License
Homepage
Open Source Agenda Badge
