GitHub - simonw/ttok: Count and truncate text based on tokens - discu.eu

Reddit

How to limit/truncate/clip number of tokens being passed to GPT3.5 https://github.com/simonw/ttok 4 comments 8/10/2023 mlquestions

Linked pages

GitHub - openai/tiktoken https://github.com/openai/tiktoken 74 comments
llm, ttok and strip-tags—CLI tools for working with ChatGPT and other LLMs https://simonwillison.net/2023/May/18/cli-tools-for-llms/ 51 comments

Related searches:

Search whole site: site:github.com

Search title: GitHub - simonw/ttok: Count and truncate text based on tokens

See how to search.

Submit link to: