You Should Probably Pay Attention to Tokenizers - Cybernetist - discu.eu

Hacker News

Probably pay attention to tokenizers https://cybernetist.com/2024/10/21/you-should-probably-pay-attention-to-tokenizers/ 94 comments 23/10/2024

Linking pages

Why are we using LLMs as calculators? • Buttondown https://newsletter.vickiboykis.com/archive/why-are-we-using-llms-as-calculators/ 2 comments

Linked pages

The world’s fastest framework for building websites |Hugo http://gohugo.io/ 396 comments
GitHub - openai/tiktoken https://github.com/openai/tiktoken 74 comments
A primer on the OpenAI API - Part 1 https://blog.scottlogic.com/2021/08/31/a-primer-on-the-openai-api-1.html 3 comments
Some Notes on Adversarial Attacks on LLMs - Cybernetist https://cybernetist.com/2024/09/23/some-notes-on-adversarial-attacks-on-llms/ 0 comments

Related searches:

Search whole site: site:cybernetist.com

Search title: You Should Probably Pay Attention to Tokenizers - Cybernetist

See how to search.

Submit link to: