Token Split Tool - Easily Split text based on token count
Use Token Split Tool to divide your text into manageable tokens based on a character count you define.
I've built this because I kept running into context size length limitations on LLMs.
It enables you to split large bodies of text into smaller tokens based on a defined character count (assuming 1 token = 4 chars).
Enter your text and desired token size below and get an output.
Output:
Check out my new project to track prices on your favorite websites.