Skip to content

PeoplesGrocers/vscode-count-tokens-statusbar

Repository files navigation

Count LLM Tokens in your Status Bar

Do you wonder how many LLM tokens your code uses?

This extension puts the token count of the current file and the current selection right in the status bar! I needed this at work all the time, so I decided to make one for myself. I hope you find it useful too!

Features

  • Token Count Display: The extension provides a real-time token count of the currently selected text or the entire document if no text is selected. The token count is displayed on the right side of the status bar.

  • Auto-Update: The token count is automatically updated as you edit or select text, ensuring that the count is always accurate.

  • Easy Activation: The extension is activated as soon as VS Code starts up. You don't have to manually activate it every time you start your editor.

  • Model Selection: The extension allows you to select the model you want to use for token counting. The default model is the OpenAI's GPT-4 model. All OpenAI and Anthropic models are available.

    • cl100k_base: GPT-4
    • p50k_edit
    • p50k_base
    • r50k_base: GPT-3.5
    • gpt2
    • Anthropic Claude v1 and v2
    • LLaMA

    You can change the model by:

    1. clicking on the token count in the status bar and selecting the model you want to use.
    2. Open the Command Palette and search for Token Count in Status Bar: Change Tokenizer

Requirements

  • Visual Studio Code: The extension is developed for VS Code and will not work with other editors.

Extension Settings

The extension does not add any VS Code settings.

About

VSCode extension showing tokens count in your status bar

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors