Skip to content
Back to blog

How to Reduce Token Usage in ChatGPT, Claude and Gemini (2026 Guide)

PiiBlock Team
tokenschatgptclaudegeminiproductivity

Every message you send to an AI chat resends the whole conversation, not just your latest line. The system rebuilds the input from scratch each turn: instructions, history, your new prompt. That is why a 40-message chat costs 40 messages' worth of tokens on turn 41, and why the tenth reply in a long thread is slower and dumber than the first. The fix is not shorter prompts. It is smaller context. The ten habits below apply to ChatGPT, Claude, Gemini, Copilot and any other chat that bills or rate-limits by tokens. The first three matter more than the rest combined.

1. Reset the chat around 15 to 20 messages

Long chats are the single biggest leak, and the one most people never plug. Because the full history rides along with every turn, cost grows roughly with the square of conversation length: message 30 carries 29 messages of baggage, message 31 carries 30. Keep one goal per chat. When the goal is done, or the thread passes 15 to 20 exchanges, start a new one. You lose nothing if you carry a summary forward (see tip 5). Rate-limited plans feel this hardest: a single bloated thread can burn a day's allowance in an afternoon.

2. Store standing context once, not in every message

If you open every chat by explaining your role, your project and how you like answers formatted, you are paying for the same paragraph every session. All major products have a persistent slot for this: custom instructions in ChatGPT, project instructions in Claude, saved info in Gemini, and Projects or workspaces in each. Set it once. One rule: keep this slot to your role, stack and preferences. Do not park client names, account numbers or customer details in it, because persistent context is sent with every conversation, including ones that never needed it.

3. Use the cheapest model that does the job

Most people default to the top-tier model for everything. For day-to-day drafting, summarising and Q&A, the mid-tier model (the smaller, faster tier in ChatGPT, Claude Sonnet, Gemini Flash) does the same work at a fraction of the per-token price, and on rate-limited plans it draws far less from your allowance. Draft in the smaller model and escalate only when it fails. The gap widens on deep reasoning, multi-step planning and nuanced judgement, so treat this as a default with exceptions, not a rule.

4. Paste the snippet, not the file

A 200-line file pasted to ask about 10 lines adds 190 lines of dead weight, and that weight is resent on every later turn in the chat. Extract the function, the paragraph or the table you actually have a question about. If the model needs more, it will ask. This is also the habit that keeps the most unrelated data out of the conversation in the first place.

5. Summarise before you start fresh

When a chat has run its course, do not abandon it mid-flight. Ask the model to write a handoff: "Summarise what we decided, what is open, and any constraints, in under 200 words." Paste that into the new chat. You carry forward the outcome without the 30 turns it took to reach it. Projects or workspaces keep your files and instructions attached across resets, so the new thread starts warm.

6. Ask for the length you want

Models default to thorough. Output tokens usually cost more than input tokens, and a 600-word answer to a yes/no question is pure waste. State the format up front: "one paragraph", "three bullets", "just the command, no explanation". Long answers also sit in history and get resent, so a verbose reply on turn 3 taxes every turn after it.

7. Trim raw logs and test output

A stack trace, a full API response or a failing test run can be thousands of tokens, most of it irrelevant. Pull out the error line, the request that failed and the ten lines around it. Beyond cost, models get worse at finding the relevant part as noise grows; a clean excerpt gets a better answer than the full dump.

Three questions about the same document, asked in three messages, resend the document three times. Ask all three at once. You pay for the context once, and answers tend to be more coherent because the model sees the full set together.

9. Keep one-offs out of your working threads

A quick unrelated question dropped into a project chat lives in that history forever and gets resent with every later turn. Open a scratch chat for it instead. In products with memory, this also keeps your saved profile from filling with things you asked once and never needed again.

10. Prune what persists

Memory and custom instructions save tokens only while they are relevant. Review them monthly. Delete outdated projects, finished tasks and preferences you have moved on from. Stale memory is worse than none: it costs tokens on every chat and steers answers toward context that no longer applies.

The overlap with privacy

Tips 4, 7 and 9 have a second effect: less pasted means less exposed. Trimming a log to the error line also strips the customer email addresses in the rows around it. But trimming only removes what you noticed. Names, emails and phone numbers still slip through in the snippet you kept. Masking that data before it leaves the browser closes the gap without adding tokens or changing the answer: PiiBlocker replaces personal data with placeholders in the prompt and restores them in the reply, and works across ChatGPT, Claude, Gemini and other chats. Alternatives include PrivacyScrubber, Caviard and MaskMyPrompt, which do similar in-page masking with different coverage. Any of them beats relying on a temporary-chat toggle, which stops the provider keeping the data but still sends it.

Frequently asked questions

Do longer conversations really cost more per message? Yes. Each turn resends the full history, so per-message cost rises as the chat grows. Resetting is the fastest way to bring it down.

Does using a smaller model reduce token count? No, it reduces cost per token and draws less from rate-limited plans. Token count depends on context size, which the other tips control.

Do custom instructions cost tokens? Yes, on every conversation. Keep them short and current.

Does masking personal data add tokens? Marginally. A placeholder like [NAME_1] is a few tokens, about the same as the name it replaces.