HackerByte

ranxianglei/billion-context

billion-context: Compress conversational context for month-long AI sessions

A context-compression plugin for month-long single sessions (billions of tokens) ,small context windows (a 100K context is enough) and token savings (5x fewer tokens) .上下文压缩插件,月级长会话会话, 兼顾小窗口(100k上下文足矣)省token(省5倍token) . billion-context is all you need

AI-generated summary

billion-context is a TypeScript plugin that compresses conversational context for AI models, enabling month-long single sessions by reducing token usage significantly. It works by rewriting AI streams, allowing the model to incrementally summarize and decompress conversation history as needed, rather than relying on fixed truncation limits.

Language: TypeScript

View the original GitHub repository