Skip to main content

Document and chat pipelines

Use explicit provenance for retrieval and conversational context.

4 min readUpdated September 2026

Retrieved documents

compress_documents() defaults to ContextRole.RAG. This is an intentional v0.3.1 behavior change.

rag.pypython
from llmslim import compress_documents
results = compress_documents(documents, query=user_query, target_ratio=0.4)

Chat messages

compress_chat_messages() propagates system, developer, user, assistant, and tool roles. Unknown roles map to GENERAL.

chat.pypython
from llmslim import compress_chat_messages
compressed = compress_chat_messages(messages, target_ratio=0.5)

Questions

Are system messages compressed by default?

No. The default chat pipeline leaves system messages unchanged.