What does provenance-aware priority handling do?

It prevents untrusted RAG, tool, and assistant content from gaining protected priority solely through imperative or safety-critical wording.

Does LLMSlim prevent prompt injection?

No. It mitigates compression-induced instruction elevation and applications still need defense in depth.

Does LLMSlim require remote calls?

The default extractive strategy runs locally. Rewrite and hybrid strategies use a caller-supplied provider.

All documentation

Core Concepts 6 min readUpdated September 2026

Adaptive Context Planner

Fit heterogeneous context into a real model budget without weakening hard constraints.

Create a plan

Choose a model profile, policy, and output-token reserve. The planner generates safe representation candidates, allocates them deterministically, validates the result, and explains every decision.

planner.py

from llmslim import plan_context

plan = plan_context(
    messages=[
        {"role": "system", "content": "Answer only from supplied evidence."},
        *messages,
    ],
    documents=documents,
    tools=tools,
    model="sarvam-105b",
    policy="balanced",
    reserve_output_tokens=1024,
)

if not plan.feasible:
    raise RuntimeError(plan.infeasibility_reason)
print(plan.final_context)

Policies and validation

Balanced, quality-first, cost-first, and latency-first policies change the utility tradeoff, not the trust boundary. Post-plan validation can conservatively fall back to safer candidates.

Planning is not authorization

Tool schema selection never grants permission to call a tool. Preserve authorization, argument validation, and execution in the host.

Optional hosted Sarvam mode

Studio always supports offline planning. Where operators explicitly enable it, the separate hosted route reserves distributed request, token, concurrency, and project-spend quota before calling Sarvam. Paid mode defaults off, BYOK is not stored in the public UI, and estimated metrics are clearly separated from provider-reported usage.

Limited demonstration service

Hosted access can be disabled or exhausted. A durable quota store, server-only key, identity HMAC secret, and conservative budgets are required before activation.

Frequently asked questions

Provenance and ContextRole MCP catalogs

Create a plan

Policies and validation

Optional hosted Sarvam mode

Can the planner drop trusted instructions?

Does planning call an LLM or execute tools?

Is the hosted Sarvam key sent to the browser?