Skip to main content
Engineering notes & research

Context, examined in public.

Technical explorations of graph centrality, token economics, attention saliency, and provenance-aware compression.

Featured paper · 10 min read

Graph Centrality & TF-IDF Vectorization for In-Context Redundancy Reduction

Mathematical Derivation of LexRank Stationary Distributions and Priority Tier FilteringA formal mathematical and algorithmic breakdown of how graph centrality over TF-IDF term matrices ranks and prunes redundant sentences in long context prompts while safeguarding imperative instructions.

Computes sentence importance via the stationary probability distribution vector p^T = p^T M over a damped Markov transition matrix derived from pairwise TF-IDF cosine similarities.