Numerically Robust News Recommendation under Item Cold-Start via Cholesky-based LinUCB and Matryoshka Embeddings
In dynamic content spaces like regional news publishing, recommendation systems face a structural paradox:
articles display an extremely short Time-to-Live (TTL < 48h) while catalog throughput remains modest.
Classical collaborative filtering algorithms
Project Kairos addresses this scarcity by transitioning from passive data-driven learning
to active online bandit optimization via Linear Upper Confidence Bound (LinUCB)
Empirical evaluations on news interaction datasets confirm that the majority of engagement occurs within hours of publication.
Afterwards, article utility decays exponentially
LinUCB resolves this by modeling user payoffs as a linear combination of contextual features $x_{t,a} \in \mathbb{R}^d$ and estimated user preference vectors $\hat{\theta}_t \in \mathbb{R}^d$:
where $\alpha > 0$ balances exploitation with epistemic exploration, and $A_t \in \mathbb{R}^{d \times d}$ denotes the cumulative feature covariance matrix with ridge parameter $I_d$:
Geometrically, the quadratic term under the radical, $x_{t,a}^\top A_t^{-1} x_{t,a}$, represents the weighted Mahalanobis distance with respect to the precision matrix $A_t^{-1}$. It defines a confidence ellipsoid in the $d$-dimensional parameter space:
Exploration is non-isotropic. Along feature directions that have received substantial interaction (high data coverage), the ellipsoid contracts quickly, reducing uncertainty. Conversely, along under-explored directions (representing novel or cold-start topics), the ellipsoid remains stretched out, yielding a large exploration bonus that directly counteracts popularity bias.
To sustain continuous recommendation streams, LinUCB must update $A_t^{-1}$ iteratively as each new article interaction $x_t$ arrives. Conventional implementations employ the Sherman-Morrison formula:
Under floating-point arithmetic, repeatedly subtracting outer products induces catastrophic cancellation. The condition number $\kappa(A_t^{-1})$ diverges, asymmetry creeps in, and positive definiteness is irreparably destroyed.
Below, we simulate 1,000 streaming interactions on real 128-dimensional Matryoshka embeddings extracted from the Tagesschau API. Both models are initialized identically ($A_0 = 0.1 I_{128} \implies A_0^{-1} = 10 I_{128}$). We project the uncertainty ellipsoid into 3 representative axes: PC1 (dominant category), PC2, and PC120 (cold-start topic):
Rather than storing and inverting $A_t$, Kairos maintains the lower-triangular Cholesky factor $L_t \in \mathbb{R}^{d \times d}$ such that:
Upon observing action context $x \in \mathbb{R}^d$ and reward $r \in \{0, 1\}$, the factorization is updated directly via rank-1 modification
Operating in triangular factor space yields a decisive mathematical property
Numerical stability ensures system reliability, but real-time news serving requires sub-millisecond inference latency.
Kairos combines Cholesky LinUCB with Matryoshka Representation Learning (MRL)
By truncating the 768-dimensional embedding vector to the nested $m = 128$ subspace, Maximum Inner Product Search (MIPS) achieves a 4.85-fold speedup (0.069 ms vs. 0.337 ms per 100 candidates) while retaining over 95% of total semantic variance and 96.4% pairwise cosine similarity precision.
The following slide deck summarizes the mathematical derivation, algorithmic Givens rank-1 factor updates, and empirical latency/stability benchmarks for the SKILL 2026 at the INFORMATIK Festival in Dresden.
This work was conducted at DHBW Ravensburg (School of Business, Data Science & AI). Experimental validation relies on real-time news embeddings sourced from the Tagesschau API. Implementation in Julia 1.10; source code and benchmark scripts are available on GitHub.
Finn Hertsch: Conceptualization, mathematical formulation of Cholesky LinUCB, MRL integration, empirical evaluation, and software architecture.