Session 6:

6A: Graph, Knowledge & Content Representations

Date: Wednesday September 30, 16:00 – 17:30 CDT
Session Chair: Giuseppe Spillo

  • PPFEachMovie: archaeology of the first latent recommender system
    by John DeTreville

    This retrospective presents a preliminary archaeological reconstruction of EachMovie (1995–97), believed to be the first large latent recommender system; it became broadly available online a full decade before the Netflix Prize competition was announced. Running on two office PCs, EachMovie gave its users highly personalized movie recommendations by computing 20-dimensional latent vectors from its evolving 2.8M-vote dataset (97.63% sparse). EachMovie’s Joint Quartic Polak-Ribière iterative solver converged rapidly, and used a novel Hallucination-Free objective function to overcome the inherent problems of zero- or mean-filled matrices. EachMovie’s Early Voting data-augmentation strategy pre-loaded and stabilized the latent space every week by importing votes from professional reviews. EachMovie worked surprisingly well, cultivating a high degree of user engagement and trust, and noted movie critic Roger Ebert called it “uncannily accurate.”

  • RESLearning Sparse Representations of Multimodal Content for Enhanced Cold Item Recommendation
    by Gregor Meehan and Johan Pauwels

    The scale and rapid growth of item catalogs in modern digital platforms present significant challenges to recommender system (RS) practitioners. Most RSs use embedding similarity to predict user-item preferences, but storage and low-latency retrieval of these embeddings is challenging in industry-scale catalogs. Furthermore, newly added items do not have corresponding embeddings and cannot be recommended effectively; previous works often tackle this item cold-start problem by generating cold item representations from auxiliary content, such as images or descriptive text, so that user preferences can be predicted without historical interactions. In this paper, we argue that sparse embeddings have notable advantages over standard dense vectors in this content-based cold-start paradigm. We describe how existing cold-start training regimes can be adapted for sparse representation learning, and build on insights from linear attention to design a pre-sparsification activation technique that induces sharpness and denoising effects in learned item-item similarities. We show that the resulting sparse embeddings achieve significant improvements in cold-start recommendation accuracy over dense embeddings at considerably lower storage costs, especially for users with multiple interests. Through comprehensive experiments on four multimodal RS datasets, we also demonstrate the interpretability of sparse content embeddings and their robustness in the trade-off between size and accuracy.

  • RESGateBoxGCN: Hard-Soft Gated Box Embeddings with Graph Convolution for Recommendation
    by Fan Mo, Takashi Wada, Rongqin Chen, Chongxian Chen, Xin Fan, Tianwei Chen and Hayato Yamana

    This paper proposes GateBoxGCN, a box embedding framework that relaxes the strict positivity constraint on offsets via a hard-forward/soft-backward gating mechanism, improving recommendation performance. Box embeddings have been explored as a technique to model user preferences via high-dimensional boxes defined by centers and offsets. However, existing box-based methods restrict all offset dimensions to be positive to ensure valid box geometry, limiting the model’s flexibility and expressiveness. To address this limitation, we relax the constraint to allow offsets to be negative values. We then use negative offset dimensions to explicitly model unevaluable dimensions, such as those arising from unobserved user preferences or noise. During inference, we exclude unevaluable dimensions and calculate user-item preference scores by using only the robust ones. To handle unevaluable dimensions, we further introduce a hard-forward/soft-backward gating mechanism, where unevaluable dimensions are filtered out by the hard gate during forward propagation while the soft gate provides gradients to these dimensions during backpropagation, enabling end-to-end learning of the gating mechanism and user/item box representations. Experimental results on real-world datasets confirm the effectiveness of our method over state-of-the-art baselines.

  • PPFFrom Side Information and Knowledge Graphs to Large Language Models: Two Decades of Knowledge Integration in Recommender Systems
    by Claudio Pomo, Diego Baquero Sanz, Liam Claude Morris, Ludovico Boratto, Fedelucio Narducci and Tommaso Di Noia

    Over the past two decades, Recommender Systems (RSs) have undergone successive transformations in how they encode and enable external knowledge: evolving from constraints and hand-crafted rules, to side information and feature matrices, to linked data and knowledge graphs, and, most recently, to Large Language Models (LLMs). This Past/Present/Future retrospective views this trajectory as a sequence of representational translations rather than a series of outright replacements. We analyze how these translations have transformed the functional capabilities of RSs, the recurring design patterns across technological eras, and the new risks that arise as knowledge integration becomes generative and conversational. By analyzing representative contributions from the RecSys literature, we identify several persistent regularities. External knowledge is repeatedly leveraged to mitigate sparsity and cold-start problems; human-interpretable structure remains fundamental for explanation, user control, and system governance; and hybrid architectures systematically reappear whenever no single representation simultaneously satisfies both scalability requirements and demands for traceability and auditability. We argue that LLMs should not be seen as replacements for structured knowledge representations, but rather as a new interaction and mediation layer that requires explicit grounding in verifiable, structured sources. We close by outlining a cautious research agenda for 2026–2030, centered on the development of hybrid, inspectable, and accountable RSs.

  • RESGSPRec: On Improving Item Representations in Graph Signal Processing for Collaborative Filtering
    by Ahmad Bin Rabiah and Julian McAuley

    Graph-based collaborative filtering methods act as low-pass filters in the spectral domain and discard the intermediate-frequency components where community-level user preferences reside. Existing GSP-based methods address this through increasingly sophisticated filter designs, yet derive item representations from the user-item interaction matrix alone. The interaction matrix captures which items each user interacted with, but not which items users interacted with close together in their interaction ordering. We propose GSPRec, a graph spectral collaborative filtering framework that produces richer item spectral representations by incorporating item-item proximity derived from user interaction ordering before spectral filtering. GSPRec derives item-item edges from user interaction ordering via multi-hop diffusion and incorporates them into the graph topology. The resulting Laplacian exposes intermediate-frequency structure that a Gaussian bandpass filter selectively amplifies. A low-pass filter retains broad popularity trends. Extensive experiments on four real-world datasets show that GSPRec outperforms all GSP-based and GCN-based CF baselines, with average improvements of 5.12% in NDCG@10. Ablation studies establish that graph construction and filter design are coupled: incorporating item-item proximity without the bandpass filter falls below all GSP baselines, while bandpass filtering without item-item proximity already surpasses them.

  • RESStabilizing Stability and Plasticity in Graph-based Continual Recommender System
    by Yixin Chen, Xiangmeng Wang and Qian Li

    Real-world graph-based recommender systems face increasing challenges as interaction graphs evolve continuously, exposing models to persistent out-of-distribution shifts. Continual learning has emerged as a promising paradigm for incremental updates without retraining from scratch. However, existing methods primarily emphasize preserving historical knowledge (i.e., stability) and fail to address the unique challenges of graph structures. We identify fundamental challenges in graph-based continual recommendation. Through empirical analysis, we reveal three key challenges: (i) over-stabilization induced by message passing limits the absorption of new knowledge, i.e., lack of plasticity; (ii) improving plasticity for new items degrades performance on historical items, exposing a stability–plasticity trade-off; and (iii) evolving graph topology weakens the preservation of learned representations, i.e., limited stability. To address these challenges, we propose SSPRec, a graph prompt-based continual learning framework for OOD recommendation that explicitly preserve plasticity, enhance stability, and effectively balance the stability–plasticity trade-off. SSPRec freezes a pre-trained backbone and adapts to evolving graph slices via lightweight prompts and user-specific control. Specifically, we design contextual and temporal prompts to enhance stability, introduce forward-knowledge-guided contrastive objectives to improve plasticity, and develop a preference-shift-aware mechanism to adaptively balance stability and plasticity at the user level. Extensive experiments demonstrate that SSPRec consistently outperforms state-of-the-art methods under evolving graph settings.

Back to program