MemRerank: Preference Memory for Personalized Product Reranking
Abstract
MemRerank is a preference memory framework that improves personalized product reranking by distilling user purchase history into concise, query-independent signals using reinforcement learning with downstream performance as supervision.
LLM-based shopping agents increasingly rely on long purchase histories and multi-turn interactions for personalization, yet naively appending raw history to prompts is often ineffective due to noise, length, and relevance mismatch. We propose MemRerank, a preference memory framework that distills user purchase history into concise, query-independent signals for personalized product reranking. To study this problem, we build an end-to-end benchmark and evaluation framework centered on an LLM-based 1-in-5 selection task, which measures both memory quality and downstream reranking utility. We further train the memory extractor with reinforcement learning (RL), using downstream reranking performance as supervision. Experiments with two LLM-based rerankers show that MemRerank consistently outperforms no-memory, raw-history, and off-the-shelf memory baselines, yielding up to +10.61 absolute points in 1-in-5 accuracy. These results suggest that explicit preference memory is a practical and effective building block for personalization in agentic e-commerce systems.
Community
Excited to share MemRerank: Preference Memory for Personalized Product Reranking. We study personalized LLM reranking for shopping agents and show that explicit preference memory works much better than naively appending raw history. We also introduce an end-to-end benchmark and train the memory extractor with RL using downstream reranking performance as supervision. Results show consistent improvements across two LLM rerankers, with gains up to +10.61 absolute points. Feedback is very welcome.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- Shopping Companion: A Memory-Augmented LLM Agent for Real-World E-Commerce Tasks (2026)
- From Logs to Language: Learning Optimal Verbalization for LLM-Based Recommendation at Industry Scale (2026)
- User Preference Modeling for Conversational LLM Agents: Weak Rewards from Retrieval-Augmented Interaction (2026)
- MLLMRec-R1: Incentivizing Reasoning Capability in Large Language Models for Multimodal Sequential Recommendation (2026)
- Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation (2026)
- AMEM4Rec: Leveraging Cross-User Similarity for Memory Evolution in Agentic LLM Recommenders (2026)
- AIGQ: An End-to-End Hybrid Generative Architecture for E-commerce Query Recommendation (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2603.29247 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper
Collections including this paper 0
No Collection including this paper