Awesome LLM For RecSys Save

Survey: A collection of AWESOME papers and resources on the large language model (LLM) related recommender system topics.

Project README

Awesome-LLM-for-RecSys

A collection of AWESOME papers and resources on the large language model (LLM) related recommender system topics.

:satisfied: Please check out our survey paper for LLM-enhanced RS: How Can Recommender Systems Benefit from Large Language Models: A Survey

To catch up with the latest research progress, this repository will be actively maintained as well as our released survey paper. Newly added papers will first appear in 1.6 Paper Pending List: to be Added to Our Survey Paper section.

:rocket: 2024.02.05 - Paper v5 released: New release with 27-page main content & more thorough taxonomies.

Survey Paper Update Logs

2023.06.29 - Paper v5 released: New release with 27-page main content & more thorough taxonomies.
2023.06.29 - Paper v4 released: 7 papers have been newly added.
2023.06.28 - Paper v3 released: Fix typos.
2023.06.12 - Paper v2 released: Add summerization table in the appendix.
2023.06.09 - Paper v1 released: Initial version.

1. Papers

We classify papers according to where LLM will be adapted in the pipeline of RS, which is summarized in the figure below.

1.1 LLM for Feature Engineering

1.1.1 User- and Item-level Feature Augmentation

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
LLM4KGC	Knowledge Graph Completion Models are Few-shot Learners: An Empirical Study of Relation Labeling in E-commerce with LLMs	PaLM (540B)/ ChatGPT	Frozen	Arxiv 2023	[Link]
TagGPT	TagGPT: Large Language Models are Zero-shot Multimodal Taggers	ChatGPT	Frozen	Arxiv 2023	[Link]
ICPC	Large Language Models for User Interest Journeys	LaMDA (137B)	Full Finetuning/ Prompt Tuning	Arxiv 2023	[Link]
KAR	Towards Open-World Recommendation with Knowledge Augmentation from Large Language Models	ChatGPT	Frozen	Arxiv 2023	[Link]
PIE	Product Information Extraction using ChatGPT	ChatGPT	Frozen	Arxiv 2023	[Link]
LGIR	Enhancing Job Recommendation through LLM-based Generative Adversarial Networks	GhatGLM (6B)	Frozen	AAAI 2024	[Link]
GIRL	Generative Job Recommendations with Large Language Model	BELLE (7B)	Full Finetuning	Arxiv 2023	[Link]
LLM-Rec	LLM-Rec: Personalized Recommendation via Prompting Large Language Models	text-davinci-003	Frozen	Arxiv 2023	[Link]
HKFR	Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLM	ChatGPT	Frozen	RecSys 2023	[Link]
LLaMA-E	LLaMA-E: Empowering E-commerce Authoring with Multi-Aspect Instruction Following	LLaMA (30B)	LoRA	Arxiv 2023	[Link]
EcomGPT	EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce	BLOOMZ (7.1B)	Full Finetuning	Arxiv 2023	[Link]
TF-DCon	Leveraging Large Language Models (LLMs) to Empower Training-Free Dataset Condensation for Content-Based Recommendation	ChatGPT	Frozen	Arxiv 2023	[Link]
RLMRec	Representation Learning with Large Language Models for Recommendation	ChatGPT	Frozen	WWW 2024	[Link]
LLMRec	LLMRec: Large Language Models with Graph Augmentation for Recommendation	ChatGPT	Frozen	WSDM 2024	[Link]
LLMRG	Enhancing Recommender Systems with Large Language Model Reasoning Graphs	GPT4	Frozen	Arxiv 2023	[Link]
CUP	Recommendations by Concise User Profiles from Review Text	ChatGPT	Frozen	Arxiv 2023	[Link]
SINGLE	Modeling User Viewing Flow using Large Language Models for Article Recommendation	ChatGPT	Frozen	Arxiv 2023	[Link]
SAGCN	Understanding Before Recommendation: Semantic Aspect-Aware Review Exploitation via Large Language Models	Vicuna (13B)	Frozen	Arxiv 2023	[Link]
UEM	User Embedding Model for Personalized Language Prompting	FLAN-T5-base (250M)	Full Finetuning	Arxiv 2024	[Link]
LLMHG	LLM-Guided Multi-View Hypergraph Learning for Human-Centric Explainable Recommendation	GPT4	Frozen	Arxiv 2024	[Link]
Llama4Rec	Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation	LLaMA2 (7B)	Full Finetuning	Arxiv 2024	[Link]

1.1.2 Instance-level Sample Generation

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
GReaT	Language Models are Realistic Tabular Data Generators	GPT2-medium (355M)	Full Finetuning	ICLR 2023	[Link]
ONCE	ONCE: Boosting Content-based Recommendation with Both Open- and Closed-source Large Language Models	ChatGPT	Frozen	WSDM 2024	[Link]
AnyPredict	AnyPredict: Foundation Model for Tabular Prediction	ChatGPT	Frozen	Arxiv 2023	[Link]
DPLLM	Privacy-Preserving Recommender Systems with Synthetic Query Generation using Differentially Private Large Language Models	T5-XL (3B)	Full Finetuning	Arxiv 2023	[Link]
MINT	Large Language Model Augmented Narrative Driven Recommendations	text-davinci-003	Frozen	RecSys 2023	[Link]
Agent4Rec	On Generative Agents in Recommendation	ChatGPT	Frozen	Arxiv 2023	[Link]
RecPrompt	RecPrompt: A Prompt Tuning Framework for News Recommendation Using Large Language Models	GPT4	Frozen	Arxiv 2023	[Link]
PO4ISR	Large Language Models for Intent-Driven Session Recommendations	ChatGPT	Frozen	Arxiv 2023	[Link]
BEQUE	Large Language Model based Long-tail Query Rewriting in Taobao Search	ChatGLM (6B)	FFT	Arxiv 2023	[Link]
Agent4Ranking	Agent4Ranking: Semantic Robust Ranking via Personalized Query Rewriting Using Multi-agent LLM	ChatGPT	Frozen	Arxiv 2023	[Link]

1.2 LLM as Feature Encoder

1.2.1 Representation Enhancement

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
U-BERT	U-BERT: Pre-training User Representations for Improved Recommendation	BERT-base (110M)	Full Finetuning	AAAI 2021	[Link]
UNBERT	UNBERT: User-News Matching BERT for News Recommendation	BERT-base (110M)	Full Finetuning	IJCAI 2021	[Link]
PLM-NR	Empowering News Recommendation with Pre-trained Language Models	RoBERTa-base (125M)	Full Finetuning	SIGIR 2021	[Link]
Pyramid-ERNIE	Pre-trained Language Model based Ranking in Baidu Search	ERNIE (110M)	Full Finetuning	KDD 2021	[Link]
ERNIE-RS	Pre-trained Language Model for Web-scale Retrieval in Baidu Search	ERNIE (110M)	Full Finetuning	KDD 2021	[Link]
CTR-BERT	CTR-BERT: Cost-effective knowledge distillation for billion-parameter teacher models	Customized BERT (1.5B)	Full Finetuning	ENLSP 2021	[Link]
SuKD	Learning Supplementary NLP Features for CTR Prediction in Sponsored Search	RoBERTa-large (355M)	Full Finetuning	KDD 2022	[Link]
PREC	Boosting Deep CTR Prediction with a Plug-and-Play Pre-trainer for News Recommendation	BERT-base (110M)	Full Finetuning	COLING 2022	[Link]
MM-Rec	MM-Rec: Visiolinguistic Model Empowered Multimodal News Recommendation	BERT-base (110M)	Full Finetuning	SIGIR 2022	[Link]
Tiny-NewsRec	Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation	UniLMv2-base (110M)	Full Finetuning	EMNLP 2022	[Link]
PLM4Tag	PTM4Tag: Sharpening Tag Recommendation of Stack Overflow Posts with Pre-trained Models	CodeBERT (125M)	Full Finetuning	ICPC 2022	[Link]
TwHIN-BERT	TwHIN-BERT: A Socially-Enriched Pre-trained Language Model for Multilingual Tweet Representations	BERT-base (110M)	Full Finetuning	Arxiv 2022	[Link]
LSH	Improving Code Example Recommendations on Informal Documentation Using BERT and Query-Aware LSH: A Comparative Study	BERT-base (110M)	Full Finetuning	Arxiv 2023	[Link]
LLM2BERT4Rec	Leveraging Large Language Models for Sequential Recommendation	text-embedding-ada-002	Frozen	RecSys 2023	[Link]
LLM4ARec	Prompt Tuning Large Language Models on Personalized Aspect Extraction for Recommendations	GPT2 (110M)	Prompt Tuning	Arxiv 2023	[Link]
TIGER	Recommender Systems with Generative Retrieval	Sentence-T5-base (223M)	Frozen	NIPS 2023	[Link]
TBIN	TBIN: Modeling Long Textual Behavior Data for CTR Prediction	BERT-base (110M)	Frozen	DLP-RecSys 2023	[Link]
LKPNR	LKPNR: LLM and KG for Personalized News Recommendation Framework	LLaMA2 (7B)	Frozen	Arxiv 2023	[Link]
SSNA	Towards Efficient and Effective Adaptation of Large Language Models for Sequential Recommendation	DistilRoBERTa-base (83M)	Layerwise Adapter Tuning	Arxiv 2023	[Link]
CollabContext	Collaborative Contextualization: Bridging the Gap between Collaborative Filtering and Pre-trained Language Model	Instructor-XL (1.5B)	Frozen	Arxiv 2023	[Link]
LMIndexer	Language Models As Semantic Indexers	T5-base (223M)	Full Finetuning	Arxiv 2023	[Link]
Stack	A BERT based Ensemble Approach for Sentiment Classification of Customer Reviews and its Application to Nudge Marketing in e-Commerce	BERT-base (110M)	Frozen	Arxiv 2023	[Link]
N/A	Utilizing Language Models for Tour Itinerary Recommendation	BERT-base (110M)	Full Finetuning	PMAI@IJCAI 2023	[Link]
UEM	User Embedding Model for Personalized Language Prompting	Sentence-T5-base (223M)	Frozen	Arxiv 2024	[Link]
Social-LLM	Social-LLM: Modeling User Behavior at Scale using Language Models and Social Network Data	SBERT-MPNet-base (110M)	Frozen	Arxiv 2024	[Link]
LLMRS	LLMRS: Unlocking Potentials of LLM-Based Recommender Systems for Software Purchase	MPNet (110M)	Frozen	Arxiv 2024	[Link]

1.2.2 Unified Cross-domain Recommendation

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
ZESRec	Zero-Shot Recommender Systems	BERT-base (110M)	Frozen	Arxiv 2021	[Link]
UniSRec	Towards Universal Sequence Representation Learning for Recommender Systems	BERT-base (110M)	Frozen	KDD 2022	[Link]
TransRec	TransRec: Learning Transferable Recommendation from Mixture-of-Modality Feedback	BERT-base (110M)	Full Finetuning	Arxiv 2022	[Link]
VQ-Rec	Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders	BERT-base (110M)	Frozen	WWW 2023	[Link]
IDRec vs MoRec	Where to Go Next for Recommender Systems? ID- vs. Modality-based Recommender Models Revisited	BERT-base (110M)	Full Finetuning	SIGIR 2023	[Link]
TransRec	Exploring Adapter-based Transfer Learning for Recommender Systems: Empirical Studies and Practical Insights	RoBERTa-base (125M)	Layerwise Adapter Tuning	Arxiv 2023	[Link]
TCF	Exploring the Upper Limits of Text-Based Collaborative Filtering Using Large Language Models: Discoveries and Insights	OPT-175B (175B)	Frozen/ Full Finetuning	Arxiv 2023	[Link]
S&R Foundation	An Unified Search and Recommendation Foundation Model for Cold-Start Scenario	ChatGLM (6B)	Frozen	CIKM 2023	[Link]
MISSRec	MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation	CLIP-B/32 (400M)	Full Finetuning	MM 2023	[Link]
UFIN	UFIN: Universal Feature Interaction Network for Multi-Domain Click-Through Rate Prediction	FLAN-T5-base (250M)	Frozen	Arxiv 2023	[Link]
PMMRec	Multi-Modality is All You Need for Transferable Recommender Systems	RoBERTa-large (355M)	Top-2-layer Finetuning	ICDE 2024	[Link]
Uni-CTR	A Unified Framework for Multi-Domain CTR Prediction via Large Language Models	Sheared-LLaMA (1.3B)	LoRA	Arxiv 2023	[Link]

1.3 LLM as Scoring/Ranking Function

1.3.1 Item Scoring Task

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
LMRecSys	Language Models as Recommender Systems: Evaluations and Limitations	GPT2-XL (1.5B)	Full Finetuning	ICBINB 2021	[Link]
PTab	PTab: Using the Pre-trained Language Model for Modeling Tabular Data	BERT-base (110M)	Full Finetuning	Arxiv 2022	[Link]
UniTRec	UniTRec: A Unified Text-to-Text Transformer and Joint Contrastive Learning Framework for Text-based Recommendation	BART (406M)	Full Finetuning	ACL 2023	[Link]
Prompt4NR	Prompt Learning for News Recommendation	BERT-base (110M)	Full Finetuning	SIGIR 2023	[Link]
RecFormer	Text Is All You Need: Learning Language Representations for Sequential Recommendation	LongFormer (149M)	Full Finetuning	KDD 2023	[Link]
TabLLM	TabLLM: Few-shot Classification of Tabular Data with Large Language Models	T0 (11B)	Few-shot Parameter-effiecnt Finetuning	AISTATS 2023	[Link]
Zero-shot GPT	Zero-Shot Recommendation as Language Modeling	GPT2-medium (355M)	Frozen	Arxiv 2023	[Link]
FLAN-T5	Do LLMs Understand User Preferences? Evaluating LLMs On User Rating Prediction	FLAN-5-XXL (11B)	Full Finetuning	Arxiv 2023	[Link]
BookGPT	BookGPT: A General Framework for Book Recommendation Empowered by Large Language Model	ChatGPT	Frozen	Arxiv 2023	[Link]
TALLRec	TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation	LLaMA (7B)	LoRA	RecSys 2023	[Link]
PBNR	PBNR: Prompt-based News Recommender System	T5-small (60M)	Full Finetuning	Arxiv 2023	[Link]
CR-SoRec	CR-SoRec: BERT driven Consistency Regularization for Social Recommendation	BERT-base (110M)	Full Finetuning	RecSys 2023	[Link]
PromptRec	Towards Personalized Cold-Start Recommendation with Prompts	LLaMA (7B)	Frozen	Arxiv 2023	[Link]
GLRec	Exploring Large Language Model for Graph Data Understanding in Online Job Recommendations	BELLE-LLaMA (7B)	LoRA	Arxiv 2023	[Link]
BERT4CTR	BERT4CTR: An Efficient Framework to Combine Pre-trained Language Model with Non-textual Features for CTR Prediction	RoBERTa-large (355M)	Full Finetuning	KDD 2023	[Link]
ReLLa	ReLLa: Retrieval-enhanced Large Language Models for Lifelong Sequential Behavior Comprehension in Recommendation	Vicuna (13B)	LoRA	WWW 2024	[Link]
TASTE	Text Matching Improves Sequential Recommendation by Reducing Popularity Biases	T5-base (223M)	Full Finetuning	CIKM 2023	[Link]
N/A	Unveiling Challenging Cases in Text-based Recommender Systems	BERT-base (110M)	Full Finetuning	RecSys Workshop 2023	[Link]
ClickPrompt	ClickPrompt: CTR Models are Strong Prompt Generators for Adapting Language Models to CTR Prediction	RoBERTa-large (355M)	Full Finetuning	WWW 2024	[Link]
SetwiseRank	A Setwise Approach for Effective and Highly Efficient Zero-shot Ranking with Large Language Models	FLAN-T5-XXL (11B)	Frozen	Arxiv 2023	[Link]
UPSR	Thoroughly Modeling Multi-domain Pre-trained Recommendation as Language	T5-base (223M)	Full Finetuning	Arxiv 2023	[Link]
LLM-Rec	One Model for All: Large Language Models are Domain-Agnostic Recommendation Systems	OPT (6.7B)	LoRA	Arxiv 2023	[Link]
LLMRanker	Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels	FLAN PaLM2 S	Frozen	Arxiv 2023	[Link]
CoLLM	CoLLM: Integrating Collaborative Embeddings into Large Language Models for Recommendation	Vicuna (7B)	LoRA	Arxiv 2023	[Link]
FLIP	FLIP: Towards Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction	RoBERTa-large (355M)	Full Finetuning	Arxiv 2023	[Link]
BTRec	BTRec: BERT-Based Trajectory Recommendation for Personalized Tours	BERT-base (110M)	Full Finetuning	Arxiv 2023	[Link]
CLLM4Rec	Collaborative Large Language Model for Recommender Systems	GPT2 (110M)	Full Finetuning	Arxiv 2023	[Link]
CUP	Recommendations by Concise User Profiles from Review Text	BERT-base (110M)	Last-layer Finetuning	Arxiv 2023	[Link]
N/A	Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers	FLAN-T5-XL (3B)	Full Finetuning	Arxiv 2023	[Link]
CoWPiRec	Collaborative Word-based Pre-trained Item Representation for Transferable Recommendation	BERT-base (110M)	Full Finetuning	ICDM 2023	[Link]
RecExplainer	RecExplainer: Aligning Large Language Models for Recommendation Model Interpretability	Vicuna-v1.3 (7B)	LoRA	Arxiv 2023	[Link]
E4SRec	E4SRec: An Elegant Effective Efficient Extensible Solution of Large Language Models for Sequential Recommendation	LLaMA2 (13B)	LoRA	Arxiv 2023	[Link]
CER	The Problem of Coherence in Natural Language Explanations of Recommendations	GPT2 (110M)	Full Finetuning	ECAI 2023	[Link]
LSAT	Preliminary Study on Incremental Learning for Large Language Model-based Recommender Systems	LLaMA (7B)	LoRA	Arxiv 2023	[Link]
Llama4Rec	Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation	LLaMA2 (7B)	Full Finetuning	Arxiv 2024	[Link]

1.3.2 Item Generation Task

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
GPT4Rec	GPT4Rec: A Generative Framework for Personalized Recommendation and User Interests Interpretation	GPT2 (110M)	Full Finetuning	Arxiv 2023	[Link]
VIP5	VIP5: Towards Multimodal Foundation Models for Recommendation	T5-base (223M)	Layerwise Adater Tuning	EMNLP 2023	[Link]
P5-ID	How to Index Item IDs for Recommendation Foundation Models	T5-small (60M)	Full Finetuning	Arxiv 2023	[Link]
FaiRLLM	Is ChatGPT Fair for Recommendation? Evaluating Fairness in Large Language Model Recommendation	ChatGPT	Frozen	RecSys 2023	[Link]
PALR	PALR: Personalization Aware LLMs for Recommendation	LLaMA (7B)	Full Finetuning	Arxiv 2023	[Link]
ChatGPT	Large Language Models are Zero-Shot Rankers for Recommender Systems	ChatGPT	Frozen	ECIR 2024	[Link]
AGR	Sparks of Artificial General Recommender (AGR): Early Experiments with ChatGPT	ChatGPT	Frozen	Arxiv 2023	[Link]
NIR	Zero-Shot Next-Item Recommendation using Large Pretrained Language Models	GPT3 (175B)	Frozen	Arxiv 2023	[Link]
GPTRec	Generative Sequential Recommendation with GPTRec	GPT2-medium (355M)	Full Finetuning	Gen-IR@SIGIR 2023	[Link]
ChatNews	A Preliminary Study of ChatGPT on News Recommendation: Personalization, Provider Fairness, Fake News	ChatGPT	Frozen	Arxiv 2023	[Link]
N/A	Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based Preferences	PaLM (62B)	Frozen	RecSys 2023	[Link]
LLMSeqPrompt	Leveraging Large Language Models for Sequential Recommendation	OpenAI ada model	Finetune	RecSys 2023	[Link]
GenRec	GenRec: Large Language Model for Generative Recommendation	LLaMA (7B)	LoRA	Arxiv 2023	[Link]
UP5	UP5: Unbiased Foundation Model for Fairness-aware Recommendation	T5-base (223M)	Prefix Tuning	Arxiv 2023	[Link]
HKFR	Heterogeneous Knowledge Fusion: A Novel Approach for Personalized Recommendation via LLM	ChatGLM (6B)	LoRA	RecSys 2023	[Link]
N/A	The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations	ChatGPT	Frozen	EAAMO 2023	[Link]
BIGRec	A Bi-Step Grounding Paradigm for Large Language Models in Recommendation Systems	LLaMA (7B)	LoRA	Arxiv 2023	[Link]
KP4SR	Knowledge Prompt-tuning for Sequential Recommendation	T5-small (60M)	Full Finetuning	Arxiv 2023	[Link]
RecSysLLM	Leveraging Large Language Models for Pre-trained Recommender Systems	GLM (10B)	LoRA	Arxiv 2023	[Link]
POD	Prompt Distillation for Efficient LLM-based Recommendation	T5-small (60M)	Full Finetuning	CIKM 2023	[Link]
N/A	Evaluating ChatGPT as a Recommender System: A Rigorous Approach	ChatGPT	Frozen	Arxiv 2023	[Link]
RaRS	Retrieval-augmented Recommender System: Enhancing Recommender Systems with Large Language Models	ChatGPT	Frozen	RecSys Doctoral Symposium 2023	[Link]
JobRecoGPT	JobRecoGPT -- Explainable job recommendations using LLMs	GPT4	Frozen	Arxiv 2023	[Link]
LANCER	Reformulating Sequential Recommendation: Learning Dynamic User Interest with Content-enriched Language Modeling	GPT2 (110M)	Prefix Tuning	Arxiv 2023	[Link]
TransRec	A Multi-facet Paradigm to Bridge Large Language Model and Recommendation	LLaMA (7B)	LoRA	Arxiv 2023	[Link]
AgentCF	AgentCF: Collaborative Learning with Autonomous Language Agents for Recommender Systems	text-davinci-003 & gpt-3.5-turbo	Frozen	WWW 2024	[Link]
P4LM	Factual and Personalized Recommendations using Language Models and Reinforcement Learning	PaLM2-XS	Full Finetuning	Arxiv 2023	[Link]
InstructMK	Multiple Key-value Strategy in Recommendation Systems Incorporating Large Language Model	LLaMA (7B)	Full Finetuning	CIKM GenRec 2023	[Link]
LightLM	LightLM: A Lightweight Deep and Narrow Language Model for Generative Recommendation	T5-small (60M)	Full Finetuning	Arxiv 2023	[Link]
LlamaRec	LlamaRec: Two-Stage Recommendation using Large Language Models for Ranking	LLaMA2 (7B)	QLoRA	PGAI@CIKM 2023	[Link]
N/A	Exploring Recommendation Capabilities of GPT-4V(ision): A Preliminary Case Study	GPT-4V	Frozen	Arxiv 2023	[Link]
N/A	Exploring Fine-tuning ChatGPT for News Recommendation	ChatGPT	gpt-3.5-turbo finetuning API	Arxiv 2023	[Link]
N/A	Do LLMs Implicitly Exhibit User Discrimination in Recommendation? An Empirical Study	ChatGPT	Frozen	Arxiv 2023	[Link]
LC-Rec	Adapting Large Language Models by Integrating Collaborative Semantics for Recommendation	LLaMA (7B)	LoRA	Arxiv 2023	[Link]
DOKE	Knowledge Plugins: Enhancing Large Language Models for Domain-Specific Recommendations	ChatGPT	Frozen	Arxiv 2023	[Link]
ControlRec	ControlRec: Bridging the Semantic Gap between Language Model and Personalized Recommendation	T5-base (223M)	Full Finetuning	Arxiv 2023	[Link]
LLaRA	LLaRA: Aligning Large Language Models with Sequential Recommenders	LLaMA2 (7B)	LoRA	Arxiv 2023	[Link]
PO4ISR	Large Language Models for Intent-Driven Session Recommendations	ChatGPT	Frozen	Arxiv 2023	[Link]
DRDT	DRDT: Dynamic Reflection with Divergent Thinking for LLM-based Sequential Recommendation	ChatGPT	Frozen	Arxiv 2023	[Link]
RecPrompt	RecPrompt: A Prompt Tuning Framework for News Recommendation Using Large Language Models	GPT4	Frozen	Arxiv 2023	[Link]
LiT5	Scaling Down, LiTting Up: Efficient Zero-Shot Listwise Reranking with Seq2seq Encoder-Decoder Models	T5-XL (3B)	Full Finetuning	Arxiv 2023	[Link]
STELLA	Large Language Models are Not Stable Recommender Systems	ChatGPT	Frozen	Arxiv 2023	[Link]
Llama4Rec	Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation	LLaMA2 (7B)	Full Finetuning	Arxiv 2024	[Link]

1.3.3 Hybrid Task

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
P5	Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5)	T5-base (223M)	Full Finetuning	RecSys 2022	[Link]
M6-Rec	M6-Rec: Generative Pretrained Language Models are Open-Ended Recommender Systems	M6-base (300M)	Option Tuning	Arxiv 2022	[Link]
InstructRec	Recommendation as Instruction Following: A Large Language Model Empowered Recommendation Approach	FLAN-T5-XL (3B)	Full Finetuning	Arxiv 2023	[Link]
ChatGPT	Is ChatGPT a Good Recommender? A Preliminary Study	ChatGPT	Frozen	Arxiv 2023	[Link]
ChatGPT	Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agent	ChatGPT	Frozen	Arxiv 2023	[Link]
ChatGPT	Uncovering ChatGPT's Capabilities in Recommender Systems	ChatGPT	Frozen	RecSys 2023	[Link]
BDLM	Bridging the Information Gap Between Domain-Specific Model and General LLM for Personalized Recommendation	Vicuna (7B)	Full Finetuning	Arxiv 2023	[Link]
RecRanker	RecRanker: Instruction Tuning Large Language Model as Ranker for Top-k Recommendation	LLaMA2 (13B)	Full Finetuning	Arxiv 2023	[Link]

1.4 LLM for User Interaction

1.4.1 Task-oriented User Interaction

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
TG-ReDial	Towards Topic-Guided Conversational Recommender System	BERT-base (110M) & GPT2 (110M)	Unknown	COLING 2020	[Link]
TCP	Follow Me: Conversation Planning for Target-driven Recommendation Dialogue Systems	BERT-base (110M)	Full Finetuning	Arxiv 2022	[Link]
MESE	Improving Conversational Recommendation Systems' Quality with Context-Aware Item Meta-Information	DistilBERT (67M) & GPT2 (110M)	Full Finetuning	ACL 2022	[Link]
UniMIND	A Unified Multi-task Learning Framework for Multi-goal Conversational Recommender Systems	BART-base (139M)	Full Finetuning	ACM TOIS 2023	[Link]
VRICR	Variational Reasoning over Incomplete Knowledge Graphs for Conversational Recommendation	BERT-base (110M)	Full Finetuning	WSDM 2023	[Link]
KECR	Explicit Knowledge Graph Reasoning for Conversational Recommendation	BERT-base (110M) & GPT2 (110M)	Frozen	ACM TIST 2023	[Link]
N/A	Large Language Models as Zero-Shot Conversational Recommenders	GPT4	Frozen	CIKM 2023	[Link]
MuseChat	MuseChat: A Conversational Music Recommendation System for Videos	Vicuna (7B)	LoRA	Arxiv 2023	[Link]
N/A	Conversational Recommender System and Large Language Model Are Made for Each Other in E-commerce Pre-sales Dialogue	Chinese-Alpaca (7B)	LoRA	EMNLP 2023 Findings	[Link]

1.4.2 Open-ended User Interaction

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
BARCOR	BARCOR: Towards A Unified Framework for Conversational Recommendation Systems	BART-base (139M)	Selective-layer Finetuning	Arxiv 2022	[Link]
RecInDial	RecInDial: A Unified Framework for Conversational Recommendation with Pretrained Language Models	DialoGPT (110M)	Full Finetuning	AACL 2022	[Link]
UniCRS	Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning	DialoGPT-small (176M)	Frozen	KDD 2022	[Link]
T5-CR	Multi-Task End-to-End Training Improves Conversational Recommendation	T5-base (223M)	Full Finetuning	Arxiv 2023	[Link]
TtW	Talk the Walk: Synthetic Data Generation for Conversational Music Recommendation	T5-base (223M) & T5-XXL (11B)	Full Finetuning & Frozen	Arxiv 2023	[Link]
N/A	Rethinking the Evaluation for Conversational Recommendation in the Era of Large Language Models	ChatGPT	Frozen	EMNLP 2023	[Link]

1.5 LLM for RS Pipeline Controller

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
Chat-REC	Chat-REC: Towards Interactive and Explainable LLMs-Augmented Recommender System	ChatGPT	Frozen	Arxiv 2023	[Link]
RecLLM	Leveraging Large Language Models in Conversational Recommender Systems	LLaMA (7B)	Full Finetuning	Arxiv 2023	[Link]
RAH	RAH! RecSys-Assistant-Human: A Human-Central Recommendation Framework with Large Language Models	GPT4	Frozen	Arxiv 2023	[Link]
RecMind	RecMind: Large Language Model Powered Agent For Recommendation	ChatGPT	Frozen	NAACL 2024	[Link]
InteRecAgent	Recommender AI Agent: Integrating Large Language Models for Interactive Recommendations	GPT4	Frozen	Arxiv 2023	[Link]
CORE	Lending Interaction Wings to Recommender Systems with Conversational Agents	N/A	N/A	NIPS 2023	[Link]

1.6 Other Related Papers

1.6.1 Related Survey Papers

Paper	Publication	Link
A Review of Modern Recommender Systems Using Generative Models (Gen-RecSys)	Arxiv 2024	[Link]
Exploring the Impact of Large Language Models on Recommender Systems: An Extensive Review	Arxiv 2024	[Link]
Foundation Models for Recommender Systems: A Survey and New Perspectives	Arxiv 2024	[Link]
Prompting Large Language Models for Recommender Systems: A Comprehensive Framework and Empirical Analysis	Arixv 2024	[Link]
User Modeling in the Era of Large Language Models: Current Research and Future Directions	IEEE Data Engineering Bulletin 2023	[Link]
A Survey on Large Language Models for Personalized and Explainable Recommendations	Arxiv 2023	[Link]
Large Language Models for Generative Recommendation: A Survey and Visionary Discussions	Arxiv 2023	[Link]
Large Language Models for Information Retrieval: A Survey	Arxiv 2023	[Link]
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities	Arxiv 2023	[Link]
Recommender Systems in the Era of Large Language Models (LLMs)	Arxiv 2023	[Link]
A Survey on Large Language Models for Recommendation	Arxiv 2023	[Link]
Pre-train, Prompt and Recommendation: A Comprehensive Survey of Language Modelling Paradigm Adaptations in Recommender Systems	TACL 2023	[Link]
Self-Supervised Learning for Recommender Systems: A Survey	TKDE 2022	[Link]

1.6.2 Other Papers

Paper	Publication	Link
Large Language Model Can Interpret Latent Space of Sequential Recommender	Arxiv 2023	[Link]
Zero-Shot Recommendations with Pre-Trained Large Language Models for Multimodal Nudging	Arxiv 2023	[Link]
INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning	Arxiv 2024	[Link]
Evaluation of Synthetic Datasets for Conversational Recommender Systems	Arxiv 2023	[Link]
Generative Recommendation: Towards Next-generation Recommender Paradigm	Arxiv 2023	[Link]
Towards Personalized Prompt-Model Retrieval for Generative Recommendation	Arxiv 2023	[Link]
Generative Next-Basket Recommendation	RecSys 2023	[Link]

1.7 Paper Pending List: to be Added to Our Survey Paper

Name	Paper	LLM Backbone (Largest)	LLM Tuning Strategy	Publication	Link
	A Large Language Model Enhanced Conversational Recommender System			Arxiv 2023	[Link]
	Improving Conversational Recommendation Systems via Bias Analysis and Language-Model-Enhanced Data Augmentation			Arxiv 2023	[Link]
	Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems			Arxiv 2023	[Link]
	Unlocking the Potential of Large Language Models for Explainable Recommendations			Arxiv 2023	[Link]
	The Challenge of Using LLMs to Simulate Human Behavior: A Causal Inference Perspective			Arxiv 2023	[Link]
	Empowering Few-Shot Recommender Systems with Large Language Models -- Enhanced Representations			IEEE Access	[Link]
	dIR -- Discrete Information Retrieval: Conversational Search over Unstructured (and Structured) Data with Large Language Models			Arxiv 2023	[Link]
Logic-Scaffolding	Logic-Scaffolding: Personalized Aspect-Instructed Recommendation Explanation Generation using LLMs	Falcon (40B)	Frozen	WSDM 2024	[Link]
	Unveiling Bias in Fairness Evaluations of Large Language Models: A Critical Literature Review of Music and Movie Recommendation Systems			Arxiv 2024	[Link]
	ChatGPT for Conversational Recommendation: Refining Recommendations by Reprompting with Feedback			Arxiv 2024	[Link]
	Combining Embedding-Based and Semantic-Based Models for Post-hoc Explanations in Recommender Systems			Arxiv 2024	[Link]
	Understanding Biases in ChatGPT-based Recommender Systems: Provider Fairness, Temporal Stability, and Recency			Arxiv 2024	[Link]
	LLM4Vis: Explainable Visualization Recommendation using ChatGPT			EMNLP 2023	[Link]
	Parameter-Efficient Conversational Recommender System as a Language Processing Task			EACL 2024	[Link]
	Data-efficient Fine-tuning for LLM-based Recommendation			Arxiv 2024	[Link]
	Prompt-enhanced Federated Content Representation Learning for Cross-domain Recommendation			WWW 2024	[Link]
	LoRec: Large Language Model for Robust Sequential Recommendation against Poisoning Attacks			Arxiv 2024	[Link]
	PAP-REC: Personalized Automatic Prompt for Recommendation Language Model			Arxiv 2024	[Link]
	From PARIS to LE-PARIS: Toward Patent Response Automation with Recommender Systems and Collaborative Large Language Models			Arxiv 2024	[Link]
	Improving Sequential Recommendations with LLMs			Arxiv 2024	[Link]
	A Multi-Agent Conversational Recommender System			Arxiv 2024	[Link]
	TransFR: Transferable Federated Recommendation with Pre-trained Language Models			Arxiv 2024	[Link]
	Large Language Model Distilling Medication Recommendation Model			Arxiv 2024	[Link]
	Uncertainty-Aware Explainable Recommendation with Large Language Models			Arxiv 2024	[Link]
	Natural Language User Profiles for Transparent and Scrutable Recommendations			Arxiv 2024	[Link]
	Leveraging LLMs for Unsupervised Dense Retriever Ranking			Arxiv 2024	[Link]
	RA-Rec: An Efficient ID Representation Alignment Framework for LLM-based Recommendation			Arxiv 2024	[Link]
	A Multi-Agent Conversational Recommender System			Arxiv 2024	[Link]
	Fairly Evaluating Large Language Model-based Recommendation Needs Revisit the Cross-Entropy Loss			Arxiv 2024	[Link]
	SearchAgent: A Lightweight Collaborative Search Agent with Large Language Models			Arxiv 2024	[Link]
	Large Language Model Interaction Simulator for Cold-Start Item Recommendation			Arxiv 2024	[Link]
	Enhancing ID and Text Fusion via Alternative Training in Session-based Recommendation			Arxiv 2024	[Link]
	eCeLLM: Generalizing Large Language Models for E-commerce from Large-scale, High-quality Instruction Data			Arxiv 2024	[Link]
	LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendations			Arxiv 2024	[Link]
	LLM-based Federated Recommendation			Arxiv 2024	[Link]
	Rethinking Large Language Model Architectures for Sequential Recommendations			Arxiv 2024	[Link]
	Large Language Model with Graph Convolution for Recommendation			Arxiv 2024	[Link]
	Rec-GPT4V: Multimodal Recommendation with Large Vision-Language Models			Arxiv 2024	[Link]
	Enhancing Recommendation Diversity by Re-ranking with Large Language Models			Arxiv 2024	[Link]
	Are ID Embeddings Necessary? Whitening Pre-trained Text Embeddings for Effective Sequential Recommendation			Arxiv 2024	[Link]
	SPAR: Personalized Content-Based Recommendation via Long Engagement Attention			Arxiv 2024	[Link]
	Cognitive Personalized Search Integrating Large Language Models with an Efficient Memory Mechanism			WWW 2024	[Link]
	Large Language Models as Data Augmenters for Cold-Start Item Recommendation			Arxiv 2024	[Link]
	Explain then Rank: Scale Calibration of Neural Rankers Using Natural Language Explanations from Large Language Models			Arxiv 2024	[Link]
	LLM4SBR: A Lightweight and Effective Framework for Integrating Large Language Models in Session-based Recommendation			Arxiv 2024	[Link]
	Breaking the Barrier: Utilizing Large Language Models for Industrial Recommendation Systems through an Inferential Knowledge Graph			Arxiv 2024	[Link]
	User-LLM: Efficient LLM Contextualization with User Embeddings			Arxiv 2024	[Link]
	Stealthy Attack on Large Language Model based Recommendation			Arxiv 2024	[Link]
	Multi-Agent Collaboration Framework for Recommender Systems			Arxiv 2024	[Link]
	Item-side Fairness of Large Language Model-based Recommendation System			WWW 2024	[Link]
	Integrating Large Language Models with Graphical Session-Based Recommendation			Arxiv 2024	[Link]
	Language-Based User Profiles for Recommendation			LLM-IGS@WSDM2024	[Link]
	BASES: Large-scale Web Search User Simulation with Large Language Model based Agents			Arxiv 2024	[Link]
	Prospect Personalized Recommendation on Large Language Model-based Agent Platform			Arxiv 2024	[Link]
	Sequence-level Semantic Representation Fusion for Recommender Systems			Arxiv 2024	[Link]
	Corpus-Steered Query Expansion with Large Language Models			ECAL 2024	[Link]
NoteLLM	NoteLLM: A Retrievable Large Language Model for Note Recommendation	LLaMA2 (7B)	Full Finetuning	WWW 2024	[Link]
PP-GLAM	An Interpretable Ensemble of Graph and Language Models for Improving Search Relevance in E-Commerce	M-DeBERTa-base (276M)	Full Finetuning	WWW 2024	[Link]
LLM-Ensemble	LLM-Ensemble: Optimal Large Language Model Ensemble Method for E-commerce Product Attribute Value Extraction	GPT4	Frozen	Arxiv 2024	[Link]
BiLLP	Enhancing Long-Term Recommendation with Bi-level Learnable Large Language Model Planning	ChatGPT	Frozen	Arxiv 2024	[Link]
InteraRec	InteraRec: Interactive Recommendations Using Multimodal Large Language Models	GPT4-V	Frozen	Arxiv 2024	[Link]
ChatDiet	ChatDiet: Empowering Personalized Nutrition-Oriented Food Recommender Chatbots through an LLM-Augmented Framework	ChatGPT	Frozen	CHASE 2024	[Link]
E2URec	Towards Efficient and Effective Unlearning of Large Language Models for Recommendation	T5-base (223M)	LoRA	Arxiv 2024	[Link]
GNR	Generative News Recommendation	ChatGPT	Frozen	WWW 2024	[Link]
BLAIR	Bridging Language and Items for Retrieval and Recommendation	RoBERTa-large (355M)	Full Finetuning	Arxiv 2024	[Link]
SLIM	Can Small Language Models be Good Reasoners for Sequential Recommendation?	LLaMA2 (7B)	LoRA	WWW 2024	[Link]
N/A	Aligning Large Language Models for Controllable Recommendations	LLaMA2 (7B)	LoRA	Arxiv 2024	[Link]
2T-HGNN	Personalized Audiobook Recommendations at Spotify Through Graph Neural Networks	Sentence-BERT (110M)	Frozen	WWW 2024	[Link]
N/A	Towards Graph Foundation Models for Personalization	Sentence-BERT (110M)	Frozen	Arxiv 2024	[Link]
CFaiRLLM	CFaiRLLM: Consumer Fairness Evaluation in Large-Language Model Recommender System	GPT4	Frozen	Arxiv 2024	[Link]
CoRAL	CoRAL: Collaborative Retrieval-Augmented Large Language Models Improve Long-tail Recommendation	GPT4	Frozen	Arxiv 2024	[Link]
RecAI	RecAI: Leveraging Large Language Models for Next-Generation Recommender Systems			WWW 2024 Demo	[Link]
KELLMRec	KELLMRec: Knowledge-Enhanced Large Language Models for Recommendation	InternLM (7B)	Frozen	Arxiv 2024	[Link]
USimAgent	USimAgent: Large Language Models for Simulating Search Users	GPT4	Frozen	Arxiv 2024	[Link]

2. Datasets & Benchmarks

The datasets & benchmarks for LLM-related RS topics should maintain the original semantic/textual features, instead of anonymous feature IDs.

2.1 Datasets

Dataset	RS Scenario	Link
NineRec	9 Domains	[Link]
MicroLens	Video Streaming	[Link]
Amazon-Review 2023	E-commerce	[Link]
Reddit-Movie	Conversational & Movie	[Link]
Amazon-M2	E-commerce	[Link]
MovieLens	Movie	[Link]
Amazon	E-commerce	[Link]
BookCrossing	Book	[Link]
GoodReads	Book	[Link]
Anime	Anime	[Link]
PixelRec	Short Video	[Link]
Netflix	Movie	[Link]

2.2 Benchmarks

Benchmarks	Webcite Link	Paper
Amazon-M2 (KDD Cup 2023)	[Link]	[Paper]
LLMRec	[Link]	[Paper]
OpenP5	[Link]	[Paper]
TABLET	[Link]	[Paper]

Repo Name	Maintainer
rs-llm-paper-list	wwliu555
awesome-recommend-system-pretraining-papers	archersama
LLM4Rec	WLiK
Awesome-LLM4RS-Papers	nancheng58
LLM4IR-Survey	RUC-NLPIR

Contributing

👍 Welcome to contribute to this repository.

If you have come across relevant resources or found some errors in this repesitory, feel free to open an issue or submit a pull request.

Contact: chiangel [DOT] ljh [AT] gmail [DOT] com

Citation

@article{lin2023can,
  title={How Can Recommender Systems Benefit from Large Language Models: A Survey},
  author={Lin, Jianghao and Dai, Xinyi and Xi, Yunjia and Liu, Weiwen and Chen, Bo and Li, Xiangyang and Zhu, Chenxu and Guo, Huifeng and Yu, Yong and Tang, Ruiming and others},
  journal={arXiv preprint arXiv:2306.05817},
  year={2023}
}

Open Source Agenda is not affiliated with "Awesome LLM For RecSys" Project. README Source: CHIANGEL/Awesome-LLM-for-RecSys

Stars

744

Open Issues

Last Commit

3 weeks ago

Repository

CHIANGEL/Awesome-LLM-for-RecSys

License

MIT

Open Source Agenda Badge

<a href="https://www.opensourceagenda.com/projects/awesome-llm-for-recsys"><img src="https://www.opensourceagenda.com/projects/awesome-llm-for-recsys/reviews/badge.svg" alt="Open Source Agenda"></a>

Submit Review Review Your Favorite Project

Submit Resource Articles, Courses, Videos

Submit Article Submit a post to our blog