Base Model for TransMLA
mengfanxu
fxmeng
AI & ML interests
None yet
Recent Activity
upvoted
an
article
2 days ago
SigLIP 2: A better multilingual vision language encoder
upvoted
a
paper
19 days ago
Youtu-LLM: Unlocking the Native Agentic Potential for Lightweight Large Language Models
Organizations
None yet
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1
Base Model for TransMLA
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
Principal Singular Values and Singular Vectors Adaptation
https://arxiv.org/abs/2404.02948
Substructure of mistralai/Mixtral-8x7B-Instruct-v0.1