PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Paper • 2312.12456 • Published • 45
Shadowmoon
unranked927
·
AI & ML interests
None yet
Recent Activity
liked a model about 5 hours ago
google/gemma-4-26B-A4B-it liked a model 1 day ago
mlx-community/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-mlx-8bit liked a model about 1 year ago
huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2Organizations
None yet
upvoted a paper over 2 years ago