Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
GPTQ vs. GGML vs. Base Models: Speed and VRAM Test for Vicuna-33B on A100 GPU (llm-utils.org)
1 point by tikkun on July 17, 2023 | hide | past | favorite


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: