Any recommended starting points for LORA training llama 30B on a specific niche?... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ThorsBane on May 27, 2023 \| parent \| context \| favorite \| on: The False Promise of Imitating Proprietary LLMs Any recommended starting points for LORA training llama 30B on a specific niche? Books, tutorials, videos are all appreciated. Thanks for your time!

f_devd on May 27, 2023 [–]

Currently SOTA for specialization of LLMs is QLoRA: https://github.com/artidoro/qlora

ThorsBane on May 27, 2023 | [–]

Thank you very much my friend. Be blessed in all that you do. <3

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact