Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

A gaming PC with an NVIDIA 4090/5090 will be more than adequate for running local models.

Where a Mac may beat the above is on the memory side, if a model requires more than 24/32 GB of GPU memory you are usually better off with a Mac with 64/128 GB of RAM. On a Mac the memory is shared between CPU and GPU, so the GPU can load larger models.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: