Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

it's a pretty common case to be parsing thousands of locally-stored pages. There are only so many cores and the task of scraping an entire site can still easily still be CPU limited.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: