Would the common crawl dataset be useful to you starting out? http://commoncrawl... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

gary__ on Aug 12, 2018 | parent | context | favorite | on: Show HN: Didyougogo – An Altavista slayer

Would the common crawl dataset be useful to you starting out?

http://commoncrawl.org

misterman0 on Aug 12, 2018 [–]

Yes absolutely. I have been holding off crawling because I have no server capacity yet. That will probably sort itself out pretty soon from the looks of it. When I have the disk space I'll start using their data.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact