v1.4.0

• feat(cli): add cli ability (#16 thanks to @j-mendez)
• feat(concurrency): dynamic concurrent cpu defaults (#15 thanks to @j-mendez)
• docs: add a changelog

v1.3.1

• fix(crawl): fix field type (#14 thanks to @j-mendez)

v1.3.0

• feat(crawl): callback to run when link is found (#13 thanks to @j-mendez)

v1.2.0

• Add User Agent configuration (#5 thanks to @Dragnucs)
• Add polite delay (#6 thanks to @Dragnucs )

v1.1.3

• Handle page get errors (#4 thanks to @Dragnucs)
• Fix link resolution (#3 thanks to @Dragnucs)

v1.1.2

Update dependencies

v1.1.1

Correct tag

v1.0.3

Merge branch 'master' of https://github.com/madeindjs/spider