Issues

• Tests are flaky

  inglesp/http-crawler#16 · Filter by author inglesp opened on Oct 9, 2017

• Should be able to identify invalid URL schemes

  inglesp/http-crawler#13 · Filter by author inglesp opened on Aug 19, 2017

• No way to tell where a broken link is linked from

  inglesp/http-crawler#10 · Filter by author alexwlchan opened on Feb 17, 2017
  2

• Allow user to choose whether to follow redirects

  inglesp/http-crawler#5 · Filter by author inglesp opened on Jun 9, 2016
  11

• Allow user to choose how links are extracted from responses

  inglesp/http-crawler#4 · Filter by author inglesp opened on Jun 9, 2016
  1

• Allow user to choose which links to follow

  inglesp/http-crawler#3 · Filter by author inglesp opened on Jun 9, 2016
  1

• Allow user to choose which pages to extract links from

  inglesp/http-crawler#2 · Filter by author inglesp opened on Jun 9, 2016