Commit Graph

21 Commits

Author SHA1 Message Date
James
dbe1481e5c add example 2020-03-10 10:52:13 +00:00
James
ca4686f81b new readme 2020-03-06 14:00:43 +00:00
James
7f2b819861 remove the console command 2020-03-06 13:34:37 +00:00
James
3ab51ccff9 better tests for interlinked and redirect tracking 2020-02-24 09:07:58 +00:00
5fc2b1fb83 Update 'README.md' 2020-02-23 19:10:49 +00:00
2b6bd3024e Update 'README.md' 2020-02-23 18:52:31 +00:00
882b05ff06 Update 'README.md' 2020-02-23 18:37:36 +00:00
James
340e78de13 crawler takes request options in constructor, update docs 2020-02-23 18:23:36 +00:00
James
c3cf29848a add test and patch for the https://github.com/spatie/crawler/issues/271 2020-02-23 18:00:58 +00:00
James
b26bd7c6c5 consistent 2020-02-23 01:23:24 +00:00
James
adaaaef3c2 more comprehensive tests and tidy up 2020-02-23 01:19:31 +00:00
James
9c0961fd87 fix tests 2020-02-23 01:08:14 +00:00
James
ffdef4b0d5 awesome new test server structure - just need to fix all the tests now :/ 2020-02-23 00:48:06 +00:00
James
fe45abaf49 make baseurl (internal links only) optional in crawler constructor 2020-02-22 13:57:43 +00:00
James
ef4ebf7cd0 add simple console command 2020-02-22 13:57:43 +00:00
9623a36013 added initial readme - needs work 2020-02-22 12:32:24 +00:00
James
9a84ec204d test and fix redirect tracking 2020-02-22 10:06:18 +00:00
James
d81dc86381 bugfix inverted logic 2020-02-21 13:05:20 +00:00
James
c81551e2bf add tests 2020-02-21 10:59:58 +00:00
James
ac7b849036 make observer collate all found on urls 2020-02-21 10:24:34 +00:00
James
6a986a62c0 inital 2020-02-20 17:06:44 +00:00