jarink/brokenlinks/worker_test.go, branch main Program to inspects and maintains web sites. http://git.kilabit.info/jarink/atom?h=main 2026-02-11T14:45:06Z brokenlinks: make link that return HTML always end with slash 2026-02-11T14:45:06Z Shulhan ms@kilabit.info 2026-02-11T03:47:42Z urn:sha1:8100b3be0730173a77f1a64f9ac6bc8862a159ac If parent URL like "/page" return the body as HTML page, the URL should be end with slash to make the relative links inside it works when joined with the parent URL. brokenlinks: check for redirect during scan 2026-02-04T20:29:49Z Shulhan ms@kilabit.info 2026-02-04T20:29:49Z urn:sha1:d8a892eb2f28b3ef4c2625c682d255f4f616cae2 If the request redirected, use the "Location" value in the response header as the parent URL instead of from the original link in queue. brokenlinks: fix generating relative URL 2026-02-04T15:58:10Z Shulhan ms@kilabit.info 2026-02-04T15:10:42Z urn:sha1:fa31e0a656d03fe3744c70a1171e3831647923c9 If the parent URL end with .html or .htm, join the directory of parent instead of the current path with the relative path.