diff options
| author | Shulhan <ms@kilabit.info> | 2024-12-08 13:53:54 +0700 |
|---|---|---|
| committer | Shulhan <ms@kilabit.info> | 2024-12-08 13:53:54 +0700 |
| commit | a5aa2acc24ec3380f56955a757096a681f88d3e5 (patch) | |
| tree | 5870ae85f139d3d5db42676c9e5e538ec3a77173 | |
| parent | 7bbebdc3714e7209dc977c5c735a4e722c950e4f (diff) | |
| download | kilabit.info-a5aa2acc24ec3380f56955a757096a681f88d3e5.tar.xz | |
_content: update robots.txt
Disallow aur and job_exec logs since the content are dynamic.
| -rw-r--r-- | _content/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/_content/robots.txt b/_content/robots.txt index 24d7060..d2a6564 100644 --- a/_content/robots.txt +++ b/_content/robots.txt @@ -1,2 +1,4 @@ User-agent: * +Disallow: /aur/ Disallow: /dns-query +Disallow: /karajo/job_exec/log/ |