github.io/public/robots.txt

19 lines
342 B
Plaintext
Raw Normal View History

2022-03-29 23:00:57 +00:00
User-agent: *
Allow: /about/
Allow: /categories/
Allow: /no/categories/
Allow: /tags/info/
Allow: /no/tags/info/
Allow: /categories/meta/
Allow: /tags/meta/
Allow: /no/categories/meta/
Allow: /no/tags/meta/
Allow: /no/about/
Allow: /series/
Allow: /no/series/
Allow: /blog/
Allow: /no/blog/
Allow: /tags/
Allow: /no/tags/
Allow: /no/
Allow: /