diff options
| author | Thorsten Ortlepp <post@ortlepp.eu> | 2024-12-12 01:19:00 +0100 |
|---|---|---|
| committer | Thorsten Ortlepp <post@ortlepp.eu> | 2024-12-12 01:19:00 +0100 |
| commit | fa9ccbd94724e9edc849a7dce46c0d468ee47fd5 (patch) | |
| tree | e23045773f63ae8cdf432cd149bd278e5866dc7e /static/robots.txt | |
| parent | 2a3d44d7ed88d0e58f5a8907fb0f82eed4669868 (diff) | |
| download | website-ortleppms-fa9ccbd94724e9edc849a7dce46c0d468ee47fd5.zip | |
website setup
Diffstat (limited to 'static/robots.txt')
| -rw-r--r-- | static/robots.txt | 40 |
1 files changed, 40 insertions, 0 deletions
diff --git a/static/robots.txt b/static/robots.txt new file mode 100644 index 0000000..b275d38 --- /dev/null +++ b/static/robots.txt @@ -0,0 +1,40 @@ +user-agent: Googlebot-Image +disallow: / + +user-agent: Google-Extended +Disallow: / + +User-agent: OAI-SearchBot +Disallow: / + +User-agent: ChatGPT-User +Disallow: / + +User-agent: GPTBot +Disallow: / + +User-agent: FacebookBot +Disallow: / + +User-agent: Meta-ExternalAgent +Disallow: / + +User-agent: Meta-ExternalFetcher +Disallow: / + +User-agent: PerplexityBot +Disallow: / + +User-agent: ClaudeBot +Disallow: / + +User-agent: anthropic-ai +Disallow: / + +User-agent: OmgiliBot +Disallow: / + +User-agent: cohere-ai +Disallow: / + +Sitemap: https://www.ortlepp.ms/sitemap.xml |