mirror of
https://github.com/magnus919/agent-skills.git
synced 2026-09-11 19:47:12 +03:00
Magnus HedemarkandGitHub
531ff67537
Merging with required validation green. Droid Auto Review was retried twice and failed before producing a review because DeepSeek V4 Flash rejected the action's ApplyPatch tool; the check is non-required per branch protection. The diff was independently inspected and local/repository validation passed.
24 lines
953 B
Plaintext
24 lines
953 B
Plaintext
# AEO crawler policy decision template
|
|
# Review before turning any example into a public robots.txt.
|
|
|
|
## Intended policy
|
|
|
|
- Search visibility allowed for:
|
|
- Training use allowed for:
|
|
- User-triggered fetch allowed for:
|
|
- Restricted paths:
|
|
- Policy owner and review date:
|
|
|
|
| Provider | Search crawler | Training crawler | User-triggered crawler | Source URL | Verified date |
|
|
|---|---|---|---|---|---|
|
|
| OpenAI | OAI-SearchBot | GPTBot | ChatGPT-User | https://platform.openai.com/docs/bots | |
|
|
| Google | Googlebot | Google-Extended | provider-specific | https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers | |
|
|
| Other | | | | | |
|
|
|
|
## Verification
|
|
|
|
- [ ] No accidental wildcard rule changes unrelated crawlers.
|
|
- [ ] CDN/hosting layer matches the intended policy.
|
|
- [ ] Public /robots.txt matches the approved file.
|
|
- [ ] The policy does not claim to control user-triggered requests where the provider says it does not.
|