網路爬蟲
| 運算子
| 類別
| 已允許的要求
| Robots.txt 違規
| 動作
| | Amazonbot | Amazon | AI Crawler | 86,266 | 0
| 允許封鎖
| | ClaudeBot | Anthropic | AI Crawler | 77,052 | 0
| 允許封鎖
| | GPTBot | OpenAI | AI Crawler | 68,691 | 0
| 允許封鎖
| | BingBot | Microsoft | Search Engine | 40,168 | 0
| 允許封鎖
| | PetalBot | Huawei | AI Crawler | 8,983 | 0
| 允許封鎖
| | Applebot | Apple | AI Search | 6,800 | 0
| 允許封鎖
| | Googlebot | Google | Search Engine | 6,017 | 0
| 允許封鎖
| | Meta-ExternalAgent | Meta | AI Crawler | 216 | 0
| 允許封鎖
| | ChatGPT-User | OpenAI | AI Assistant | 51 | 0
| 允許封鎖
| | PerplexityBot | Perplexity | AI Search | 29 | 0
| 允許封鎖
| | Bytespider | ByteDance | AI Crawler | 28 | 0
| 允許封鎖
| | archive.org_bot | Internet Archive | Archiver | 15 | 0
| 允許封鎖
| | OAI-SearchBot | OpenAI | AI Search | 1 | 0
| 允許封鎖
| | Perplexity-User | Perplexity | AI Assistant | 1 | 0
| 允許封鎖
| | CCBot | Common Crawl | AI Crawler | 0 | 0
| 允許封鎖
| | Claude-SearchBot | Anthropic | AI Crawler | 0 | 0
| 允許封鎖
| | Claude-User | Anthropic | AI Crawler | 0 | 0
| 允許封鎖
| | DuckAssistBot | DuckDuckGo | AI Assistant | 0 | 0
| 允許封鎖
| | FacebookBot | Meta | AI Crawler | 0 | 0
| 允許封鎖
| | Google-CloudVertexBot | Google | AI Crawler | 0 | 0
| 允許封鎖
| | Meta-ExternalFetcher | Meta | AI Assistant | 0 | 0
| 允許封鎖
| | MistralAI-User | Mistral | AI Assistant | 0 | 0
| 允許封鎖
| | ProRataInc | ProRata.ai | AI Crawler | 0 | 0
| 允許封鎖
| | Timpibot | Timpi | AI Crawler | 0 | 0
| 允許封鎖
|
各位版友要加油啊，讓AI向離教者之家的版友好好學習吧。 |
