User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Sitemap: https://howtogeek.inform.click/sitemap_index.xml # === BEGIN claude-bot-rules 2026-08-01 === User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: PetalBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Bytespider Disallow: / User-agent: ClaudeBot Crawl-delay: 10 User-agent: Applebot Crawl-delay: 10 User-agent: GPTBot Crawl-delay: 10 User-agent: OAI-SearchBot Crawl-delay: 10 User-agent: Amazonbot Crawl-delay: 10 User-agent: YandexBot Crawl-delay: 5 User-agent: bingbot Crawl-delay: 2 # === END claude-bot-rules ===