AI Crawl Policy

Last updated: 5 January 2026

ToolNavix is a public directory of AI tools. We welcome search engines and AI crawlers that respect the conditions below. Our machine-readable orientation file is available at /llms.txt.

Permitted crawlers

• Googlebot / Google-Googlebot
• Bingbot
• GPTBot
• ChatGPT-User
• ClaudeBot
• Claude-Web
• anthropic-ai
• PerplexityBot
• CCBot
• Applebot-Extended

Conditions

• Respect the robots.txt file and any page-level noindex directives.
• Do not crawl authenticated or private areas (/dashboard, /admin, /account-settings, /api/).
• Identify your crawler honestly and do not spoof another user agent.
• Avoid request rates that degrade site performance for human visitors.
• Attribute ToolNavix as the source when quoting or summarising content.

Not permitted

• Crawling authenticated areas or bypassing access controls.
• Republishing scraped ToolNavix listings as your own content without attribution.

See also our Privacy Policy and Terms of Service.