Brave Search MCP Server
Brave
Privacy-focused web and local search through the Brave Search API.
by Community · TypeScript
Check whether AI crawlers such as GPTBot, ClaudeBot and PerplexityBot can access a URL: robots.txt rules per bot (RFC 9309) plus the live HTTP status fetched with each bot's user agent.
The project docs have the install command. This catalog does not yet list a package name. Most clients expect an entry shaped like this:
{
"mcpServers": {
"crawlerpeek": {
"command": "<command from the docs>",
"args": [
"<args>"
]
}
}
}