Home/Claude Connector Documentation

How to Add the CrawlHunt Claude Connector

Scan your website for SEO problems, review them and fix them by chatting with Claude. This guide shows how to add CrawlHunt to Claude as a custom connector, sign in, and use it, including what it can do, what data it uses and how to remove it.

MCP server URL
https://claude.crawlhunt.com/mcp
Before You Start

What you'll need

A CrawlHunt account (sign up free at crawlhunt.com)
A Claude account that can add custom connectors (on Team and Enterprise plans an Owner adds it first)
To apply fixes: your Shopify store, WordPress site or Magento store connected to CrawlHunt under Integrations
Don't have a CrawlHunt account yet? Create one for free before you begin.
Step-by-Step Guide

Claude Connector Documentation

Follow each step in order. Open any screenshot at full size to see the details.

01Step 1 of 11

Open Connectors in Claude

Open Claude on the web (claude.ai) or the desktop app, then go to Settings, then Customize, then the Connectors tab. This is where custom connectors are added, and they then work on the web, desktop and mobile apps.

Click your name at the bottom left and choose Settings
Open Customize, then the Connectors tab (Yours shows what you have already added)
If you do not see the Add button, your plan or workspace may not allow custom connectors. On Team and Enterprise plans an Owner adds it under Organization settings first; you then connect it yourself
Claude Settings, Customize, Connectors with the Add button
Claude Settings, Customize, Connectors with the Add buttonOpen Full Screenshot
02Step 2 of 11

Add CrawlHunt as a custom connector

Click Add, then choose Add custom connector. In the window that opens, enter a name and the server URL from the Connection Details section of this page, then click Continue.

Name: CrawlHunt
Server URL: https://claude.crawlhunt.com/mcp
Claude Add custom connector window with the CrawlHunt name and URL
Claude Add custom connector window with the CrawlHunt name and URLOpen Full Screenshot
03Step 3 of 11

Keep the detected sign-in options and click Add

Claude checks the server and fills in the sign-in settings for you. CrawlHunt is detected as Sign in now with Register automatically, so leave them as they are and click Add.

Authentication: Sign in now (detected)
OAuth client: Register automatically (detected). No client ID or secret is needed
Leave Request headers and Advanced empty, then click Add
Claude's sign-in options for the CrawlHunt connector
Claude's sign-in options for the CrawlHunt connectorOpen Full Screenshot
04Step 4 of 11

Click Connect

CrawlHunt now shows in your connector list, with the message "You're not connected to CrawlHunt yet". Click Connect to continue to CrawlHunt's own sign-in page.

The CrawlHunt connector page in Claude with the Connect button
The CrawlHunt connector page in Claude with the Connect buttonOpen Full Screenshot
05Step 5 of 11

Sign in to CrawlHunt and approve access

A CrawlHunt page opens. Sign in to your CrawlHunt account if asked (two-factor sign-in works as usual), check that the account shown is the one you want, and review what Claude will be able to do.

View your websites and audit results
Start SEO scans (they count toward your plan's crawl limit)
Apply SEO fixes you approve in the chat
Read your Google Search Console data, if you have connected it
Not the right account? Click Not you? to sign in with a different one
Click Allow and connect, or Cancel to stop. Nothing is shared until you click Allow and connect
The CrawlHunt page where you approve Claude's access
The CrawlHunt page where you approve Claude's accessOpen Full Screenshot
06Step 6 of 11

Choose how Claude uses the tools

Back in Claude, the CrawlHunt page now shows Disconnect and a Tool permissions list. Each tool can be set to Always allow, Needs approval or Blocked. The default, Needs approval, makes Claude ask before it uses a tool.

Keep Needs approval if you want to confirm each action
Switch read-only tools such as About CrawlHunt, Check robots.txt or Compare with the previous scan to Always allow if you do not want to be asked every time
Keep tools that change your website, such as Apply a previewed fix to the live store, on Needs approval
CrawlHunt's tool permissions in Claude
CrawlHunt's tool permissions in ClaudeOpen Full Screenshot
07Step 7 of 11

Ask CrawlHunt something in a chat

Open a new chat and ask in plain language, naming CrawlHunt so Claude knows to use it. Claude shows Loaded CrawlHunt, runs the tool and answers with a recommended next step and clickable options.

Start with: "Hey CrawlHunt, what can you help my website with?"
Click an option to fill it into your message box, then press Enter to send it
If Claude asks for approval to run a tool, choose Allow once or Always allow
Tools that only read data never change anything on your website
CrawlHunt's first answer in a Claude chat
CrawlHunt's first answer in a Claude chatOpen Full Screenshot
08Step 8 of 11

Scan a website

Ask Claude to scan a site, for example: "Use CrawlHunt to scan example.com". CrawlHunt adds the site to your account if it is new, crawls it, and Claude reports progress and then the issues found.

A scan takes a few minutes depending on the size of the site
Scans count against your CrawlHunt plan limits, exactly as scans started from the dashboard
Ask for the affected pages of any issue, such as images missing alt text or pages missing a title or meta description
Ask to compare the latest scan with the previous one to see what improved
09Step 9 of 11

Preview, apply and undo AI fixes

Ask Claude to fix an issue, for example: "Write a better title for the pricing page". CrawlHunt generates the text and Claude shows the current and proposed versions with Apply and Undo buttons. Nothing on your website changes until you approve.

Page titles, meta descriptions and image alt text are supported, one at a time or in bulk (bulk fixes need a Growth or Agency plan)
Generating a fix uses your CrawlHunt AI credits, and previews expire after 30 minutes
Say yes or press Apply. CrawlHunt only applies text that was shown to you in a preview, and only to the connected store that matches the page address
Applying changes your live website, so accept the live-fix notice once in your CrawlHunt dashboard; it stays valid for 6 hours
Ask Claude to undo the last fix. Any fix can also be undone later from the History tab in your CrawlHunt dashboard
10Step 10 of 11

Check robots.txt, Search Console and AI visibility

The same chat can also review your robots.txt file, read Google Search Console clicks and index status, and show how ready your site is to be quoted by AI answers (AEO/GEO).

robots.txt: ask CrawlHunt to check it and, on a connected Shopify store, apply or undo the recommended fix
Search Console: needs Google Search Console connected in CrawlHunt; ask for clicks, top queries or whether a page is indexed
AI Visibility: ask for your AEO/GEO scores and what to improve
11Step 11 of 11

Remove or disconnect CrawlHunt

You can disconnect at any time. In Claude, open Settings, Customize, Connectors, choose CrawlHunt and click Disconnect, or use the ... menu to remove the connector. Access tokens can also be revoked on request at contact@crawlhunt.com.

Connection Details

Values to paste into Claude

Copy these into the Add custom connector window from step 2.

Name
CrawlHunt
Server URL
https://claude.crawlhunt.com/mcp
Try It

Things to ask CrawlHunt

Once it is connected, ask in plain language. These are good first prompts.

“What can CrawlHunt do for my website?”

“Use CrawlHunt to scan example.com and tell me what is wrong”

“Which pages are missing a meta description?”

“Write a better title for my pricing page”

“Show my recent CrawlHunt changes and undo the last one”

“Check my robots.txt”

“Show my Search Console clicks for the last 28 days”

“How AI-ready is my site (AEO/GEO)?”

“What plan am I on and how much have I used?”

Troubleshooting

Common questions

I do not see the Add button or Add custom connector

Custom connectors are only available on some Claude plans. On Team and Enterprise plans an Owner has to add the connector under Organization settings first; after that you will see CrawlHunt in your own Connectors list and can click Connect.

Claude says it could not connect or the sign-in failed

Check that the URL is exactly the one on this page, including https:// and /mcp at the end, and that Authentication is Sign in now with Register automatically. If the CrawlHunt sign-in page does not open, allow pop-ups for claude.ai and try again.

Claude does not use CrawlHunt when I ask

Name CrawlHunt in the request, for example: "Use CrawlHunt to scan example.com". Also check that CrawlHunt is still connected under Settings, Customize, Connectors, and that its tools are not set to Blocked.

The Apply and Undo buttons do not respond

Claude does not always allow a button to run a tool directly. Type "apply that fix" or "undo the last fix" in the chat instead; it does the same thing.

A fix could not be applied to my website

Fixes are only applied to a Shopify, WordPress or Magento site that is connected to CrawlHunt under Integrations, and the live-fix notice must be accepted in your CrawlHunt dashboard. For any other site CrawlHunt can still write the text for you to paste in yourself.

It says I have reached a plan limit

Scans, AI fixes and bulk fixes follow the same limits as the CrawlHunt dashboard. The reply shows your usage and links to upgrade or buy more credits.

What data does Claude see?

Claude receives the audit results, page addresses and page text you ask about, which it handles under Anthropic's own terms. CrawlHunt never sees your Claude conversation: it only receives the specific requests Claude sends to its tools. CrawlHunt stores access tokens in hashed form and never receives your Claude password. See the CrawlHunt Privacy Policy and Terms and Conditions for how your account data is handled.

Claude Connector Documentation

Ready to run your first SEO audit?

Open CrawlHunt to start auditing, or head back to the integration overview.