+ Firecrawl × your AI agent Crawl a docs site
If you ask
“Crawl https://docs.example.com and return clean markdown for every page under /guides”
Then
Crawl a whole docs site and get clean markdown for each page.
Works in Claude, Codex, Cursor & any MCP agent
How this prompt works
-
Turn on the Firecrawl connector in Claude, ChatGPT or Cursor — once.
-
Paste the prompt above. No code, no menus.
-
Crawl a whole docs site and get clean markdown for each page.
FAQ
How do I crawl a docs site with Firecrawl?
Add the Firecrawl MCP connector once, then paste this prompt into Claude or ChatGPT: "Crawl https://docs.example.com and return clean markdown for every page under /guides". Your AI runs it in Firecrawl.
Do I need to code?
No. You install the connector once (a short config or one click), then ask in plain words. The prompt on this page works as-is.
Which AI assistants work?
Claude (Desktop, Code), Cursor, ChatGPT and other MCP clients. The same prompt works across them.
Set up Firecrawl in Claude
Copy-paste config, setup steps and more ready-to-run prompts on the connector page.
Open Firecrawl setupMore prompts