Featured

Deploy OpenClaw in 60 seconds — 20% off logoDeploy OpenClaw in 60 seconds — 20% off

Launch OpenClaw on Hostinger in about 60 seconds and keep your agent live 24/7. Our referral link gives you 20% off, no coupon code needed.

Launch on Hostinger
Run your Hermes agent on Hostinger, fully managed logoRun your Hermes agent on Hostinger, fully managed

Launch Hermes on Hostinger in one click, fully managed, no VPS knowledge needed. Use code ZACAARON10 for 10% off.

Launch on Hostinger
Crawl and scrape any site into clean data, 10% off logoCrawl and scrape any site into clean data, 10% off

Firecrawl crawls and scrapes any site into clean markdown for your agent. Get 1,000 free credits, and new users get 10% off their first purchase.

Try Firecrawl free
6,000+ web scrapers for your AI agent, start free logo6,000+ web scrapers for your AI agent, start free

Apify gives your agent live web data: 6,000+ prebuilt scrapers and actors, MCP-ready. Sign up free with $5 in usage credits.

Try Apify free
One API to scrape, enrich, and extract the internet. logoOne API to scrape, enrich, and extract the internet.

Context.dev gives your agents a single API to scrape, enrich, and extract live web data — no proxies, no parsers, no maintenance.

Start building free
SetupClaw: done-for-you OpenClaw for founders & exec teams logoSetupClaw: done-for-you OpenClaw for founders & exec teams

White-glove OpenClaw for founders and exec teams (4–50+ employees): we install, harden, integrate your tools, and maintain it — secured from day one.

Get it set up for you
SEO data APIs for your agent, $1 free credit logoSEO data APIs for your agent, $1 free credit

DataForSEO gives your agent live access to SERP results, keyword data, backlinks, and on-page SEO data through one API. New accounts get a $1 credit, good for up to 20,000 keyword or backlink lookups.

Try DataForSEO free
Reach 48,000+ AI builders

A flat monthly placement in front of developers actively installing AI tools. No lock-in, cancel anytime.

Advertise here

Works with

Claude CodeClaude DesktopCursorVS CodeClineCodex CLIOpenClaw+ any MCP client

Install to Claude Code

This server doesn't publish a one-line install command. Follow the setup in the source repository.

Summary

Documentation crawler MCP server that crawls and indexes documentation sites so that any MCP-compatible AI can search, read, and expand on the content.

README.md

rock-mcp

Documentation crawler MCP server. Share a link → site gets crawled and indexed → any MCP-compatible AI can search, read, and expand on it.

No API keys. No cloud. Runs locally, stores everything in SQLite.

How it works

  1. Share a docs URL (add_docs_url)
  2. rock-mcp crawls and indexes it in the background
  3. Ask your AI about it — it searches, reads pages, and expands topics on demand

Tools

| Tool | Description | |---|---| | search_web | Search the web via DuckDuckGo — find URLs when you don't have one yet | | add_docs_url | Crawl and index a URL (async, call immediately then search) | | search_docs | Full-text search across all indexed docs | | get_page | Get a specific page, chunked. Jump to a section by name. | | expand_topic | Find all pages covering a topic | | list_sources | List indexed sources with crawl status and staleness | | recrawl_source | Re-crawl a source to pick up updates | | get_crawl_status | Check crawl progress for a URL | | delete_source | Remove a source and all its pages |

Installation

Prerequisites

  • Node.js 18+
  • Git
git clone https://github.com/sethwebster/rock-mcp
cd rock-mcp
npm install && npm run build

Note the full path to dist/server.js — you'll need it below.

---

Claude Code (CLI)

claude mcp add --scope user rock-mcp node /path/to/rock-mcp/dist/server.js

Restart Claude Code after running this. Verify with:

claude mcp list

---

Claude Desktop

Add to ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows):

{
  "mcpServers": {
    "rock-mcp": {
      "command": "node",
      "args": ["/path/to/rock-mcp/dist/server.js"]
    }
  }
}

Restart Claude Desktop.

---

Cursor

Add to .cursor/mcp.json in your project root, or ~/.cursor/mcp.json globally:

{
  "mcpServers": {
    "rock-mcp": {
      "command": "node",
      "args": ["/path/to/rock-mcp/dist/server.js"]
    }
  }
}

Restart Cursor.

---

Windsurf

Add to ~/.codeium/windsurf/mcp_config.json:

{
  "mcpServers": {
    "rock-mcp": {
      "command": "node",
      "args": ["/path/to/rock-mcp/dist/server.js"]
    }
  }
}

Restart Windsurf.

---

Codex (OpenAI CLI)

Add to ~/.codex/config.yaml (or your project's codex.yaml):

mcp_servers:
  - name: rock-mcp
    command: node
    args:
      - /path/to/rock-mcp/dist/server.js

---

Cline (VS Code extension)

Open VS Code settings, search for Cline MCP, and add:

{
  "rock-mcp": {
    "command": "node",
    "args": ["/path/to/rock-mcp/dist/server.js"]
  }
}

Or edit settings.json directly under the cline.mcpServers key.

---

Continue.dev

Add to ~/.continue/config.json under mcpServers:

{
  "mcpServers": [
    {
      "name": "rock-mcp",
      "command": "node",
      "args": ["/path/to/rock-mcp/dist/server.js"]
    }
  ]
}

---

Antigravity

In the agent panel, click ...Manage MCP ServersView raw config to open mcp_config.json. Add your server:

{
  "mcpServers": {
    "rock-mcp": {
      "command": "node",
      "args": ["/path/to/rock-mcp/dist/server.js"]
    }
  }
}

Save the file and restart Antigravity (or reload the window).

---

Firebase Studio (Project IDX)

Add to .idx/mcp.json in your workspace root (create it if it doesn't exist):

{
  "mcpServers": {
    "rock-mcp": {
      "command": "node",
      "args": ["/path/to/rock-mcp/dist/server.js"]
    }
  }
}

For Gemini CLI within Firebase Studio, add to .gemini/settings.json instead.

---

Zed

Add to ~/.config/zed/settings.json under context_servers:

{
  "context_servers": {
    "rock-mcp": {
      "command": {
        "path": "node",
        "args": ["/path/to/rock-mcp/dist/server.js"]
      }
    }
  }
}

---

Any MCP-compatible client

rock-mcp is a standard MCP stdio server. The binary is node /path/to/rock-mcp/dist/server.js. If your client supports MCP, point it there.

---

Storage

All data lives in ~/.rock-mcp/docs.db (SQLite, WAL mode). Delete it to reset everything.

Crawl defaults

  • Depth: 2 hops from the root URL
  • Max pages: 50 per source
  • Concurrency: 5 pages at a time, 200ms between batches
  • Only indexes text/html — skips PDFs, plain text, JSON, etc.
  • Redirect deduplication: follows redirects and stores under the canonical URL

License

MIT

See related servers & alternatives →

Related MCP servers

Browse all →

Related guides

Hand-picked reading to help you choose and use Search servers.