Web data API

14 endpoints for Web: search, page, links, discover, text, headers, feed, robots, sitemap, scrape, parse, extract, map, crawl. One API key, one JSON schema, as MCP tools or REST.

Endpoints

Call any of them over MCP with call_endpoint and its path, or over REST.

Endpoint	Returns	Credits	Cache
searchGET /v1/web/search	Web search results for a query: title, URL and snippet for each hit.	1	2 min
pageGET /v1/web/page	Title, description and canonical link for a web page.	1	2 min
linksGET /v1/web/links	Outbound links found on a web page.	1	2 min
discoverGET /v1/web/discover	Crawl one hop from a page: metadata for the seed and its outbound links.	5	2 min
textGET /v1/web/text	Readable text extracted from a web page, scripts and navigation removed.	1	2 min
headersGET /v1/web/headers	HTTP status, redirect result and key response headers for a URL.	1	2 min
feedGET /v1/web/feed	Items from an RSS or Atom feed.	1	10 min
robotsGET /v1/web/robots	Parsed robots.txt groups, sitemaps and crawl delay for a site.	1	2 min
sitemapGET /v1/web/sitemap	URLs from a sitemap or sitemap index, with lastmod when present.	1	10 min
scrapeGET /v1/web/scrape	One page as readable text: cleaned article body, word count and the page head.	1	10 min
parseGET /v1/web/parse	Page structure: head tags, headings, anchors, images and embedded JSON-LD types.	1	10 min
extractGET /v1/web/extract	Structured data a page publishes: JSON-LD, Open Graph, Twitter cards and meta tags.	1	10 min
mapGET /v1/web/map	URL inventory for a site: page links plus the sitemap entries robots.txt declares.	1	10 min
crawlGET /v1/web/crawl	Breadth-first crawl from a seed URL that reads robots.txt and reports each page it visited.	5	10 min

Connect your agent over MCP

Remote MCP server: https://data.openkrill.app/mcp with your key in the x-api-key header.

Claude Code · Run in a terminal

claude mcp add --transport http krilldata \
  https://data.openkrill.app/mcp \
  --header "x-api-key: YOUR_API_KEY"

Cursor · Add to ~/.cursor/mcp.json

{
  "mcpServers": {
    "krilldata": {
      "url": "https://data.openkrill.app/mcp",
      "headers": {
        "x-api-key": "YOUR_API_KEY"
      }
    }
  }
}

Claude Desktop · Add to claude_desktop_config.json

{
  "mcpServers": {
    "krilldata": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://data.openkrill.app/mcp",
        "--header",
        "x-api-key:${API_KEY}"
      ],
      "env": {
        "API_KEY": "YOUR_API_KEY"
      }
    }
  }
}