FruxonDocs

Firecrawl

Firecrawl web scraping integration — turn websites into LLM-ready markdown, crawl entire sites, and extract structured data

The Firecrawl integration lets your agents scrape pages, crawl whole sites, generate sitemaps, and pull structured data out of arbitrary web pages — returning clean, LLM-ready markdown.

Prerequisites

  • A Firecrawl API key from firecrawl.dev. Free tier works for evaluation; paid plans give higher rate limits and longer crawls.

Setup

  1. Open Integrations from the sidebar
  2. Select Firecrawl from the catalog
  3. Click Add Integration Config
  4. Give the config a display name (e.g., "Firecrawl — Marketing scrape").
  5. Paste your API Key.
  6. Save the config

Using in Your Agent

  1. Open your agent in Agent Studio and select an Agent Step
  2. Under Attached Integration Configurations, click Attach configuration and choose your config
  3. Attach Firecrawl tools from the tools panel
  4. Tools are referenced as firecrawl.firecrawl_scrape, firecrawl.firecrawl_crawl, etc.

A scrape is one URL → markdown. A crawl walks the site graph and is more expensive; use it when you genuinely need multi-page coverage. map is the cheap "what URLs exist on this site" call.

Available Tools

ToolDescriptionAction Type
firecrawl_scrapeScrape a single page and return its content as clean markdown with configurable output formatsReadOnly
firecrawl_crawlCrawl a website starting from a URL, following links to scrape multiple pagesReadOnly
firecrawl_mapDiscover all URLs on a website by generating a sitemap without scraping contentReadOnly
firecrawl_extractExtract structured data from a page using a natural language prompt or JSON schemaReadOnly

On this page