Firecrawl API SOP

Appearance

Camel AI ​

Firecrawl integrates with Camel AI as a data loader.

Installation ​

bash
pip install camel-ai

Usage ​

With Camel AI and Firecrawl you can quickly build multi-agent systems than use data from the web.

Using Firecrawl to Gather an Entire Website ​

python
mock_app = MockFirecrawlApp.return_value
firecrawl = Firecrawl(
  api_key='FC_API_KEY', api_url='https://api.test.com'
)
url = 'https://example.com'
response = [{'markdown': 'Markdown content'}]
mock_app.crawl_url.return_value = respons
result = firecrawl.markdown_crawl(url)

Using Firecrawl to Gather a Single Page ​

python
mock_app = MockFirecrawlApp.return_value
firecrawl = Firecrawl(
  api_key='test_api_key', api_url='https://api.test.com'
)
url = 'https://example.com'
response = 'Scraped content'
mock_app.scrape_url.return_value = response

result = firecrawl.scrape(url)