Firecrawl API SOP

Appearance

Flask ​

Use Firecrawl with Flask to build web scraping and search APIs in Python.

Prerequisites ​

  • Python 3.8+
  • A Firecrawl API key, get one free

Setup ​

bash
pip install flask firecrawl-py

Add your API key to .env:

bash
FIRECRAWL_API_KEY=fc-YOUR-API-KEY

Create the app ​

Create app.py:

python
import os
from flask import Flask, request, jsonify
from firecrawl import Firecrawl

app = Flask(__name__)
firecrawl = Firecrawl(api_key=os.environ["FIRECRAWL_API_KEY"])

@app.post("/search")
def search():
  data = request.get_json()
  results = firecrawl.search(data["query"], limit=data.get("limit", 5))
  return jsonify([{"title": r.title, "url": r.url} for r in results.web])

@app.post("/scrape")
def scrape():
  data = request.get_json()
  result = firecrawl.scrape(data["url"])
  return jsonify(markdown=result.markdown, metadata=result.metadata)

@app.post("/interact/start")
def interact_start():
  data = request.get_json()
  result = firecrawl.scrape(data["url"], formats=["markdown"])
  return jsonify(scrape_id=result.metadata.scrape_id)

@app.post("/interact")
def interact():
  data = request.get_json()
  response = firecrawl.interact(data["scrape_id"], prompt=data["prompt"])
  return jsonify(output=response.output)

@app.post("/interact/stop")
def interact_stop():
  data = request.get_json()
  firecrawl.stop_interaction(data["scrape_id"])
  return jsonify(status="stopped")

if __name__ == "__main__":
  app.run(debug=True)

Run it ​

bash
flask run

Test it ​

bash
# Search the web
curl -X POST http://localhost:5000/search \
-H "Content-Type: application/json" \
-d '{"query": "firecrawl web scraping", "limit": 5}'

# Scrape a page
curl -X POST http://localhost:5000/scrape \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com"}'

# Start an interactive session
curl -X POST http://localhost:5000/interact/start \
-H "Content-Type: application/json" \
-d '{"url": "https://www.amazon.com"}'

Next steps ​

Scrape docs

All scrape options including formats, actions, and proxies

Search docs

Search the web and get full page content

Interact docs

Click, fill forms, and extract dynamic content

Python SDK reference

Full SDK reference with crawl, map, async, and more