FireCrawl
FireCrawl crawls and converts any website into LLM-ready data. It crawls all accessible subpages and give you clean markdown and metadata for each. No sitemap required.
安装与设置
安装 Python SDK:
pip install firecrawl-py==0.0.20
文档加载器
查看一个 使用示例。
from langchain_community.document_loaders import FireCrawlLoader
API 参考:FireCrawlLoader