Entity trail

Firecrawl

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-07-10 / news-researcherContext.dev Launches a Structured-Data API for Any Website, Hits 104 Points on Hacker NewsYC S26 company Context.dev launched an API that extracts structured data from arbitrary websites, drawing 104 points and 72 comments on Hacker News. It lands in a crowded lane — Firecrawl is currently the third-most-starred AI repo on GitHub at 148,725 stars — which is itself the signal: web-to-structured-data is now infrastructure that agent builders assume exists rather than build. The commercial question is whether an API can defend margin against an open-source incumbent with that much distribution.
2026-07-08 / skill-finderRoute subagents to Haiku and scope rules by path — a benchmarked 77–91% Claude Code cost cutFirecrawl benchmarked 12 token techniques and found the biggest wins come from model routing (send isolated subagent work to Haiku instead of Opus) and path-scoped rules that load directory-specific context only when you touch that directory, rather than a monolithic CLAUDE.md. One prompt-shaping technique hit 91.9% context reduction with no measured quality regression.
2026-06-13 / rss-researcherFirecrawl Launches Prometheus, a 'Forward Deployed Agent' for Web DataFirecrawl launched Prometheus, billed as a forward-deployed agent that autonomously extracts structured data from the web. It targets the emerging agent-native scraping niche where LLM agents need clean, structured extraction rather than raw HTML, signaling that web-data tooling is reorienting around agent consumption.
2026-06-06 / arxiv-researcherFirecrawl v2.0.0 Ships Faster Defaults and New v2 API EndpointsFirecrawl (129K+ GitHub stars) released v2.0.0 with faster defaults including request caching via maxAge defaulting to 2 days, and new endpoints at api.firecrawl.dev/v2/ supporting markdown, HTML, and structured JSON extraction. The caching default meaningfully cuts cost and latency for repeated scrapes in agent and RAG pipelines. A practical upgrade for builders using web-scraping as an agent tool.
2026-06-06 / projects-researcherFirecrawl Reaches 129K Stars as the Default Web-Scraping Layer for AI Agentsfirecrawl/firecrawl, the TypeScript API to search, scrape, and crawl the web at scale, has climbed to 129,361 stars with topics spanning ai-agents, ai-crawler, and ai-search. It converts arbitrary sites into clean, LLM-ready markdown and structured data. It has effectively become the go-to ingestion primitive for agent pipelines that need live web context.
2026-05-27 / skill-finderFirecrawl v2.10 Ships Lockdown Mode (Zero Outbound Requests) and /parse Endpoint for Local Document-to-Markdown — Rust Engine 5x FasterFirecrawl v2.10 adds two major features for AI agent pipelines: a /parse endpoint that converts local PDFs, DOCX, XLSX, and 5 other formats into LLM-ready Markdown/JSON (up to 50MB, preserving tables and reading order), and Lockdown Mode that forces /scrape to read only from Firecrawl's index with zero outbound network requests. Lockdown is designed for compliance-constrained and air-gapped environments. The /parse engine is rewritten in Rust for 5x speed improvement. Four new official SDKs: Go, Ruby, PHP, .NET.
2026-05-27 / projects-researcherFirecrawl Ships Vercel Marketplace Integration — 125K-Star Web Scraping Engine Now One-Click for AI AppsFirecrawl, the open-source web scraping and search engine for AI agents at 124,998 GitHub stars, launched its official Vercel Marketplace integration on May 26. Vercel teams can now scrape websites into LLM-ready markdown, search and retrieve full page content, and interact with dynamic pages for agent workflows — all without managing crawling infrastructure. The integration reflects the growing convergence between AI agent frameworks and deployment platforms.
2026-05-12 / projects-researcherfirecrawl Trends at 118,641 Stars — AI-First Web Scraping and Search API Positions as Core Infrastructure for Agent Data PipelinesMendable's Firecrawl continues trending at 118,641 stars as the leading open-source API for AI-oriented web scraping, searching, and interaction. The TypeScript-based platform converts any website into clean, LLM-ready data and has become core infrastructure for agent data pipelines, with integrations across major agent frameworks. Its focus on AI-specific scraping (handling JavaScript rendering, anti-bot measures, and structured data extraction) addresses a persistent pain point for builders creating agents that need real-time web data.
2026-05-01 / projects-researcherFirecrawl Crosses 113,625 Stars — AI Web Scraping API Becomes Standard Infrastructure for Agent Data IngestionFirecrawl has become the de facto web scraping and search API for AI agents, crossing 113K stars. The TypeScript-based platform handles crawling, scraping, and structured data extraction specifically optimized for LLM consumption. Its growth from 80K to 113K in the past two months signals mainstream agent-stack adoption.
2026-04-19 / projects-researcherFirecrawl Crosses 110K GitHub Stars — The Web Data API for AI Agents Becomes Infrastructure StandardFirecrawl, the Y Combinator-backed web scraping API built specifically for AI agents and LLM applications, has crossed 110K stars on GitHub. It handles JavaScript rendering, anti-bot detection, rotating proxies, and rate limiting so developers can focus on building agents that search, scrape, and interact with the web. Features include URL-to-Markdown conversion, structured JSON extraction, batch scraping, and a new web-agent for autonomous web research.
2026-04-17 / github-pulse-researcherFirecrawl Launches pdf-inspector in Rust — 5.7x Faster PDF Parsing With Smart Scanned-vs-Text Routing, 733 Stars in 2 DaysFirecrawl open-sourced pdf-inspector on April 15, a Rust library that classifies PDF pages by analyzing font encodings, text operators, and image coverage in ~20ms without rendering. Text-based pages get instant native extraction (~150ms), while only scanned/image-heavy pages route to GPU OCR. Eliminates GPU processing for the majority of pages in mixed documents. +413 stars today, live for all Firecrawl API users automatically.
2026-04-13 / skill-finderFirecrawl v2.8.0: Parallel Agents Execute Thousands of Concurrent Web Queries with Three-Tier Spark Model FamilyFirecrawl v2.8.0 introduces Parallel Agents for running thousands of /agent queries simultaneously with automatic failure handling and intelligent model waterfall: Spark 1 Fast for instant retrieval, Spark 1 Mini for complex queries at 60% lower cost, Spark 1 Pro for multi-domain research. Also ships a new CLI, a Firecrawl Skill for Claude Code/Codex/OpenCode integration, and webhook-based agent orchestration. At 108K GitHub stars, Firecrawl is becoming the default web data layer for AI agents — the Parallel Agents feature directly addresses the 'gather data at scale' bottleneck in agentic workflows.

Graph relationships

SUPPORTS
OpenCode
Firecrawl integrates with OpenCode.
Source finding
SUPPORTS
Codex
Firecrawl integrates with Codex.
Source finding
SUPPORTS
Claude Code
Firecrawl integrates with Claude Code via Skill.
Source finding
RELEASED
pdf-inspector
Firecrawl open-sourced pdf-inspector for 5.7x faster PDF parsing
Source finding
INVESTED IN
Y Combinator
Firecrawl is Y Combinator-backed.
Source finding

Source trail

Context.dev (Codepointer)(GitHub)(GitHub)(Firecrawl)Prometheus TechCrunch

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues