— Use case

Live web intelligence for AI agents and RAG

Live web intelligence for AI agents and RAG Crawl, extract, and deliver structured web intelligence via API.

Pain points

  • Agents hallucinate when training data is stale
  • Broad web search wastes tokens on irrelevant domains
  • No structured plan for which sites to read first

Architecture

  1. Seed a domain → GET /graph/domain-context
  2. Rank inbound/outbound/related domains
  3. GET /graph/top-pages for scrapable URLs
  4. POST /scrape → embed → answer with citations

Example output

{
  "seed_domain": "stripe.com",
  "context_for_ai": "8 strong referrers, 12 destinations...",
  "top_inbound_domains": [{ "domain": "ycombinator.com", "niche_score": 1.0 }]
}

FAQ

How fast can I start?

Sign up free, create an API key, and call /graph/domain-context or /scrape in minutes. See /docs for curl examples.

Is output AI-ready?

Yes — structured JSON, context_for_ai summaries, and link graphs designed for agents and RAG pipelines.